2026-02-25T17:06:22.120 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-25T17:06:22.136 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T17:06:22.223 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-25_15:27:50-fs-reef-release-distro-default-trial/70419 branch: reef-release description: fs/upgrade/nofs/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-from/quincy 1-upgrade}} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '70419' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial meta: - desc: 'install ceph/quincy latest ' name: yuriw-2026-02-25_15:27:50-fs-reef-release-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: reef-release ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on osd down out interval zero: false mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - MGR_MODULE_ERROR - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - pg .* is stuck peering - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request sha1: 0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef-release sha1: 0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 seed: 6885 sha1: 0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: reef-release suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28 targets: trial076.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMLPnO86r44UbPj0jSFK40saUtolmS/AgstCCRAR1bxCrU/4rtKZH5bY9NCoa9oVr65GFvxEKZYraR9vUoNniYI= tasks: - install: branch: quincy exclude_packages: - librados3 - ceph-mgr-dashboard - ceph-mgr-diskprediction-local - ceph-mgr-rook - ceph-mgr-cephadm - cephadm - ceph-volume extra_packages: - librados2 - print: '**** done installing quincy' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client quincy - print: '**** done ceph' - print: '*** upgrading, no cephfs present' - exec: mon.a: - ceph fs dump - install.upgrade: mon.a: null - print: '**** done install.upgrade' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph versions - ceph osd dump -f json-pretty - ceph fs dump - ceph osd require-osd-release reef - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph.healthy: null - print: '**** done ceph.restart' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-25_15:27:50 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699 2026-02-25T17:06:22.223 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28/qa; will attempt to use it 2026-02-25T17:06:22.224 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28/qa/tasks 2026-02-25T17:06:22.224 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-25T17:06:22.225 INFO:teuthology.task.internal:Checking packages... 2026-02-25T17:06:22.225 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28' 2026-02-25T17:06:22.225 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-25T17:06:22.225 INFO:teuthology.packaging:ref: None 2026-02-25T17:06:22.225 INFO:teuthology.packaging:tag: None 2026-02-25T17:06:22.225 INFO:teuthology.packaging:branch: reef-release 2026-02-25T17:06:22.225 INFO:teuthology.packaging:sha1: 0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28 2026-02-25T17:06:22.226 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef-release 2026-02-25T17:06:22.344 INFO:teuthology.task.internal:Found packages for ceph version 18.2.7-1050.g0ef62ce8 2026-02-25T17:06:22.345 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-25T17:06:22.357 INFO:teuthology.task.internal:no buildpackages task found 2026-02-25T17:06:22.357 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-25T17:06:22.369 INFO:teuthology.task.internal:Saving configuration 2026-02-25T17:06:22.383 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-25T17:06:22.396 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-25T17:06:22.466 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial076.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-25_15:27:50-fs-reef-release-distro-default-trial/70419', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-25 17:02:52.494156', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMLPnO86r44UbPj0jSFK40saUtolmS/AgstCCRAR1bxCrU/4rtKZH5bY9NCoa9oVr65GFvxEKZYraR9vUoNniYI='} 2026-02-25T17:06:22.466 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-25T17:06:22.477 INFO:teuthology.task.internal:roles: ubuntu@trial076.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2026-02-25T17:06:22.477 INFO:teuthology.run_tasks:Running task console_log... 2026-02-25T17:06:22.556 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7b5d2b93c4a0>, signals=[15]) 2026-02-25T17:06:22.556 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-25T17:06:22.567 INFO:teuthology.task.internal:Opening connections... 2026-02-25T17:06:22.567 DEBUG:teuthology.task.internal:connecting to ubuntu@trial076.front.sepia.ceph.com 2026-02-25T17:06:22.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T17:06:22.631 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-25T17:06:22.642 DEBUG:teuthology.orchestra.run.trial076:> uname -m 2026-02-25T17:06:22.708 INFO:teuthology.orchestra.run.trial076.stdout:x86_64 2026-02-25T17:06:22.708 DEBUG:teuthology.orchestra.run.trial076:> cat /etc/os-release 2026-02-25T17:06:22.764 INFO:teuthology.orchestra.run.trial076.stdout:NAME="CentOS Stream" 2026-02-25T17:06:22.764 INFO:teuthology.orchestra.run.trial076.stdout:VERSION="9" 2026-02-25T17:06:22.764 INFO:teuthology.orchestra.run.trial076.stdout:ID="centos" 2026-02-25T17:06:22.764 INFO:teuthology.orchestra.run.trial076.stdout:ID_LIKE="rhel fedora" 2026-02-25T17:06:22.764 INFO:teuthology.orchestra.run.trial076.stdout:VERSION_ID="9" 2026-02-25T17:06:22.764 INFO:teuthology.orchestra.run.trial076.stdout:PLATFORM_ID="platform:el9" 2026-02-25T17:06:22.764 INFO:teuthology.orchestra.run.trial076.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-25T17:06:22.764 INFO:teuthology.orchestra.run.trial076.stdout:ANSI_COLOR="0;31" 2026-02-25T17:06:22.764 INFO:teuthology.orchestra.run.trial076.stdout:LOGO="fedora-logo-icon" 2026-02-25T17:06:22.764 INFO:teuthology.orchestra.run.trial076.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-25T17:06:22.764 INFO:teuthology.orchestra.run.trial076.stdout:HOME_URL="https://centos.org/" 2026-02-25T17:06:22.764 INFO:teuthology.orchestra.run.trial076.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-25T17:06:22.764 INFO:teuthology.orchestra.run.trial076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-25T17:06:22.764 INFO:teuthology.orchestra.run.trial076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-25T17:06:22.765 INFO:teuthology.lock.ops:Updating trial076.front.sepia.ceph.com on lock server 2026-02-25T17:06:22.845 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-25T17:06:22.858 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-25T17:06:22.873 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-25T17:06:22.874 DEBUG:teuthology.orchestra.run.trial076:> test '!' -e /home/ubuntu/cephtest 2026-02-25T17:06:22.888 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-25T17:06:22.899 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-25T17:06:22.899 DEBUG:teuthology.orchestra.run.trial076:> test -z $(ls -A /var/lib/ceph) 2026-02-25T17:06:22.946 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-25T17:06:23.050 INFO:teuthology.run_tasks:Running task kernel... 2026-02-25T17:06:23.070 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-25T17:06:23.070 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-25T17:06:23.070 DEBUG:teuthology.orchestra.run.trial076:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-25T17:06:23.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T17:06:23.085 DEBUG:teuthology.orchestra.run.trial076:> uname -r 2026-02-25T17:06:23.140 INFO:teuthology.orchestra.run.trial076.stdout:5.14.0-681.el9.x86_64 2026-02-25T17:06:23.140 INFO:teuthology.task.kernel:Running kernel on trial076: 5.14.0-681.el9.x86_64 2026-02-25T17:06:23.140 DEBUG:teuthology.orchestra.run.trial076:> sudo yum install -y kernel 2026-02-25T17:06:29.501 INFO:teuthology.orchestra.run.trial076.stdout:CentOS Stream 9 - BaseOS 1.5 MB/s | 8.9 MB 00:05 2026-02-25T17:06:32.623 INFO:teuthology.orchestra.run.trial076.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-25T17:06:35.921 INFO:teuthology.orchestra.run.trial076.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 8.0 MB 00:00 2026-02-25T17:06:36.746 INFO:teuthology.orchestra.run.trial076.stdout:CentOS Stream 9 - Extras packages 251 kB/s | 20 kB 00:00 2026-02-25T17:06:37.255 INFO:teuthology.orchestra.run.trial076.stdout:Extra Packages for Enterprise Linux 46 MB/s | 20 MB 00:00 2026-02-25T17:06:40.504 INFO:teuthology.orchestra.run.trial076.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-25T17:06:41.514 INFO:teuthology.orchestra.run.trial076.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-25T17:06:41.514 INFO:teuthology.orchestra.run.trial076.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-25T17:06:41.534 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:06:41.535 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:06:41.535 INFO:teuthology.orchestra.run.trial076.stdout: Package Architecture Version Repository Size 2026-02-25T17:06:41.535 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:06:41.535 INFO:teuthology.orchestra.run.trial076.stdout:Installing: 2026-02-25T17:06:41.535 INFO:teuthology.orchestra.run.trial076.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-25T17:06:41.535 INFO:teuthology.orchestra.run.trial076.stdout:Installing dependencies: 2026-02-25T17:06:41.535 INFO:teuthology.orchestra.run.trial076.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-25T17:06:41.535 INFO:teuthology.orchestra.run.trial076.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-25T17:06:41.535 INFO:teuthology.orchestra.run.trial076.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-25T17:06:41.535 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:06:41.535 INFO:teuthology.orchestra.run.trial076.stdout:Transaction Summary 2026-02-25T17:06:41.535 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:06:41.535 INFO:teuthology.orchestra.run.trial076.stdout:Install 4 Packages 2026-02-25T17:06:41.535 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:06:41.535 INFO:teuthology.orchestra.run.trial076.stdout:Total download size: 89 M 2026-02-25T17:06:41.535 INFO:teuthology.orchestra.run.trial076.stdout:Installed size: 135 M 2026-02-25T17:06:41.535 INFO:teuthology.orchestra.run.trial076.stdout:Downloading Packages: 2026-02-25T17:06:44.142 INFO:teuthology.orchestra.run.trial076.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 363 kB/s | 901 kB 00:02 2026-02-25T17:06:57.893 INFO:teuthology.orchestra.run.trial076.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 1.1 MB/s | 17 MB 00:16 2026-02-25T17:07:09.447 INFO:teuthology.orchestra.run.trial076.stdout:(3/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 1.4 MB/s | 40 MB 00:27 2026-02-25T17:07:19.823 INFO:teuthology.orchestra.run.trial076.stdout:(4/4): kernel-modules-core-5.14.0-686.el9.x86_6 890 kB/s | 31 MB 00:35 2026-02-25T17:07:19.825 INFO:teuthology.orchestra.run.trial076.stdout:-------------------------------------------------------------------------------- 2026-02-25T17:07:19.825 INFO:teuthology.orchestra.run.trial076.stdout:Total 2.3 MB/s | 89 MB 00:38 2026-02-25T17:07:20.019 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction check 2026-02-25T17:07:20.226 INFO:teuthology.orchestra.run.trial076.stdout:Transaction check succeeded. 2026-02-25T17:07:20.226 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction test 2026-02-25T17:07:20.612 INFO:teuthology.orchestra.run.trial076.stdout:Transaction test succeeded. 2026-02-25T17:07:20.612 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction 2026-02-25T17:07:21.724 INFO:teuthology.orchestra.run.trial076.stdout: Preparing : 1/1 2026-02-25T17:07:22.011 INFO:teuthology.orchestra.run.trial076.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-25T17:07:22.033 INFO:teuthology.orchestra.run.trial076.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T17:07:24.589 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T17:07:24.623 INFO:teuthology.orchestra.run.trial076.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T17:07:27.874 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T17:07:27.881 INFO:teuthology.orchestra.run.trial076.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T17:07:30.929 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T17:07:48.350 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T17:07:48.371 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-25T17:07:48.557 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-25T17:07:48.557 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-25T17:07:48.558 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-25T17:07:48.558 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-25T17:07:48.616 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-25T17:07:48.616 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:07:48.616 INFO:teuthology.orchestra.run.trial076.stdout:Installed: 2026-02-25T17:07:48.616 INFO:teuthology.orchestra.run.trial076.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-25T17:07:48.616 INFO:teuthology.orchestra.run.trial076.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-25T17:07:48.616 INFO:teuthology.orchestra.run.trial076.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-25T17:07:48.616 INFO:teuthology.orchestra.run.trial076.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-25T17:07:48.616 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:07:48.616 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:07:48.680 DEBUG:teuthology.orchestra.run.trial076:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T17:07:48.708 INFO:teuthology.orchestra.run.trial076.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T17:07:48.709 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T17:07:48.709 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-25T17:07:48.709 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-25T17:07:48.709 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-25T17:07:48.709 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-25T17:07:48.709 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial076.front.sepia.ceph.com, path=None, version=distro) 2026-02-25T17:07:48.709 DEBUG:teuthology.orchestra.run.trial076:> rpm -q kernel | sort -rV | head -n 1 2026-02-25T17:07:48.774 INFO:teuthology.orchestra.run.trial076.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-25T17:07:48.775 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-25T17:07:48.775 DEBUG:teuthology.orchestra.run.trial076:> sudo rpm -qi grub2-tools 2026-02-25T17:07:48.843 INFO:teuthology.orchestra.run.trial076.stdout:Name : grub2-tools 2026-02-25T17:07:48.843 INFO:teuthology.orchestra.run.trial076.stdout:Epoch : 1 2026-02-25T17:07:48.843 INFO:teuthology.orchestra.run.trial076.stdout:Version : 2.06 2026-02-25T17:07:48.843 INFO:teuthology.orchestra.run.trial076.stdout:Release : 120.el9 2026-02-25T17:07:48.844 INFO:teuthology.orchestra.run.trial076.stdout:Architecture: x86_64 2026-02-25T17:07:48.844 INFO:teuthology.orchestra.run.trial076.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-25T17:07:48.844 INFO:teuthology.orchestra.run.trial076.stdout:Group : Unspecified 2026-02-25T17:07:48.844 INFO:teuthology.orchestra.run.trial076.stdout:Size : 9108611 2026-02-25T17:07:48.844 INFO:teuthology.orchestra.run.trial076.stdout:License : GPLv3+ 2026-02-25T17:07:48.844 INFO:teuthology.orchestra.run.trial076.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-25T17:07:48.844 INFO:teuthology.orchestra.run.trial076.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-25T17:07:48.844 INFO:teuthology.orchestra.run.trial076.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-25T17:07:48.844 INFO:teuthology.orchestra.run.trial076.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-25T17:07:48.844 INFO:teuthology.orchestra.run.trial076.stdout:Packager : builder@centos.org 2026-02-25T17:07:48.844 INFO:teuthology.orchestra.run.trial076.stdout:Vendor : CentOS 2026-02-25T17:07:48.844 INFO:teuthology.orchestra.run.trial076.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-25T17:07:48.845 INFO:teuthology.orchestra.run.trial076.stdout:Summary : Support tools for GRUB. 2026-02-25T17:07:48.845 INFO:teuthology.orchestra.run.trial076.stdout:Description : 2026-02-25T17:07:48.845 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:07:48.845 INFO:teuthology.orchestra.run.trial076.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-25T17:07:48.845 INFO:teuthology.orchestra.run.trial076.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-25T17:07:48.845 INFO:teuthology.orchestra.run.trial076.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-25T17:07:48.845 INFO:teuthology.orchestra.run.trial076.stdout:hardware devices. 2026-02-25T17:07:48.845 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:07:48.845 INFO:teuthology.orchestra.run.trial076.stdout:This subpackage provides tools for support of all platforms. 2026-02-25T17:07:48.846 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-25T17:07:48.846 INFO:teuthology.task.kernel:Updating grub on trial076 to boot 5.14.0-686.el9.x86_64 2026-02-25T17:07:48.847 DEBUG:teuthology.orchestra.run.trial076:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-25T17:07:48.912 INFO:teuthology.orchestra.run.trial076.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-25T17:07:48.913 DEBUG:teuthology.orchestra.run.trial076:> sudo command -v grubby && echo yes || echo no 2026-02-25T17:07:48.977 INFO:teuthology.orchestra.run.trial076.stdout:/sbin/grubby 2026-02-25T17:07:48.977 INFO:teuthology.orchestra.run.trial076.stdout:yes 2026-02-25T17:07:48.978 DEBUG:teuthology.orchestra.run.trial076:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-25T17:07:49.042 INFO:teuthology.orchestra.run.trial076.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-25T17:07:49.043 DEBUG:teuthology.orchestra.run.trial076:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-25T17:07:49.114 DEBUG:teuthology.orchestra.run.trial076:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-25T17:07:49.322 INFO:teuthology.orchestra.run.trial076.stderr:Generating grub configuration file ... 2026-02-25T17:07:49.390 INFO:teuthology.orchestra.run.trial076.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-25T17:07:49.396 INFO:teuthology.orchestra.run.trial076.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-25T17:07:49.648 INFO:teuthology.orchestra.run.trial076.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-25T17:07:49.654 INFO:teuthology.orchestra.run.trial076.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-25T17:07:49.688 INFO:teuthology.orchestra.run.trial076.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-25T17:07:49.695 INFO:teuthology.orchestra.run.trial076.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-25T17:07:49.727 INFO:teuthology.orchestra.run.trial076.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-25T17:07:49.733 INFO:teuthology.orchestra.run.trial076.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-25T17:07:49.757 INFO:teuthology.orchestra.run.trial076.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-25T17:07:49.763 INFO:teuthology.orchestra.run.trial076.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-25T17:07:49.848 INFO:teuthology.orchestra.run.trial076.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-25T17:07:49.857 INFO:teuthology.orchestra.run.trial076.stderr:done 2026-02-25T17:07:49.859 DEBUG:teuthology.orchestra.run.trial076:> test -d /sys/firmware/efi 2026-02-25T17:07:49.876 DEBUG:teuthology.orchestra.run.trial076:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-25T17:07:49.941 INFO:teuthology.orchestra.run.trial076.stdout:/boot/efi/EFI/BOOT 2026-02-25T17:07:49.942 INFO:teuthology.orchestra.run.trial076.stdout:/boot/efi/EFI/centos 2026-02-25T17:07:49.943 DEBUG:teuthology.orchestra.run.trial076:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-25T17:07:50.009 INFO:teuthology.orchestra.run.trial076.stdout:no 2026-02-25T17:07:50.010 DEBUG:teuthology.orchestra.run.trial076:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-25T17:07:50.074 INFO:teuthology.orchestra.run.trial076.stdout:yes 2026-02-25T17:07:50.074 DEBUG:teuthology.orchestra.run.trial076:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-25T17:07:50.138 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial076 2026-02-25T17:07:50.138 DEBUG:teuthology.orchestra.run.trial076:> sudo bash -c ' 2026-02-25T17:07:50.138 DEBUG:teuthology.orchestra.run.trial076:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-25T17:07:50.138 DEBUG:teuthology.orchestra.run.trial076:> ' 2026-02-25T17:08:20.181 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-25T17:08:20.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial076.front.sepia.ceph.com' 2026-02-25T17:08:20.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T17:08:34.432 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.76 2026-02-25T17:08:43.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial076.front.sepia.ceph.com' 2026-02-25T17:08:43.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T17:09:19.497 DEBUG:teuthology.orchestra.run.trial076:> true 2026-02-25T17:09:19.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial076.front.sepia.ceph.com' 2026-02-25T17:09:19.652 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-686.el9.x86_64"... 2026-02-25T17:09:19.652 DEBUG:teuthology.orchestra.run.trial076:> uname -r 2026-02-25T17:09:19.708 INFO:teuthology.orchestra.run.trial076.stdout:5.14.0-686.el9.x86_64 2026-02-25T17:09:19.708 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-25T17:09:19.708 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-25T17:09:19.708 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-25T17:09:20.709 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-25T17:09:20.710 DEBUG:teuthology.orchestra.run.trial076:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-25T17:09:20.739 INFO:teuthology.orchestra.run.trial076.stdout:ttyS1 2026-02-25T17:09:20.771 DEBUG:teuthology.parallel:result is None 2026-02-25T17:09:20.771 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-25T17:09:20.782 INFO:teuthology.task.internal:Creating test directory... 2026-02-25T17:09:20.783 DEBUG:teuthology.orchestra.run.trial076:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-25T17:09:20.827 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-25T17:09:20.842 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-25T17:09:20.857 INFO:teuthology.task.internal:Creating archive directory... 2026-02-25T17:09:20.858 DEBUG:teuthology.orchestra.run.trial076:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-25T17:09:20.889 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-25T17:09:20.900 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-25T17:09:20.901 DEBUG:teuthology.orchestra.run.trial076:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-25T17:09:20.947 INFO:teuthology.orchestra.run.trial076.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T17:09:20.956 INFO:teuthology.orchestra.run.trial076.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-25T17:09:20.957 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-25T17:09:20.970 INFO:teuthology.task.internal:Configuring sudo... 2026-02-25T17:09:20.970 DEBUG:teuthology.orchestra.run.trial076:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-25T17:09:21.021 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-25T17:09:21.034 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-25T17:09:21.034 DEBUG:teuthology.orchestra.run.trial076:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-25T17:09:21.077 DEBUG:teuthology.orchestra.run.trial076:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T17:09:21.239 DEBUG:teuthology.orchestra.run.trial076:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T17:09:21.265 DEBUG:teuthology.orchestra.run.trial076:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T17:09:21.405 DEBUG:teuthology.orchestra.run.trial076:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T17:09:21.430 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:09:21.430 DEBUG:teuthology.orchestra.run.trial076:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-25T17:09:21.494 DEBUG:teuthology.orchestra.run.trial076:> sudo service rsyslog restart 2026-02-25T17:09:21.561 INFO:teuthology.orchestra.run.trial076.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T17:09:21.960 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-25T17:09:21.973 INFO:teuthology.task.internal:Starting timer... 2026-02-25T17:09:21.974 INFO:teuthology.run_tasks:Running task pcp... 2026-02-25T17:09:21.998 INFO:teuthology.run_tasks:Running task selinux... 2026-02-25T17:09:22.015 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2026-02-25T17:09:22.016 DEBUG:teuthology.orchestra.run.trial076:> sudo service auditd rotate 2026-02-25T17:09:22.044 INFO:teuthology.orchestra.run.trial076.stdout:Rotating logs: 2026-02-25T17:09:22.046 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-25T17:09:22.046 DEBUG:teuthology.orchestra.run.trial076:> /usr/sbin/getenforce 2026-02-25T17:09:22.103 INFO:teuthology.orchestra.run.trial076.stdout:Permissive 2026-02-25T17:09:22.104 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial076.front.sepia.ceph.com': 'permissive'} 2026-02-25T17:09:22.104 DEBUG:teuthology.orchestra.run.trial076:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-25T17:09:22.167 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T17:09:22.168 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-25T17:09:22.168 DEBUG:teuthology.orchestra.run.trial076:> sudo /usr/sbin/setenforce permissive 2026-02-25T17:09:22.233 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-25T17:09:22.249 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-25T17:09:22.263 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-25T17:09:22.264 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial076.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-25T17:12:20.695 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial076.front.sepia.ceph.com')] 2026-02-25T17:12:20.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial076.front.sepia.ceph.com' 2026-02-25T17:12:20.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-25T17:12:20.765 DEBUG:teuthology.orchestra.run.trial076:> true 2026-02-25T17:12:20.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial076.front.sepia.ceph.com' 2026-02-25T17:12:20.841 INFO:teuthology.run_tasks:Running task clock... 2026-02-25T17:12:20.853 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-25T17:12:20.853 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-25T17:12:20.853 DEBUG:teuthology.orchestra.run.trial076:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T17:12:20.908 INFO:teuthology.orchestra.run.trial076.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-25T17:12:20.920 INFO:teuthology.orchestra.run.trial076.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-25T17:12:20.940 INFO:teuthology.orchestra.run.trial076.stderr:sudo: ntpd: command not found 2026-02-25T17:12:20.950 INFO:teuthology.orchestra.run.trial076.stdout:506 Cannot talk to daemon 2026-02-25T17:12:20.962 INFO:teuthology.orchestra.run.trial076.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-25T17:12:20.973 INFO:teuthology.orchestra.run.trial076.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-25T17:12:21.018 INFO:teuthology.orchestra.run.trial076.stderr:bash: line 1: ntpq: command not found 2026-02-25T17:12:21.020 INFO:teuthology.orchestra.run.trial076.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T17:12:21.020 INFO:teuthology.orchestra.run.trial076.stdout:=============================================================================== 2026-02-25T17:12:21.021 INFO:teuthology.run_tasks:Running task install... 2026-02-25T17:12:21.033 DEBUG:teuthology.task.install:project ceph 2026-02-25T17:12:21.033 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28'}} 2026-02-25T17:12:21.033 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': '0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28'} 2026-02-25T17:12:21.033 INFO:teuthology.task.install:Using flavor: default 2026-02-25T17:12:21.035 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-25T17:12:21.035 INFO:teuthology.task.install:extra packages: ['librados2'] 2026-02-25T17:12:21.036 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28', 'tag': None, 'wait_for_package': False} 2026-02-25T17:12:21.036 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-25T17:12:21.036 INFO:teuthology.packaging:ref: None 2026-02-25T17:12:21.036 INFO:teuthology.packaging:tag: None 2026-02-25T17:12:21.036 INFO:teuthology.packaging:branch: quincy 2026-02-25T17:12:21.036 INFO:teuthology.packaging:sha1: 0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28 2026-02-25T17:12:21.036 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2026-02-25T17:12:21.179 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/quincy/69bf48f20731a4b0d742613f6c6335ccb54dd217/centos/9/flavors/default/ 2026-02-25T17:12:21.179 INFO:teuthology.task.install.rpm:Package version is 17.2.9-0 2026-02-25T17:12:21.326 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/quincy/69bf48f20731a4b0d742613f6c6335ccb54dd217/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/quincy/69bf48f20731a4b0d742613f6c6335ccb54dd217/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/quincy/69bf48f20731a4b0d742613f6c6335ccb54dd217/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-25T17:12:21.327 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:12:21.327 DEBUG:teuthology.orchestra.run.trial076:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-25T17:12:21.353 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2026-02-25T17:12:21.353 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-25T17:12:21.353 INFO:teuthology.packaging:ref: None 2026-02-25T17:12:21.353 INFO:teuthology.packaging:tag: None 2026-02-25T17:12:21.353 INFO:teuthology.packaging:branch: quincy 2026-02-25T17:12:21.353 INFO:teuthology.packaging:sha1: 0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28 2026-02-25T17:12:21.353 DEBUG:teuthology.orchestra.run.trial076:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-25T17:12:21.418 DEBUG:teuthology.orchestra.run.trial076:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-25T17:12:21.493 DEBUG:teuthology.orchestra.run.trial076:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-25T17:12:21.555 INFO:teuthology.orchestra.run.trial076.stdout:check_obsoletes = 1 2026-02-25T17:12:21.556 DEBUG:teuthology.orchestra.run.trial076:> sudo yum clean all 2026-02-25T17:12:21.709 INFO:teuthology.orchestra.run.trial076.stdout:41 files removed 2026-02-25T17:12:21.725 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y install ceph-radosgw 2026-02-25T17:12:21.961 INFO:teuthology.orchestra.run.trial076.stdout:ceph packages for x86_64 877 kB/s | 77 kB 00:00 2026-02-25T17:12:22.059 INFO:teuthology.orchestra.run.trial076.stdout:ceph noarch packages 148 kB/s | 11 kB 00:00 2026-02-25T17:12:22.151 INFO:teuthology.orchestra.run.trial076.stdout:ceph source packages 30 kB/s | 2.1 kB 00:00 2026-02-25T17:12:23.149 INFO:teuthology.orchestra.run.trial076.stdout:CentOS Stream 9 - BaseOS 9.1 MB/s | 8.9 MB 00:00 2026-02-25T17:12:24.201 INFO:teuthology.orchestra.run.trial076.stdout:CentOS Stream 9 - AppStream 52 MB/s | 27 MB 00:00 2026-02-25T17:12:27.933 INFO:teuthology.orchestra.run.trial076.stdout:CentOS Stream 9 - CRB 6.1 MB/s | 8.0 MB 00:01 2026-02-25T17:12:28.840 INFO:teuthology.orchestra.run.trial076.stdout:CentOS Stream 9 - Extras packages 121 kB/s | 20 kB 00:00 2026-02-25T17:12:29.740 INFO:teuthology.orchestra.run.trial076.stdout:Extra Packages for Enterprise Linux 24 MB/s | 20 MB 00:00 2026-02-25T17:12:33.003 INFO:teuthology.orchestra.run.trial076.stdout:lab-extras 1.5 MB/s | 50 kB 00:00 2026-02-25T17:12:34.208 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:12:34.210 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:34.210 INFO:teuthology.orchestra.run.trial076.stdout: Package Arch Version Repository Size 2026-02-25T17:12:34.210 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:34.210 INFO:teuthology.orchestra.run.trial076.stdout:Installing: 2026-02-25T17:12:34.210 INFO:teuthology.orchestra.run.trial076.stdout: ceph-radosgw x86_64 2:17.2.9-0.el9 ceph 14 M 2026-02-25T17:12:34.210 INFO:teuthology.orchestra.run.trial076.stdout:Upgrading: 2026-02-25T17:12:34.210 INFO:teuthology.orchestra.run.trial076.stdout: librados2 x86_64 2:17.2.9-0.el9 ceph 3.1 M 2026-02-25T17:12:34.210 INFO:teuthology.orchestra.run.trial076.stdout: librbd1 x86_64 2:17.2.9-0.el9 ceph 2.9 M 2026-02-25T17:12:34.211 INFO:teuthology.orchestra.run.trial076.stdout:Installing dependencies: 2026-02-25T17:12:34.211 INFO:teuthology.orchestra.run.trial076.stdout: ceph-base x86_64 2:17.2.9-0.el9 ceph 5.0 M 2026-02-25T17:12:34.211 INFO:teuthology.orchestra.run.trial076.stdout: ceph-common x86_64 2:17.2.9-0.el9 ceph 22 M 2026-02-25T17:12:34.211 INFO:teuthology.orchestra.run.trial076.stdout: ceph-selinux x86_64 2:17.2.9-0.el9 ceph 25 k 2026-02-25T17:12:34.211 INFO:teuthology.orchestra.run.trial076.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-25T17:12:34.211 INFO:teuthology.orchestra.run.trial076.stdout: libcephfs2 x86_64 2:17.2.9-0.el9 ceph 637 k 2026-02-25T17:12:34.211 INFO:teuthology.orchestra.run.trial076.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-25T17:12:34.211 INFO:teuthology.orchestra.run.trial076.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-25T17:12:34.211 INFO:teuthology.orchestra.run.trial076.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-25T17:12:34.211 INFO:teuthology.orchestra.run.trial076.stdout: libradosstriper1 x86_64 2:17.2.9-0.el9 ceph 457 k 2026-02-25T17:12:34.212 INFO:teuthology.orchestra.run.trial076.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-25T17:12:34.212 INFO:teuthology.orchestra.run.trial076.stdout: librgw2 x86_64 2:17.2.9-0.el9 ceph 4.9 M 2026-02-25T17:12:34.212 INFO:teuthology.orchestra.run.trial076.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-25T17:12:34.212 INFO:teuthology.orchestra.run.trial076.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-25T17:12:34.212 INFO:teuthology.orchestra.run.trial076.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-25T17:12:34.212 INFO:teuthology.orchestra.run.trial076.stdout: python3-ceph-argparse x86_64 2:17.2.9-0.el9 ceph 45 k 2026-02-25T17:12:34.212 INFO:teuthology.orchestra.run.trial076.stdout: python3-ceph-common x86_64 2:17.2.9-0.el9 ceph 120 k 2026-02-25T17:12:34.212 INFO:teuthology.orchestra.run.trial076.stdout: python3-cephfs x86_64 2:17.2.9-0.el9 ceph 157 k 2026-02-25T17:12:34.212 INFO:teuthology.orchestra.run.trial076.stdout: python3-rados x86_64 2:17.2.9-0.el9 ceph 320 k 2026-02-25T17:12:34.212 INFO:teuthology.orchestra.run.trial076.stdout: python3-rbd x86_64 2:17.2.9-0.el9 ceph 296 k 2026-02-25T17:12:34.212 INFO:teuthology.orchestra.run.trial076.stdout: python3-rgw x86_64 2:17.2.9-0.el9 ceph 100 k 2026-02-25T17:12:34.213 INFO:teuthology.orchestra.run.trial076.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-25T17:12:34.213 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:34.213 INFO:teuthology.orchestra.run.trial076.stdout:Transaction Summary 2026-02-25T17:12:34.213 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:34.213 INFO:teuthology.orchestra.run.trial076.stdout:Install 22 Packages 2026-02-25T17:12:34.213 INFO:teuthology.orchestra.run.trial076.stdout:Upgrade 2 Packages 2026-02-25T17:12:34.213 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:34.214 INFO:teuthology.orchestra.run.trial076.stdout:Total download size: 58 M 2026-02-25T17:12:34.214 INFO:teuthology.orchestra.run.trial076.stdout:Downloading Packages: 2026-02-25T17:12:35.387 INFO:teuthology.orchestra.run.trial076.stdout:(1/24): ceph-base-17.2.9-0.el9.x86_64.rpm 7.4 MB/s | 5.0 MB 00:00 2026-02-25T17:12:35.398 INFO:teuthology.orchestra.run.trial076.stdout:(2/24): ceph-selinux-17.2.9-0.el9.x86_64.rpm 2.3 MB/s | 25 kB 00:00 2026-02-25T17:12:35.427 INFO:teuthology.orchestra.run.trial076.stdout:(3/24): libcephfs2-17.2.9-0.el9.x86_64.rpm 22 MB/s | 637 kB 00:00 2026-02-25T17:12:35.446 INFO:teuthology.orchestra.run.trial076.stdout:(4/24): libradosstriper1-17.2.9-0.el9.x86_64.rp 24 MB/s | 457 kB 00:00 2026-02-25T17:12:35.560 INFO:teuthology.orchestra.run.trial076.stdout:(5/24): librgw2-17.2.9-0.el9.x86_64.rpm 43 MB/s | 4.9 MB 00:00 2026-02-25T17:12:35.569 INFO:teuthology.orchestra.run.trial076.stdout:(6/24): python3-ceph-argparse-17.2.9-0.el9.x86_ 4.7 MB/s | 45 kB 00:00 2026-02-25T17:12:35.579 INFO:teuthology.orchestra.run.trial076.stdout:(7/24): python3-ceph-common-17.2.9-0.el9.x86_64 12 MB/s | 120 kB 00:00 2026-02-25T17:12:35.589 INFO:teuthology.orchestra.run.trial076.stdout:(8/24): python3-cephfs-17.2.9-0.el9.x86_64.rpm 16 MB/s | 157 kB 00:00 2026-02-25T17:12:35.600 INFO:teuthology.orchestra.run.trial076.stdout:(9/24): python3-rados-17.2.9-0.el9.x86_64.rpm 27 MB/s | 320 kB 00:00 2026-02-25T17:12:35.620 INFO:teuthology.orchestra.run.trial076.stdout:(10/24): ceph-radosgw-17.2.9-0.el9.x86_64.rpm 16 MB/s | 14 MB 00:00 2026-02-25T17:12:35.621 INFO:teuthology.orchestra.run.trial076.stdout:(11/24): python3-rbd-17.2.9-0.el9.x86_64.rpm 14 MB/s | 296 kB 00:00 2026-02-25T17:12:35.631 INFO:teuthology.orchestra.run.trial076.stdout:(12/24): python3-rgw-17.2.9-0.el9.x86_64.rpm 8.4 MB/s | 100 kB 00:00 2026-02-25T17:12:35.704 INFO:teuthology.orchestra.run.trial076.stdout:(13/24): mailcap-2.1.49-5.el9.noarch.rpm 402 kB/s | 33 kB 00:00 2026-02-25T17:12:35.790 INFO:teuthology.orchestra.run.trial076.stdout:(14/24): ceph-common-17.2.9-0.el9.x86_64.rpm 21 MB/s | 22 MB 00:01 2026-02-25T17:12:36.193 INFO:teuthology.orchestra.run.trial076.stdout:(15/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 92 kB/s | 45 kB 00:00 2026-02-25T17:12:36.519 INFO:teuthology.orchestra.run.trial076.stdout:(16/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 180 kB/s | 160 kB 00:00 2026-02-25T17:12:36.588 INFO:teuthology.orchestra.run.trial076.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 740 kB/s | 292 kB 00:00 2026-02-25T17:12:36.739 INFO:teuthology.orchestra.run.trial076.stdout:(18/24): liboath-2.6.12-1.el9.x86_64.rpm 323 kB/s | 49 kB 00:00 2026-02-25T17:12:36.762 INFO:teuthology.orchestra.run.trial076.stdout:(19/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.2 MB/s | 308 kB 00:00 2026-02-25T17:12:36.810 INFO:teuthology.orchestra.run.trial076.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 959 kB/s | 67 kB 00:00 2026-02-25T17:12:36.896 INFO:teuthology.orchestra.run.trial076.stdout:(21/24): thrift-0.15.0-4.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2026-02-25T17:12:36.912 INFO:teuthology.orchestra.run.trial076.stdout:(22/24): librados2-17.2.9-0.el9.x86_64.rpm 30 MB/s | 3.1 MB 00:00 2026-02-25T17:12:36.972 INFO:teuthology.orchestra.run.trial076.stdout:(23/24): librbd1-17.2.9-0.el9.x86_64.rpm 38 MB/s | 2.9 MB 00:00 2026-02-25T17:12:36.980 INFO:teuthology.orchestra.run.trial076.stdout:(24/24): librdkafka-1.6.1-102.el9.x86_64.rpm 557 kB/s | 662 kB 00:01 2026-02-25T17:12:36.983 INFO:teuthology.orchestra.run.trial076.stdout:-------------------------------------------------------------------------------- 2026-02-25T17:12:36.983 INFO:teuthology.orchestra.run.trial076.stdout:Total 21 MB/s | 58 MB 00:02 2026-02-25T17:12:37.027 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction check 2026-02-25T17:12:37.042 INFO:teuthology.orchestra.run.trial076.stdout:Transaction check succeeded. 2026-02-25T17:12:37.042 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction test 2026-02-25T17:12:37.274 INFO:teuthology.orchestra.run.trial076.stdout:Transaction test succeeded. 2026-02-25T17:12:37.274 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction 2026-02-25T17:12:37.536 INFO:teuthology.orchestra.run.trial076.stdout: Preparing : 1/1 2026-02-25T17:12:37.679 INFO:teuthology.orchestra.run.trial076.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2026-02-25T17:12:37.682 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : librados2-2:17.2.9-0.el9.x86_64 2/26 2026-02-25T17:12:37.710 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: librados2-2:17.2.9-0.el9.x86_64 2/26 2026-02-25T17:12:37.737 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-rados-2:17.2.9-0.el9.x86_64 3/26 2026-02-25T17:12:37.738 INFO:teuthology.orchestra.run.trial076.stdout: Installing : libcephfs2-2:17.2.9-0.el9.x86_64 4/26 2026-02-25T17:12:37.759 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: libcephfs2-2:17.2.9-0.el9.x86_64 4/26 2026-02-25T17:12:37.767 INFO:teuthology.orchestra.run.trial076.stdout: Installing : thrift-0.15.0-4.el9.x86_64 5/26 2026-02-25T17:12:37.770 INFO:teuthology.orchestra.run.trial076.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2026-02-25T17:12:37.987 INFO:teuthology.orchestra.run.trial076.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2026-02-25T17:12:37.988 INFO:teuthology.orchestra.run.trial076.stdout: Installing : librgw2-2:17.2.9-0.el9.x86_64 8/26 2026-02-25T17:12:38.001 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: librgw2-2:17.2.9-0.el9.x86_64 8/26 2026-02-25T17:12:38.005 INFO:teuthology.orchestra.run.trial076.stdout: Installing : liboath-2.6.12-1.el9.x86_64 9/26 2026-02-25T17:12:38.015 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-ceph-argparse-2:17.2.9-0.el9.x86_64 10/26 2026-02-25T17:12:38.021 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-cephfs-2:17.2.9-0.el9.x86_64 11/26 2026-02-25T17:12:38.042 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-rgw-2:17.2.9-0.el9.x86_64 12/26 2026-02-25T17:12:38.043 INFO:teuthology.orchestra.run.trial076.stdout: Installing : libradosstriper1-2:17.2.9-0.el9.x86_64 13/26 2026-02-25T17:12:38.056 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: libradosstriper1-2:17.2.9-0.el9.x86_64 13/26 2026-02-25T17:12:38.063 INFO:teuthology.orchestra.run.trial076.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2026-02-25T17:12:38.067 INFO:teuthology.orchestra.run.trial076.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2026-02-25T17:12:38.204 INFO:teuthology.orchestra.run.trial076.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 16/26 2026-02-25T17:12:38.206 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : librbd1-2:17.2.9-0.el9.x86_64 17/26 2026-02-25T17:12:38.232 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: librbd1-2:17.2.9-0.el9.x86_64 17/26 2026-02-25T17:12:38.234 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-rbd-2:17.2.9-0.el9.x86_64 18/26 2026-02-25T17:12:38.257 INFO:teuthology.orchestra.run.trial076.stdout: Installing : mailcap-2.1.49-5.el9.noarch 19/26 2026-02-25T17:12:38.258 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-ceph-common-2:17.2.9-0.el9.x86_64 20/26 2026-02-25T17:12:39.292 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-common-2:17.2.9-0.el9.x86_64 21/26 2026-02-25T17:12:39.294 INFO:teuthology.orchestra.run.trial076.stdout: Installing : ceph-common-2:17.2.9-0.el9.x86_64 21/26 2026-02-25T17:12:39.562 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-common-2:17.2.9-0.el9.x86_64 21/26 2026-02-25T17:12:39.565 INFO:teuthology.orchestra.run.trial076.stdout: Installing : ceph-base-2:17.2.9-0.el9.x86_64 22/26 2026-02-25T17:12:39.610 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-base-2:17.2.9-0.el9.x86_64 22/26 2026-02-25T17:12:39.610 INFO:teuthology.orchestra.run.trial076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-25T17:12:39.610 INFO:teuthology.orchestra.run.trial076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-25T17:12:39.610 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:39.613 INFO:teuthology.orchestra.run.trial076.stdout: Installing : ceph-selinux-2:17.2.9-0.el9.x86_64 23/26 2026-02-25T17:12:44.105 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-selinux-2:17.2.9-0.el9.x86_64 23/26 2026-02-25T17:12:44.105 INFO:teuthology.orchestra.run.trial076.stdout:skipping the directory /sys 2026-02-25T17:12:44.105 INFO:teuthology.orchestra.run.trial076.stdout:skipping the directory /proc 2026-02-25T17:12:44.105 INFO:teuthology.orchestra.run.trial076.stdout:skipping the directory /mnt 2026-02-25T17:12:44.105 INFO:teuthology.orchestra.run.trial076.stdout:skipping the directory /var/tmp 2026-02-25T17:12:44.105 INFO:teuthology.orchestra.run.trial076.stdout:skipping the directory /home 2026-02-25T17:12:44.105 INFO:teuthology.orchestra.run.trial076.stdout:skipping the directory /root 2026-02-25T17:12:44.106 INFO:teuthology.orchestra.run.trial076.stdout:skipping the directory /tmp 2026-02-25T17:12:44.106 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:44.730 INFO:teuthology.orchestra.run.trial076.stdout: Installing : ceph-radosgw-2:17.2.9-0.el9.x86_64 24/26 2026-02-25T17:12:44.759 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-radosgw-2:17.2.9-0.el9.x86_64 24/26 2026-02-25T17:12:44.760 INFO:teuthology.orchestra.run.trial076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T17:12:44.760 INFO:teuthology.orchestra.run.trial076.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-25T17:12:44.760 INFO:teuthology.orchestra.run.trial076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T17:12:44.760 INFO:teuthology.orchestra.run.trial076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-25T17:12:44.760 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:44.761 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2026-02-25T17:12:44.773 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2026-02-25T17:12:44.774 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2026-02-25T17:12:45.090 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2026-02-25T17:12:45.090 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-base-2:17.2.9-0.el9.x86_64 1/26 2026-02-25T17:12:45.090 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-common-2:17.2.9-0.el9.x86_64 2/26 2026-02-25T17:12:45.090 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-radosgw-2:17.2.9-0.el9.x86_64 3/26 2026-02-25T17:12:45.091 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-selinux-2:17.2.9-0.el9.x86_64 4/26 2026-02-25T17:12:45.091 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : libcephfs2-2:17.2.9-0.el9.x86_64 5/26 2026-02-25T17:12:45.091 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : libradosstriper1-2:17.2.9-0.el9.x86_64 6/26 2026-02-25T17:12:45.091 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : librgw2-2:17.2.9-0.el9.x86_64 7/26 2026-02-25T17:12:45.091 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-ceph-argparse-2:17.2.9-0.el9.x86_64 8/26 2026-02-25T17:12:45.091 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-ceph-common-2:17.2.9-0.el9.x86_64 9/26 2026-02-25T17:12:45.091 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-cephfs-2:17.2.9-0.el9.x86_64 10/26 2026-02-25T17:12:45.091 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-rados-2:17.2.9-0.el9.x86_64 11/26 2026-02-25T17:12:45.091 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-rbd-2:17.2.9-0.el9.x86_64 12/26 2026-02-25T17:12:45.091 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-rgw-2:17.2.9-0.el9.x86_64 13/26 2026-02-25T17:12:45.091 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/26 2026-02-25T17:12:45.091 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/26 2026-02-25T17:12:45.092 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/26 2026-02-25T17:12:45.092 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/26 2026-02-25T17:12:45.092 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/26 2026-02-25T17:12:45.092 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2026-02-25T17:12:45.092 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 20/26 2026-02-25T17:12:45.092 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2026-02-25T17:12:45.092 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 22/26 2026-02-25T17:12:45.092 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : librados2-2:17.2.9-0.el9.x86_64 23/26 2026-02-25T17:12:45.092 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2026-02-25T17:12:45.092 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : librbd1-2:17.2.9-0.el9.x86_64 25/26 2026-02-25T17:12:45.155 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2026-02-25T17:12:45.155 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:45.155 INFO:teuthology.orchestra.run.trial076.stdout:Upgraded: 2026-02-25T17:12:45.156 INFO:teuthology.orchestra.run.trial076.stdout: librados2-2:17.2.9-0.el9.x86_64 librbd1-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:45.156 INFO:teuthology.orchestra.run.trial076.stdout:Installed: 2026-02-25T17:12:45.156 INFO:teuthology.orchestra.run.trial076.stdout: ceph-base-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:45.156 INFO:teuthology.orchestra.run.trial076.stdout: ceph-common-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:45.156 INFO:teuthology.orchestra.run.trial076.stdout: ceph-radosgw-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:45.156 INFO:teuthology.orchestra.run.trial076.stdout: ceph-selinux-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:45.156 INFO:teuthology.orchestra.run.trial076.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-25T17:12:45.156 INFO:teuthology.orchestra.run.trial076.stdout: libcephfs2-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:45.156 INFO:teuthology.orchestra.run.trial076.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-25T17:12:45.156 INFO:teuthology.orchestra.run.trial076.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-25T17:12:45.156 INFO:teuthology.orchestra.run.trial076.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-25T17:12:45.157 INFO:teuthology.orchestra.run.trial076.stdout: libradosstriper1-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:45.157 INFO:teuthology.orchestra.run.trial076.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-25T17:12:45.157 INFO:teuthology.orchestra.run.trial076.stdout: librgw2-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:45.157 INFO:teuthology.orchestra.run.trial076.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-25T17:12:45.157 INFO:teuthology.orchestra.run.trial076.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-25T17:12:45.157 INFO:teuthology.orchestra.run.trial076.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-25T17:12:45.157 INFO:teuthology.orchestra.run.trial076.stdout: python3-ceph-argparse-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:45.157 INFO:teuthology.orchestra.run.trial076.stdout: python3-ceph-common-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:45.157 INFO:teuthology.orchestra.run.trial076.stdout: python3-cephfs-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:45.157 INFO:teuthology.orchestra.run.trial076.stdout: python3-rados-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:45.157 INFO:teuthology.orchestra.run.trial076.stdout: python3-rbd-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:45.157 INFO:teuthology.orchestra.run.trial076.stdout: python3-rgw-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:45.157 INFO:teuthology.orchestra.run.trial076.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-25T17:12:45.158 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:45.158 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:12:45.197 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y install ceph-test 2026-02-25T17:12:45.517 INFO:teuthology.orchestra.run.trial076.stdout:Last metadata expiration check: 0:00:13 ago on Wed 25 Feb 2026 05:12:32 PM UTC. 2026-02-25T17:12:45.600 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:12:45.601 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:45.601 INFO:teuthology.orchestra.run.trial076.stdout: Package Architecture Version Repository Size 2026-02-25T17:12:45.601 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:45.601 INFO:teuthology.orchestra.run.trial076.stdout:Installing: 2026-02-25T17:12:45.601 INFO:teuthology.orchestra.run.trial076.stdout: ceph-test x86_64 2:17.2.9-0.el9 ceph 48 M 2026-02-25T17:12:45.601 INFO:teuthology.orchestra.run.trial076.stdout:Installing dependencies: 2026-02-25T17:12:45.601 INFO:teuthology.orchestra.run.trial076.stdout: libcephsqlite x86_64 2:17.2.9-0.el9 ceph 163 k 2026-02-25T17:12:45.601 INFO:teuthology.orchestra.run.trial076.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-25T17:12:45.601 INFO:teuthology.orchestra.run.trial076.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-25T17:12:45.602 INFO:teuthology.orchestra.run.trial076.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-25T17:12:45.602 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:45.602 INFO:teuthology.orchestra.run.trial076.stdout:Transaction Summary 2026-02-25T17:12:45.602 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:45.602 INFO:teuthology.orchestra.run.trial076.stdout:Install 5 Packages 2026-02-25T17:12:45.602 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:45.602 INFO:teuthology.orchestra.run.trial076.stdout:Total download size: 49 M 2026-02-25T17:12:45.602 INFO:teuthology.orchestra.run.trial076.stdout:Installed size: 194 M 2026-02-25T17:12:45.602 INFO:teuthology.orchestra.run.trial076.stdout:Downloading Packages: 2026-02-25T17:12:45.746 INFO:teuthology.orchestra.run.trial076.stdout:(1/5): libcephsqlite-17.2.9-0.el9.x86_64.rpm 1.9 MB/s | 163 kB 00:00 2026-02-25T17:12:46.064 INFO:teuthology.orchestra.run.trial076.stdout:(2/5): ceph-test-17.2.9-0.el9.x86_64.rpm 120 MB/s | 48 MB 00:00 2026-02-25T17:12:46.524 INFO:teuthology.orchestra.run.trial076.stdout:(3/5): libxslt-1.1.34-12.el9.x86_64.rpm 271 kB/s | 233 kB 00:00 2026-02-25T17:12:46.551 INFO:teuthology.orchestra.run.trial076.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 377 kB/s | 303 kB 00:00 2026-02-25T17:12:46.686 INFO:teuthology.orchestra.run.trial076.stdout:(5/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 102 kB/s | 64 kB 00:00 2026-02-25T17:12:46.688 INFO:teuthology.orchestra.run.trial076.stdout:-------------------------------------------------------------------------------- 2026-02-25T17:12:46.688 INFO:teuthology.orchestra.run.trial076.stdout:Total 45 MB/s | 49 MB 00:01 2026-02-25T17:12:46.713 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction check 2026-02-25T17:12:46.722 INFO:teuthology.orchestra.run.trial076.stdout:Transaction check succeeded. 2026-02-25T17:12:46.722 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction test 2026-02-25T17:12:46.899 INFO:teuthology.orchestra.run.trial076.stdout:Transaction test succeeded. 2026-02-25T17:12:46.899 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction 2026-02-25T17:12:47.105 INFO:teuthology.orchestra.run.trial076.stdout: Preparing : 1/1 2026-02-25T17:12:47.110 INFO:teuthology.orchestra.run.trial076.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-25T17:12:47.115 INFO:teuthology.orchestra.run.trial076.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-25T17:12:47.123 INFO:teuthology.orchestra.run.trial076.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-25T17:12:47.124 INFO:teuthology.orchestra.run.trial076.stdout: Installing : libcephsqlite-2:17.2.9-0.el9.x86_64 4/5 2026-02-25T17:12:49.297 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: libcephsqlite-2:17.2.9-0.el9.x86_64 4/5 2026-02-25T17:12:49.316 INFO:teuthology.orchestra.run.trial076.stdout: Installing : ceph-test-2:17.2.9-0.el9.x86_64 5/5 2026-02-25T17:12:49.517 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-test-2:17.2.9-0.el9.x86_64 5/5 2026-02-25T17:12:49.517 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-test-2:17.2.9-0.el9.x86_64 1/5 2026-02-25T17:12:49.517 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : libcephsqlite-2:17.2.9-0.el9.x86_64 2/5 2026-02-25T17:12:49.517 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-25T17:12:49.517 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-25T17:12:49.575 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-25T17:12:49.575 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:49.575 INFO:teuthology.orchestra.run.trial076.stdout:Installed: 2026-02-25T17:12:49.575 INFO:teuthology.orchestra.run.trial076.stdout: ceph-test-2:17.2.9-0.el9.x86_64 libcephsqlite-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:49.575 INFO:teuthology.orchestra.run.trial076.stdout: libxslt-1.1.34-12.el9.x86_64 socat-1.7.4.1-8.el9.x86_64 2026-02-25T17:12:49.576 INFO:teuthology.orchestra.run.trial076.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-25T17:12:49.576 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:49.576 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:12:49.607 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y install ceph 2026-02-25T17:12:49.916 INFO:teuthology.orchestra.run.trial076.stdout:Last metadata expiration check: 0:00:17 ago on Wed 25 Feb 2026 05:12:32 PM UTC. 2026-02-25T17:12:50.000 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:12:50.001 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:50.002 INFO:teuthology.orchestra.run.trial076.stdout: Package Arch Version Repository Size 2026-02-25T17:12:50.002 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:50.002 INFO:teuthology.orchestra.run.trial076.stdout:Installing: 2026-02-25T17:12:50.002 INFO:teuthology.orchestra.run.trial076.stdout: ceph x86_64 2:17.2.9-0.el9 ceph 6.4 k 2026-02-25T17:12:50.002 INFO:teuthology.orchestra.run.trial076.stdout:Installing dependencies: 2026-02-25T17:12:50.002 INFO:teuthology.orchestra.run.trial076.stdout: ceph-mds x86_64 2:17.2.9-0.el9 ceph 2.1 M 2026-02-25T17:12:50.002 INFO:teuthology.orchestra.run.trial076.stdout: ceph-mgr x86_64 2:17.2.9-0.el9 ceph 1.4 M 2026-02-25T17:12:50.002 INFO:teuthology.orchestra.run.trial076.stdout: ceph-mgr-modules-core noarch 2:17.2.9-0.el9 ceph-noarch 240 k 2026-02-25T17:12:50.002 INFO:teuthology.orchestra.run.trial076.stdout: ceph-mon x86_64 2:17.2.9-0.el9 ceph 3.9 M 2026-02-25T17:12:50.002 INFO:teuthology.orchestra.run.trial076.stdout: ceph-osd x86_64 2:17.2.9-0.el9 ceph 15 M 2026-02-25T17:12:50.003 INFO:teuthology.orchestra.run.trial076.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-25T17:12:50.003 INFO:teuthology.orchestra.run.trial076.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-25T17:12:50.003 INFO:teuthology.orchestra.run.trial076.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-25T17:12:50.003 INFO:teuthology.orchestra.run.trial076.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-25T17:12:50.003 INFO:teuthology.orchestra.run.trial076.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-25T17:12:50.003 INFO:teuthology.orchestra.run.trial076.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-25T17:12:50.003 INFO:teuthology.orchestra.run.trial076.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-25T17:12:50.003 INFO:teuthology.orchestra.run.trial076.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-25T17:12:50.003 INFO:teuthology.orchestra.run.trial076.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-25T17:12:50.003 INFO:teuthology.orchestra.run.trial076.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-25T17:12:50.003 INFO:teuthology.orchestra.run.trial076.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-25T17:12:50.003 INFO:teuthology.orchestra.run.trial076.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-25T17:12:50.004 INFO:teuthology.orchestra.run.trial076.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-25T17:12:50.004 INFO:teuthology.orchestra.run.trial076.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-25T17:12:50.004 INFO:teuthology.orchestra.run.trial076.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-25T17:12:50.004 INFO:teuthology.orchestra.run.trial076.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-25T17:12:50.004 INFO:teuthology.orchestra.run.trial076.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-25T17:12:50.004 INFO:teuthology.orchestra.run.trial076.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-25T17:12:50.004 INFO:teuthology.orchestra.run.trial076.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-25T17:12:50.004 INFO:teuthology.orchestra.run.trial076.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-25T17:12:50.004 INFO:teuthology.orchestra.run.trial076.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-25T17:12:50.004 INFO:teuthology.orchestra.run.trial076.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-25T17:12:50.004 INFO:teuthology.orchestra.run.trial076.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-25T17:12:50.004 INFO:teuthology.orchestra.run.trial076.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-25T17:12:50.005 INFO:teuthology.orchestra.run.trial076.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-25T17:12:50.005 INFO:teuthology.orchestra.run.trial076.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-25T17:12:50.005 INFO:teuthology.orchestra.run.trial076.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-25T17:12:50.005 INFO:teuthology.orchestra.run.trial076.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-25T17:12:50.005 INFO:teuthology.orchestra.run.trial076.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-25T17:12:50.005 INFO:teuthology.orchestra.run.trial076.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-25T17:12:50.005 INFO:teuthology.orchestra.run.trial076.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-25T17:12:50.005 INFO:teuthology.orchestra.run.trial076.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-25T17:12:50.005 INFO:teuthology.orchestra.run.trial076.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-25T17:12:50.005 INFO:teuthology.orchestra.run.trial076.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-25T17:12:50.005 INFO:teuthology.orchestra.run.trial076.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-25T17:12:50.005 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:50.005 INFO:teuthology.orchestra.run.trial076.stdout:Transaction Summary 2026-02-25T17:12:50.006 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:50.006 INFO:teuthology.orchestra.run.trial076.stdout:Install 41 Packages 2026-02-25T17:12:50.006 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:50.006 INFO:teuthology.orchestra.run.trial076.stdout:Total download size: 28 M 2026-02-25T17:12:50.007 INFO:teuthology.orchestra.run.trial076.stdout:Installed size: 99 M 2026-02-25T17:12:50.007 INFO:teuthology.orchestra.run.trial076.stdout:Downloading Packages: 2026-02-25T17:12:50.521 INFO:teuthology.orchestra.run.trial076.stdout:(1/41): ceph-17.2.9-0.el9.x86_64.rpm 162 kB/s | 6.4 kB 00:00 2026-02-25T17:12:50.577 INFO:teuthology.orchestra.run.trial076.stdout:(2/41): ceph-mgr-17.2.9-0.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2026-02-25T17:12:50.581 INFO:teuthology.orchestra.run.trial076.stdout:(3/41): ceph-mds-17.2.9-0.el9.x86_64.rpm 21 MB/s | 2.1 MB 00:00 2026-02-25T17:12:50.591 INFO:teuthology.orchestra.run.trial076.stdout:(4/41): ceph-mgr-modules-core-17.2.9-0.el9.noar 23 MB/s | 240 kB 00:00 2026-02-25T17:12:50.602 INFO:teuthology.orchestra.run.trial076.stdout:(5/41): ceph-mon-17.2.9-0.el9.x86_64.rpm 49 MB/s | 3.9 MB 00:00 2026-02-25T17:12:50.668 INFO:teuthology.orchestra.run.trial076.stdout:(6/41): ceph-osd-17.2.9-0.el9.x86_64.rpm 169 MB/s | 15 MB 00:00 2026-02-25T17:12:50.869 INFO:teuthology.orchestra.run.trial076.stdout:(7/41): ledmon-libs-1.1.0-3.el9.x86_64.rpm 146 kB/s | 40 kB 00:00 2026-02-25T17:12:50.956 INFO:teuthology.orchestra.run.trial076.stdout:(8/41): libconfig-1.7.2-9.el9.x86_64.rpm 203 kB/s | 72 kB 00:00 2026-02-25T17:12:51.127 INFO:teuthology.orchestra.run.trial076.stdout:(9/41): python3-ply-3.11-14.el9.noarch.rpm 623 kB/s | 106 kB 00:00 2026-02-25T17:12:51.167 INFO:teuthology.orchestra.run.trial076.stdout:(10/41): python3-cffi-1.14.5-5.el9.x86_64.rpm 507 kB/s | 253 kB 00:00 2026-02-25T17:12:51.247 INFO:teuthology.orchestra.run.trial076.stdout:(11/41): python3-pycparser-2.20-6.el9.noarch.rp 1.1 MB/s | 135 kB 00:00 2026-02-25T17:12:51.278 INFO:teuthology.orchestra.run.trial076.stdout:(12/41): python3-pyparsing-2.4.7-9.el9.noarch.r 1.3 MB/s | 150 kB 00:00 2026-02-25T17:12:51.352 INFO:teuthology.orchestra.run.trial076.stdout:(13/41): python3-cryptography-36.0.1-5.el9.x86_ 2.6 MB/s | 1.2 MB 00:00 2026-02-25T17:12:51.363 INFO:teuthology.orchestra.run.trial076.stdout:(14/41): python3-requests-2.25.1-10.el9.noarch. 1.1 MB/s | 126 kB 00:00 2026-02-25T17:12:51.403 INFO:teuthology.orchestra.run.trial076.stdout:(15/41): python3-urllib3-1.26.5-7.el9.noarch.rp 1.7 MB/s | 218 kB 00:00 2026-02-25T17:12:51.447 INFO:teuthology.orchestra.run.trial076.stdout:(16/41): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.5 MB/s | 246 kB 00:00 2026-02-25T17:12:51.449 INFO:teuthology.orchestra.run.trial076.stdout:(17/41): python3-libstoragemgmt-1.10.1-1.el9.x8 2.0 MB/s | 177 kB 00:00 2026-02-25T17:12:51.470 INFO:teuthology.orchestra.run.trial076.stdout:(18/41): python3-markupsafe-1.1.1-12.el9.x86_64 1.5 MB/s | 35 kB 00:00 2026-02-25T17:12:51.473 INFO:teuthology.orchestra.run.trial076.stdout:(19/41): python3-packaging-20.9-5.el9.noarch.rp 3.2 MB/s | 77 kB 00:00 2026-02-25T17:12:51.490 INFO:teuthology.orchestra.run.trial076.stdout:(20/41): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 172 kB 00:00 2026-02-25T17:12:51.492 INFO:teuthology.orchestra.run.trial076.stdout:(21/41): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-25T17:12:51.507 INFO:teuthology.orchestra.run.trial076.stdout:(22/41): python3-autocommand-2.2.2-8.el9.noarch 869 kB/s | 29 kB 00:00 2026-02-25T17:12:51.515 INFO:teuthology.orchestra.run.trial076.stdout:(23/41): python3-backports-tarfile-1.2.0-1.el9. 2.3 MB/s | 60 kB 00:00 2026-02-25T17:12:51.517 INFO:teuthology.orchestra.run.trial076.stdout:(24/41): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2026-02-25T17:12:51.518 INFO:teuthology.orchestra.run.trial076.stdout:(25/41): python3-cheroot-10.0.1-4.el9.noarch.rp 17 MB/s | 173 kB 00:00 2026-02-25T17:12:51.522 INFO:teuthology.orchestra.run.trial076.stdout:(26/41): python3-cherrypy-18.6.1-2.el9.noarch.r 52 MB/s | 358 kB 00:00 2026-02-25T17:12:51.522 INFO:teuthology.orchestra.run.trial076.stdout:(27/41): python3-jaraco-8.2.1-3.el9.noarch.rpm 2.1 MB/s | 11 kB 00:00 2026-02-25T17:12:51.523 INFO:teuthology.orchestra.run.trial076.stdout:(28/41): python3-jaraco-classes-3.2.1-5.el9.noa 3.8 MB/s | 18 kB 00:00 2026-02-25T17:12:51.526 INFO:teuthology.orchestra.run.trial076.stdout:(29/41): python3-jaraco-collections-3.0.0-8.el9 6.9 MB/s | 23 kB 00:00 2026-02-25T17:12:51.526 INFO:teuthology.orchestra.run.trial076.stdout:(30/41): python3-jaraco-context-6.0.1-3.el9.noa 5.3 MB/s | 20 kB 00:00 2026-02-25T17:12:51.526 INFO:teuthology.orchestra.run.trial076.stdout:(31/41): python3-jaraco-functools-3.5.0-2.el9.n 5.0 MB/s | 19 kB 00:00 2026-02-25T17:12:51.529 INFO:teuthology.orchestra.run.trial076.stdout:(32/41): python3-jaraco-text-4.0.0-2.el9.noarch 7.5 MB/s | 26 kB 00:00 2026-02-25T17:12:51.531 INFO:teuthology.orchestra.run.trial076.stdout:(33/41): python3-logutils-0.3.5-21.el9.noarch.r 9.2 MB/s | 46 kB 00:00 2026-02-25T17:12:51.532 INFO:teuthology.orchestra.run.trial076.stdout:(34/41): python3-more-itertools-8.12.0-2.el9.no 14 MB/s | 79 kB 00:00 2026-02-25T17:12:51.533 INFO:teuthology.orchestra.run.trial076.stdout:(35/41): python3-pecan-1.4.2-3.el9.noarch.rpm 68 MB/s | 272 kB 00:00 2026-02-25T17:12:51.535 INFO:teuthology.orchestra.run.trial076.stdout:(36/41): python3-portend-3.1.0-2.el9.noarch.rpm 4.9 MB/s | 16 kB 00:00 2026-02-25T17:12:51.535 INFO:teuthology.orchestra.run.trial076.stdout:(37/41): python3-pyOpenSSL-21.0.0-1.el9.noarch. 26 MB/s | 90 kB 00:00 2026-02-25T17:12:51.537 INFO:teuthology.orchestra.run.trial076.stdout:(38/41): python3-tempora-5.0.0-2.el9.noarch.rpm 11 MB/s | 36 kB 00:00 2026-02-25T17:12:51.539 INFO:teuthology.orchestra.run.trial076.stdout:(39/41): python3-webob-1.8.8-2.el9.noarch.rpm 60 MB/s | 230 kB 00:00 2026-02-25T17:12:51.542 INFO:teuthology.orchestra.run.trial076.stdout:(40/41): python3-werkzeug-2.0.3-3.el9.1.noarch. 60 MB/s | 427 kB 00:00 2026-02-25T17:12:51.543 INFO:teuthology.orchestra.run.trial076.stdout:(41/41): python3-zc-lockfile-2.0-10.el9.noarch. 3.3 MB/s | 20 kB 00:00 2026-02-25T17:12:51.546 INFO:teuthology.orchestra.run.trial076.stdout:-------------------------------------------------------------------------------- 2026-02-25T17:12:51.546 INFO:teuthology.orchestra.run.trial076.stdout:Total 18 MB/s | 28 MB 00:01 2026-02-25T17:12:51.667 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction check 2026-02-25T17:12:51.684 INFO:teuthology.orchestra.run.trial076.stdout:Transaction check succeeded. 2026-02-25T17:12:51.684 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction test 2026-02-25T17:12:51.823 INFO:teuthology.orchestra.run.trial076.stdout:Transaction test succeeded. 2026-02-25T17:12:51.823 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction 2026-02-25T17:12:52.006 INFO:teuthology.orchestra.run.trial076.stdout: Preparing : 1/1 2026-02-25T17:12:52.009 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/41 2026-02-25T17:12:52.010 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/41 2026-02-25T17:12:52.015 INFO:teuthology.orchestra.run.trial076.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 3/41 2026-02-25T17:12:52.020 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 4/41 2026-02-25T17:12:52.051 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 5/41 2026-02-25T17:12:52.072 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 6/41 2026-02-25T17:12:52.081 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 7/41 2026-02-25T17:12:52.088 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 8/41 2026-02-25T17:12:52.092 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 9/41 2026-02-25T17:12:52.098 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 10/41 2026-02-25T17:12:52.103 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 11/41 2026-02-25T17:12:52.107 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 12/41 2026-02-25T17:12:52.113 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 13/41 2026-02-25T17:12:52.116 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 14/41 2026-02-25T17:12:52.123 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 15/41 2026-02-25T17:12:52.126 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/41 2026-02-25T17:12:52.132 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/41 2026-02-25T17:12:52.155 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/41 2026-02-25T17:12:52.210 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/41 2026-02-25T17:12:52.233 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/41 2026-02-25T17:12:52.246 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 21/41 2026-02-25T17:12:52.251 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 22/41 2026-02-25T17:12:52.261 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 23/41 2026-02-25T17:12:52.267 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-packaging-20.9-5.el9.noarch 24/41 2026-02-25T17:12:52.280 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-ply-3.11-14.el9.noarch 25/41 2026-02-25T17:12:52.296 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 26/41 2026-02-25T17:12:52.370 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 27/41 2026-02-25T17:12:52.379 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 28/41 2026-02-25T17:12:52.402 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/41 2026-02-25T17:12:52.431 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 30/41 2026-02-25T17:12:52.437 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 31/41 2026-02-25T17:12:52.480 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 32/41 2026-02-25T17:12:52.543 INFO:teuthology.orchestra.run.trial076.stdout: Installing : ceph-mgr-modules-core-2:17.2.9-0.el9.noarch 33/41 2026-02-25T17:12:52.544 INFO:teuthology.orchestra.run.trial076.stdout: Installing : ceph-mgr-2:17.2.9-0.el9.x86_64 34/41 2026-02-25T17:12:52.566 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-mgr-2:17.2.9-0.el9.x86_64 34/41 2026-02-25T17:12:52.566 INFO:teuthology.orchestra.run.trial076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T17:12:52.566 INFO:teuthology.orchestra.run.trial076.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-25T17:12:52.566 INFO:teuthology.orchestra.run.trial076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T17:12:52.567 INFO:teuthology.orchestra.run.trial076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-25T17:12:52.567 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:52.571 INFO:teuthology.orchestra.run.trial076.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 35/41 2026-02-25T17:12:52.589 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 36/41 2026-02-25T17:12:52.589 INFO:teuthology.orchestra.run.trial076.stdout:Creating group 'libstoragemgmt' with GID 992. 2026-02-25T17:12:52.589 INFO:teuthology.orchestra.run.trial076.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 992 and GID 992. 2026-02-25T17:12:52.590 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:52.597 INFO:teuthology.orchestra.run.trial076.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 36/41 2026-02-25T17:12:52.621 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 36/41 2026-02-25T17:12:52.621 INFO:teuthology.orchestra.run.trial076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-25T17:12:52.621 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:53.266 INFO:teuthology.orchestra.run.trial076.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 37/41 2026-02-25T17:12:53.268 INFO:teuthology.orchestra.run.trial076.stdout: Installing : ceph-osd-2:17.2.9-0.el9.x86_64 38/41 2026-02-25T17:12:53.292 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-osd-2:17.2.9-0.el9.x86_64 38/41 2026-02-25T17:12:53.292 INFO:teuthology.orchestra.run.trial076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T17:12:53.292 INFO:teuthology.orchestra.run.trial076.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-25T17:12:53.293 INFO:teuthology.orchestra.run.trial076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T17:12:53.293 INFO:teuthology.orchestra.run.trial076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-25T17:12:53.293 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:53.459 INFO:teuthology.orchestra.run.trial076.stdout: Installing : ceph-mon-2:17.2.9-0.el9.x86_64 39/41 2026-02-25T17:12:53.480 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-mon-2:17.2.9-0.el9.x86_64 39/41 2026-02-25T17:12:53.481 INFO:teuthology.orchestra.run.trial076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T17:12:53.481 INFO:teuthology.orchestra.run.trial076.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-25T17:12:53.481 INFO:teuthology.orchestra.run.trial076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T17:12:53.481 INFO:teuthology.orchestra.run.trial076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-25T17:12:53.481 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:53.567 INFO:teuthology.orchestra.run.trial076.stdout: Installing : ceph-mds-2:17.2.9-0.el9.x86_64 40/41 2026-02-25T17:12:53.587 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-mds-2:17.2.9-0.el9.x86_64 40/41 2026-02-25T17:12:53.587 INFO:teuthology.orchestra.run.trial076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T17:12:53.587 INFO:teuthology.orchestra.run.trial076.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-25T17:12:53.587 INFO:teuthology.orchestra.run.trial076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T17:12:53.587 INFO:teuthology.orchestra.run.trial076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-25T17:12:53.587 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:53.605 INFO:teuthology.orchestra.run.trial076.stdout: Installing : ceph-2:17.2.9-0.el9.x86_64 41/41 2026-02-25T17:12:53.930 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-2:17.2.9-0.el9.x86_64 41/41 2026-02-25T17:12:53.930 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-2:17.2.9-0.el9.x86_64 1/41 2026-02-25T17:12:53.931 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-mds-2:17.2.9-0.el9.x86_64 2/41 2026-02-25T17:12:53.931 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-mgr-2:17.2.9-0.el9.x86_64 3/41 2026-02-25T17:12:53.931 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-mon-2:17.2.9-0.el9.x86_64 4/41 2026-02-25T17:12:53.931 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-osd-2:17.2.9-0.el9.x86_64 5/41 2026-02-25T17:12:53.931 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-mgr-modules-core-2:17.2.9-0.el9.noarch 6/41 2026-02-25T17:12:53.931 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/41 2026-02-25T17:12:53.932 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/41 2026-02-25T17:12:53.932 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/41 2026-02-25T17:12:53.932 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/41 2026-02-25T17:12:53.932 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/41 2026-02-25T17:12:53.932 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/41 2026-02-25T17:12:53.932 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/41 2026-02-25T17:12:53.933 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/41 2026-02-25T17:12:53.933 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/41 2026-02-25T17:12:53.933 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 16/41 2026-02-25T17:12:53.933 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 17/41 2026-02-25T17:12:53.933 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 18/41 2026-02-25T17:12:53.933 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 19/41 2026-02-25T17:12:53.933 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 20/41 2026-02-25T17:12:53.934 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 21/41 2026-02-25T17:12:53.934 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 22/41 2026-02-25T17:12:53.934 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 23/41 2026-02-25T17:12:53.934 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 24/41 2026-02-25T17:12:53.934 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 25/41 2026-02-25T17:12:53.934 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 26/41 2026-02-25T17:12:53.934 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 27/41 2026-02-25T17:12:53.935 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 28/41 2026-02-25T17:12:53.935 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 29/41 2026-02-25T17:12:53.935 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 30/41 2026-02-25T17:12:53.935 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 31/41 2026-02-25T17:12:53.935 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 32/41 2026-02-25T17:12:53.935 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 33/41 2026-02-25T17:12:53.936 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 34/41 2026-02-25T17:12:53.936 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 35/41 2026-02-25T17:12:53.936 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 36/41 2026-02-25T17:12:53.936 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 37/41 2026-02-25T17:12:53.936 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 38/41 2026-02-25T17:12:53.936 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 39/41 2026-02-25T17:12:53.936 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 40/41 2026-02-25T17:12:53.992 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 41/41 2026-02-25T17:12:53.993 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:53.993 INFO:teuthology.orchestra.run.trial076.stdout:Installed: 2026-02-25T17:12:53.993 INFO:teuthology.orchestra.run.trial076.stdout: ceph-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:53.993 INFO:teuthology.orchestra.run.trial076.stdout: ceph-mds-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:53.993 INFO:teuthology.orchestra.run.trial076.stdout: ceph-mgr-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:53.993 INFO:teuthology.orchestra.run.trial076.stdout: ceph-mgr-modules-core-2:17.2.9-0.el9.noarch 2026-02-25T17:12:53.993 INFO:teuthology.orchestra.run.trial076.stdout: ceph-mon-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:53.993 INFO:teuthology.orchestra.run.trial076.stdout: ceph-osd-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:53.993 INFO:teuthology.orchestra.run.trial076.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-25T17:12:53.993 INFO:teuthology.orchestra.run.trial076.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-25T17:12:53.994 INFO:teuthology.orchestra.run.trial076.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T17:12:53.994 INFO:teuthology.orchestra.run.trial076.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-25T17:12:53.994 INFO:teuthology.orchestra.run.trial076.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-25T17:12:53.994 INFO:teuthology.orchestra.run.trial076.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-25T17:12:53.994 INFO:teuthology.orchestra.run.trial076.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-25T17:12:53.994 INFO:teuthology.orchestra.run.trial076.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-25T17:12:53.994 INFO:teuthology.orchestra.run.trial076.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-25T17:12:53.994 INFO:teuthology.orchestra.run.trial076.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-25T17:12:53.994 INFO:teuthology.orchestra.run.trial076.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-25T17:12:53.994 INFO:teuthology.orchestra.run.trial076.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-25T17:12:53.995 INFO:teuthology.orchestra.run.trial076.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-25T17:12:53.995 INFO:teuthology.orchestra.run.trial076.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-25T17:12:53.995 INFO:teuthology.orchestra.run.trial076.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-25T17:12:53.995 INFO:teuthology.orchestra.run.trial076.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-25T17:12:53.995 INFO:teuthology.orchestra.run.trial076.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-25T17:12:53.995 INFO:teuthology.orchestra.run.trial076.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-25T17:12:53.995 INFO:teuthology.orchestra.run.trial076.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-25T17:12:53.995 INFO:teuthology.orchestra.run.trial076.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-25T17:12:53.995 INFO:teuthology.orchestra.run.trial076.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-25T17:12:53.995 INFO:teuthology.orchestra.run.trial076.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-25T17:12:53.995 INFO:teuthology.orchestra.run.trial076.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-25T17:12:53.995 INFO:teuthology.orchestra.run.trial076.stdout: python3-ply-3.11-14.el9.noarch 2026-02-25T17:12:53.995 INFO:teuthology.orchestra.run.trial076.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-25T17:12:53.995 INFO:teuthology.orchestra.run.trial076.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-25T17:12:53.996 INFO:teuthology.orchestra.run.trial076.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-25T17:12:53.996 INFO:teuthology.orchestra.run.trial076.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-25T17:12:53.996 INFO:teuthology.orchestra.run.trial076.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-25T17:12:53.996 INFO:teuthology.orchestra.run.trial076.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-25T17:12:53.996 INFO:teuthology.orchestra.run.trial076.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-25T17:12:53.996 INFO:teuthology.orchestra.run.trial076.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-25T17:12:53.996 INFO:teuthology.orchestra.run.trial076.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-25T17:12:53.996 INFO:teuthology.orchestra.run.trial076.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-25T17:12:53.996 INFO:teuthology.orchestra.run.trial076.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-25T17:12:53.996 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:53.996 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:12:54.028 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y install ceph-base 2026-02-25T17:12:54.345 INFO:teuthology.orchestra.run.trial076.stdout:Last metadata expiration check: 0:00:22 ago on Wed 25 Feb 2026 05:12:32 PM UTC. 2026-02-25T17:12:54.410 INFO:teuthology.orchestra.run.trial076.stdout:Package ceph-base-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-25T17:12:54.427 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:12:54.427 INFO:teuthology.orchestra.run.trial076.stdout:Nothing to do. 2026-02-25T17:12:54.428 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:12:54.451 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y install ceph-immutable-object-cache 2026-02-25T17:12:54.763 INFO:teuthology.orchestra.run.trial076.stdout:Last metadata expiration check: 0:00:22 ago on Wed 25 Feb 2026 05:12:32 PM UTC. 2026-02-25T17:12:54.845 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:12:54.846 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:54.846 INFO:teuthology.orchestra.run.trial076.stdout: Package Arch Version Repo Size 2026-02-25T17:12:54.846 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:54.846 INFO:teuthology.orchestra.run.trial076.stdout:Installing: 2026-02-25T17:12:54.846 INFO:teuthology.orchestra.run.trial076.stdout: ceph-immutable-object-cache x86_64 2:17.2.9-0.el9 ceph 137 k 2026-02-25T17:12:54.846 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:54.846 INFO:teuthology.orchestra.run.trial076.stdout:Transaction Summary 2026-02-25T17:12:54.846 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:54.846 INFO:teuthology.orchestra.run.trial076.stdout:Install 1 Package 2026-02-25T17:12:54.846 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:54.846 INFO:teuthology.orchestra.run.trial076.stdout:Total download size: 137 k 2026-02-25T17:12:54.846 INFO:teuthology.orchestra.run.trial076.stdout:Installed size: 379 k 2026-02-25T17:12:54.846 INFO:teuthology.orchestra.run.trial076.stdout:Downloading Packages: 2026-02-25T17:12:54.909 INFO:teuthology.orchestra.run.trial076.stdout:ceph-immutable-object-cache-17.2.9-0.el9.x86_64 2.1 MB/s | 137 kB 00:00 2026-02-25T17:12:54.910 INFO:teuthology.orchestra.run.trial076.stdout:-------------------------------------------------------------------------------- 2026-02-25T17:12:54.910 INFO:teuthology.orchestra.run.trial076.stdout:Total 2.1 MB/s | 137 kB 00:00 2026-02-25T17:12:54.911 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction check 2026-02-25T17:12:54.914 INFO:teuthology.orchestra.run.trial076.stdout:Transaction check succeeded. 2026-02-25T17:12:54.914 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction test 2026-02-25T17:12:54.940 INFO:teuthology.orchestra.run.trial076.stdout:Transaction test succeeded. 2026-02-25T17:12:54.940 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction 2026-02-25T17:12:54.990 INFO:teuthology.orchestra.run.trial076.stdout: Preparing : 1/1 2026-02-25T17:12:54.991 INFO:teuthology.orchestra.run.trial076.stdout: Installing : ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:12:55.013 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:12:55.013 INFO:teuthology.orchestra.run.trial076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T17:12:55.013 INFO:teuthology.orchestra.run.trial076.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-25T17:12:55.014 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:55.329 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:12:55.329 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:55.329 INFO:teuthology.orchestra.run.trial076.stdout:Installed: 2026-02-25T17:12:55.330 INFO:teuthology.orchestra.run.trial076.stdout: ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:55.330 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:55.330 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:12:55.356 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y install ceph-mgr 2026-02-25T17:12:55.672 INFO:teuthology.orchestra.run.trial076.stdout:Last metadata expiration check: 0:00:23 ago on Wed 25 Feb 2026 05:12:32 PM UTC. 2026-02-25T17:12:55.737 INFO:teuthology.orchestra.run.trial076.stdout:Package ceph-mgr-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-25T17:12:55.754 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:12:55.755 INFO:teuthology.orchestra.run.trial076.stdout:Nothing to do. 2026-02-25T17:12:55.755 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:12:55.777 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y install ceph-fuse 2026-02-25T17:12:56.092 INFO:teuthology.orchestra.run.trial076.stdout:Last metadata expiration check: 0:00:24 ago on Wed 25 Feb 2026 05:12:32 PM UTC. 2026-02-25T17:12:56.175 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:12:56.175 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:56.175 INFO:teuthology.orchestra.run.trial076.stdout: Package Architecture Version Repository Size 2026-02-25T17:12:56.176 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:56.176 INFO:teuthology.orchestra.run.trial076.stdout:Installing: 2026-02-25T17:12:56.176 INFO:teuthology.orchestra.run.trial076.stdout: ceph-fuse x86_64 2:17.2.9-0.el9 ceph 813 k 2026-02-25T17:12:56.176 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:56.176 INFO:teuthology.orchestra.run.trial076.stdout:Transaction Summary 2026-02-25T17:12:56.176 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:56.176 INFO:teuthology.orchestra.run.trial076.stdout:Install 1 Package 2026-02-25T17:12:56.176 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:56.176 INFO:teuthology.orchestra.run.trial076.stdout:Total download size: 813 k 2026-02-25T17:12:56.176 INFO:teuthology.orchestra.run.trial076.stdout:Installed size: 2.4 M 2026-02-25T17:12:56.176 INFO:teuthology.orchestra.run.trial076.stdout:Downloading Packages: 2026-02-25T17:12:56.266 INFO:teuthology.orchestra.run.trial076.stdout:ceph-fuse-17.2.9-0.el9.x86_64.rpm 8.8 MB/s | 813 kB 00:00 2026-02-25T17:12:56.267 INFO:teuthology.orchestra.run.trial076.stdout:-------------------------------------------------------------------------------- 2026-02-25T17:12:56.267 INFO:teuthology.orchestra.run.trial076.stdout:Total 8.7 MB/s | 813 kB 00:00 2026-02-25T17:12:56.267 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction check 2026-02-25T17:12:56.270 INFO:teuthology.orchestra.run.trial076.stdout:Transaction check succeeded. 2026-02-25T17:12:56.270 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction test 2026-02-25T17:12:56.298 INFO:teuthology.orchestra.run.trial076.stdout:Transaction test succeeded. 2026-02-25T17:12:56.298 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction 2026-02-25T17:12:56.377 INFO:teuthology.orchestra.run.trial076.stdout: Preparing : 1/1 2026-02-25T17:12:56.393 INFO:teuthology.orchestra.run.trial076.stdout: Installing : ceph-fuse-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:12:56.621 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-fuse-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:12:56.680 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-fuse-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:12:56.681 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:56.681 INFO:teuthology.orchestra.run.trial076.stdout:Installed: 2026-02-25T17:12:56.681 INFO:teuthology.orchestra.run.trial076.stdout: ceph-fuse-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:56.681 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:56.681 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:12:56.711 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y install librados-devel 2026-02-25T17:12:57.027 INFO:teuthology.orchestra.run.trial076.stdout:Last metadata expiration check: 0:00:25 ago on Wed 25 Feb 2026 05:12:32 PM UTC. 2026-02-25T17:12:57.110 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:12:57.110 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:57.110 INFO:teuthology.orchestra.run.trial076.stdout: Package Architecture Version Repository Size 2026-02-25T17:12:57.110 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:57.110 INFO:teuthology.orchestra.run.trial076.stdout:Installing: 2026-02-25T17:12:57.111 INFO:teuthology.orchestra.run.trial076.stdout: librados-devel x86_64 2:17.2.9-0.el9 ceph 126 k 2026-02-25T17:12:57.111 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:57.111 INFO:teuthology.orchestra.run.trial076.stdout:Transaction Summary 2026-02-25T17:12:57.111 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:57.111 INFO:teuthology.orchestra.run.trial076.stdout:Install 1 Package 2026-02-25T17:12:57.111 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:57.111 INFO:teuthology.orchestra.run.trial076.stdout:Total download size: 126 k 2026-02-25T17:12:57.111 INFO:teuthology.orchestra.run.trial076.stdout:Installed size: 448 k 2026-02-25T17:12:57.111 INFO:teuthology.orchestra.run.trial076.stdout:Downloading Packages: 2026-02-25T17:12:57.216 INFO:teuthology.orchestra.run.trial076.stdout:librados-devel-17.2.9-0.el9.x86_64.rpm 1.2 MB/s | 126 kB 00:00 2026-02-25T17:12:57.216 INFO:teuthology.orchestra.run.trial076.stdout:-------------------------------------------------------------------------------- 2026-02-25T17:12:57.216 INFO:teuthology.orchestra.run.trial076.stdout:Total 1.2 MB/s | 126 kB 00:00 2026-02-25T17:12:57.217 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction check 2026-02-25T17:12:57.219 INFO:teuthology.orchestra.run.trial076.stdout:Transaction check succeeded. 2026-02-25T17:12:57.219 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction test 2026-02-25T17:12:57.244 INFO:teuthology.orchestra.run.trial076.stdout:Transaction test succeeded. 2026-02-25T17:12:57.244 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction 2026-02-25T17:12:57.293 INFO:teuthology.orchestra.run.trial076.stdout: Preparing : 1/1 2026-02-25T17:12:57.309 INFO:teuthology.orchestra.run.trial076.stdout: Installing : librados-devel-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:12:57.389 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: librados-devel-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:12:57.449 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : librados-devel-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:12:57.449 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:57.449 INFO:teuthology.orchestra.run.trial076.stdout:Installed: 2026-02-25T17:12:57.449 INFO:teuthology.orchestra.run.trial076.stdout: librados-devel-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:57.450 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:57.450 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:12:57.478 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y install libcephfs2 2026-02-25T17:12:57.792 INFO:teuthology.orchestra.run.trial076.stdout:Last metadata expiration check: 0:00:25 ago on Wed 25 Feb 2026 05:12:32 PM UTC. 2026-02-25T17:12:57.857 INFO:teuthology.orchestra.run.trial076.stdout:Package libcephfs2-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-25T17:12:57.874 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:12:57.875 INFO:teuthology.orchestra.run.trial076.stdout:Nothing to do. 2026-02-25T17:12:57.875 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:12:57.897 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y install libcephfs-devel 2026-02-25T17:12:58.212 INFO:teuthology.orchestra.run.trial076.stdout:Last metadata expiration check: 0:00:26 ago on Wed 25 Feb 2026 05:12:32 PM UTC. 2026-02-25T17:12:58.294 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:12:58.295 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:58.295 INFO:teuthology.orchestra.run.trial076.stdout: Package Architecture Version Repository Size 2026-02-25T17:12:58.295 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:58.295 INFO:teuthology.orchestra.run.trial076.stdout:Installing: 2026-02-25T17:12:58.295 INFO:teuthology.orchestra.run.trial076.stdout: libcephfs-devel x86_64 2:17.2.9-0.el9 ceph 25 k 2026-02-25T17:12:58.295 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:58.295 INFO:teuthology.orchestra.run.trial076.stdout:Transaction Summary 2026-02-25T17:12:58.296 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:12:58.296 INFO:teuthology.orchestra.run.trial076.stdout:Install 1 Package 2026-02-25T17:12:58.296 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:58.296 INFO:teuthology.orchestra.run.trial076.stdout:Total download size: 25 k 2026-02-25T17:12:58.296 INFO:teuthology.orchestra.run.trial076.stdout:Installed size: 110 k 2026-02-25T17:12:58.296 INFO:teuthology.orchestra.run.trial076.stdout:Downloading Packages: 2026-02-25T17:12:58.338 INFO:teuthology.orchestra.run.trial076.stdout:libcephfs-devel-17.2.9-0.el9.x86_64.rpm 572 kB/s | 25 kB 00:00 2026-02-25T17:12:58.339 INFO:teuthology.orchestra.run.trial076.stdout:-------------------------------------------------------------------------------- 2026-02-25T17:12:58.339 INFO:teuthology.orchestra.run.trial076.stdout:Total 558 kB/s | 25 kB 00:00 2026-02-25T17:12:58.339 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction check 2026-02-25T17:12:58.341 INFO:teuthology.orchestra.run.trial076.stdout:Transaction check succeeded. 2026-02-25T17:12:58.341 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction test 2026-02-25T17:12:58.342 INFO:teuthology.orchestra.run.trial076.stdout:Transaction test succeeded. 2026-02-25T17:12:58.342 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction 2026-02-25T17:12:58.361 INFO:teuthology.orchestra.run.trial076.stdout: Preparing : 1/1 2026-02-25T17:12:58.377 INFO:teuthology.orchestra.run.trial076.stdout: Installing : libcephfs-devel-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:12:58.432 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: libcephfs-devel-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:12:58.491 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : libcephfs-devel-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:12:58.491 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:58.491 INFO:teuthology.orchestra.run.trial076.stdout:Installed: 2026-02-25T17:12:58.491 INFO:teuthology.orchestra.run.trial076.stdout: libcephfs-devel-2:17.2.9-0.el9.x86_64 2026-02-25T17:12:58.491 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:12:58.491 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:12:58.518 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y install librados2 2026-02-25T17:12:58.831 INFO:teuthology.orchestra.run.trial076.stdout:Last metadata expiration check: 0:00:26 ago on Wed 25 Feb 2026 05:12:32 PM UTC. 2026-02-25T17:12:58.896 INFO:teuthology.orchestra.run.trial076.stdout:Package librados2-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-25T17:12:58.914 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:12:58.915 INFO:teuthology.orchestra.run.trial076.stdout:Nothing to do. 2026-02-25T17:12:58.915 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:12:58.936 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y install librbd1 2026-02-25T17:12:59.254 INFO:teuthology.orchestra.run.trial076.stdout:Last metadata expiration check: 0:00:27 ago on Wed 25 Feb 2026 05:12:32 PM UTC. 2026-02-25T17:12:59.320 INFO:teuthology.orchestra.run.trial076.stdout:Package librbd1-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-25T17:12:59.337 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:12:59.338 INFO:teuthology.orchestra.run.trial076.stdout:Nothing to do. 2026-02-25T17:12:59.338 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:12:59.359 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y install python3-rados 2026-02-25T17:12:59.671 INFO:teuthology.orchestra.run.trial076.stdout:Last metadata expiration check: 0:00:27 ago on Wed 25 Feb 2026 05:12:32 PM UTC. 2026-02-25T17:12:59.735 INFO:teuthology.orchestra.run.trial076.stdout:Package python3-rados-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-25T17:12:59.753 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:12:59.753 INFO:teuthology.orchestra.run.trial076.stdout:Nothing to do. 2026-02-25T17:12:59.754 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:12:59.775 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y install python3-rgw 2026-02-25T17:13:00.084 INFO:teuthology.orchestra.run.trial076.stdout:Last metadata expiration check: 0:00:28 ago on Wed 25 Feb 2026 05:12:32 PM UTC. 2026-02-25T17:13:00.149 INFO:teuthology.orchestra.run.trial076.stdout:Package python3-rgw-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-25T17:13:00.166 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:13:00.167 INFO:teuthology.orchestra.run.trial076.stdout:Nothing to do. 2026-02-25T17:13:00.167 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:13:00.188 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y install python3-cephfs 2026-02-25T17:13:00.505 INFO:teuthology.orchestra.run.trial076.stdout:Last metadata expiration check: 0:00:28 ago on Wed 25 Feb 2026 05:12:32 PM UTC. 2026-02-25T17:13:00.570 INFO:teuthology.orchestra.run.trial076.stdout:Package python3-cephfs-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-25T17:13:00.588 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:13:00.588 INFO:teuthology.orchestra.run.trial076.stdout:Nothing to do. 2026-02-25T17:13:00.589 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:13:00.610 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y install python3-rbd 2026-02-25T17:13:00.925 INFO:teuthology.orchestra.run.trial076.stdout:Last metadata expiration check: 0:00:28 ago on Wed 25 Feb 2026 05:12:32 PM UTC. 2026-02-25T17:13:00.990 INFO:teuthology.orchestra.run.trial076.stdout:Package python3-rbd-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-25T17:13:01.007 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:13:01.008 INFO:teuthology.orchestra.run.trial076.stdout:Nothing to do. 2026-02-25T17:13:01.008 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:13:01.029 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y install rbd-fuse 2026-02-25T17:13:01.344 INFO:teuthology.orchestra.run.trial076.stdout:Last metadata expiration check: 0:00:29 ago on Wed 25 Feb 2026 05:12:32 PM UTC. 2026-02-25T17:13:01.427 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:13:01.427 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:13:01.428 INFO:teuthology.orchestra.run.trial076.stdout: Package Architecture Version Repository Size 2026-02-25T17:13:01.428 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:13:01.428 INFO:teuthology.orchestra.run.trial076.stdout:Installing: 2026-02-25T17:13:01.428 INFO:teuthology.orchestra.run.trial076.stdout: rbd-fuse x86_64 2:17.2.9-0.el9 ceph 82 k 2026-02-25T17:13:01.428 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:01.428 INFO:teuthology.orchestra.run.trial076.stdout:Transaction Summary 2026-02-25T17:13:01.428 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:13:01.428 INFO:teuthology.orchestra.run.trial076.stdout:Install 1 Package 2026-02-25T17:13:01.428 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:01.428 INFO:teuthology.orchestra.run.trial076.stdout:Total download size: 82 k 2026-02-25T17:13:01.428 INFO:teuthology.orchestra.run.trial076.stdout:Installed size: 222 k 2026-02-25T17:13:01.429 INFO:teuthology.orchestra.run.trial076.stdout:Downloading Packages: 2026-02-25T17:13:01.482 INFO:teuthology.orchestra.run.trial076.stdout:rbd-fuse-17.2.9-0.el9.x86_64.rpm 1.5 MB/s | 82 kB 00:00 2026-02-25T17:13:01.482 INFO:teuthology.orchestra.run.trial076.stdout:-------------------------------------------------------------------------------- 2026-02-25T17:13:01.482 INFO:teuthology.orchestra.run.trial076.stdout:Total 1.5 MB/s | 82 kB 00:00 2026-02-25T17:13:01.483 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction check 2026-02-25T17:13:01.485 INFO:teuthology.orchestra.run.trial076.stdout:Transaction check succeeded. 2026-02-25T17:13:01.485 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction test 2026-02-25T17:13:01.511 INFO:teuthology.orchestra.run.trial076.stdout:Transaction test succeeded. 2026-02-25T17:13:01.511 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction 2026-02-25T17:13:01.556 INFO:teuthology.orchestra.run.trial076.stdout: Preparing : 1/1 2026-02-25T17:13:01.574 INFO:teuthology.orchestra.run.trial076.stdout: Installing : rbd-fuse-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:13:01.654 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: rbd-fuse-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:13:01.713 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : rbd-fuse-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:13:01.713 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:01.713 INFO:teuthology.orchestra.run.trial076.stdout:Installed: 2026-02-25T17:13:01.713 INFO:teuthology.orchestra.run.trial076.stdout: rbd-fuse-2:17.2.9-0.el9.x86_64 2026-02-25T17:13:01.713 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:01.713 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:13:01.741 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y install rbd-mirror 2026-02-25T17:13:02.063 INFO:teuthology.orchestra.run.trial076.stdout:Last metadata expiration check: 0:00:30 ago on Wed 25 Feb 2026 05:12:32 PM UTC. 2026-02-25T17:13:02.148 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:13:02.149 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:13:02.149 INFO:teuthology.orchestra.run.trial076.stdout: Package Architecture Version Repository Size 2026-02-25T17:13:02.149 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:13:02.149 INFO:teuthology.orchestra.run.trial076.stdout:Installing: 2026-02-25T17:13:02.149 INFO:teuthology.orchestra.run.trial076.stdout: rbd-mirror x86_64 2:17.2.9-0.el9 ceph 2.9 M 2026-02-25T17:13:02.150 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:02.150 INFO:teuthology.orchestra.run.trial076.stdout:Transaction Summary 2026-02-25T17:13:02.150 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:13:02.150 INFO:teuthology.orchestra.run.trial076.stdout:Install 1 Package 2026-02-25T17:13:02.150 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:02.150 INFO:teuthology.orchestra.run.trial076.stdout:Total download size: 2.9 M 2026-02-25T17:13:02.150 INFO:teuthology.orchestra.run.trial076.stdout:Installed size: 12 M 2026-02-25T17:13:02.150 INFO:teuthology.orchestra.run.trial076.stdout:Downloading Packages: 2026-02-25T17:13:02.252 INFO:teuthology.orchestra.run.trial076.stdout:rbd-mirror-17.2.9-0.el9.x86_64.rpm 28 MB/s | 2.9 MB 00:00 2026-02-25T17:13:02.253 INFO:teuthology.orchestra.run.trial076.stdout:-------------------------------------------------------------------------------- 2026-02-25T17:13:02.253 INFO:teuthology.orchestra.run.trial076.stdout:Total 28 MB/s | 2.9 MB 00:00 2026-02-25T17:13:02.254 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction check 2026-02-25T17:13:02.257 INFO:teuthology.orchestra.run.trial076.stdout:Transaction check succeeded. 2026-02-25T17:13:02.257 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction test 2026-02-25T17:13:02.291 INFO:teuthology.orchestra.run.trial076.stdout:Transaction test succeeded. 2026-02-25T17:13:02.291 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction 2026-02-25T17:13:02.469 INFO:teuthology.orchestra.run.trial076.stdout: Preparing : 1/1 2026-02-25T17:13:02.470 INFO:teuthology.orchestra.run.trial076.stdout: Installing : rbd-mirror-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:13:02.493 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: rbd-mirror-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:13:02.493 INFO:teuthology.orchestra.run.trial076.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-25T17:13:02.493 INFO:teuthology.orchestra.run.trial076.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-25T17:13:02.493 INFO:teuthology.orchestra.run.trial076.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T17:13:02.493 INFO:teuthology.orchestra.run.trial076.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-25T17:13:02.494 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:02.824 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : rbd-mirror-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:13:02.824 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:02.824 INFO:teuthology.orchestra.run.trial076.stdout:Installed: 2026-02-25T17:13:02.824 INFO:teuthology.orchestra.run.trial076.stdout: rbd-mirror-2:17.2.9-0.el9.x86_64 2026-02-25T17:13:02.824 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:02.825 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:13:02.854 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y install rbd-nbd 2026-02-25T17:13:03.171 INFO:teuthology.orchestra.run.trial076.stdout:Last metadata expiration check: 0:00:31 ago on Wed 25 Feb 2026 05:12:32 PM UTC. 2026-02-25T17:13:03.254 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:13:03.255 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:13:03.255 INFO:teuthology.orchestra.run.trial076.stdout: Package Architecture Version Repository Size 2026-02-25T17:13:03.255 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:13:03.255 INFO:teuthology.orchestra.run.trial076.stdout:Installing: 2026-02-25T17:13:03.255 INFO:teuthology.orchestra.run.trial076.stdout: rbd-nbd x86_64 2:17.2.9-0.el9 ceph 165 k 2026-02-25T17:13:03.255 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:03.255 INFO:teuthology.orchestra.run.trial076.stdout:Transaction Summary 2026-02-25T17:13:03.255 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:13:03.256 INFO:teuthology.orchestra.run.trial076.stdout:Install 1 Package 2026-02-25T17:13:03.256 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:03.256 INFO:teuthology.orchestra.run.trial076.stdout:Total download size: 165 k 2026-02-25T17:13:03.256 INFO:teuthology.orchestra.run.trial076.stdout:Installed size: 477 k 2026-02-25T17:13:03.256 INFO:teuthology.orchestra.run.trial076.stdout:Downloading Packages: 2026-02-25T17:13:03.318 INFO:teuthology.orchestra.run.trial076.stdout:rbd-nbd-17.2.9-0.el9.x86_64.rpm 2.6 MB/s | 165 kB 00:00 2026-02-25T17:13:03.319 INFO:teuthology.orchestra.run.trial076.stdout:-------------------------------------------------------------------------------- 2026-02-25T17:13:03.319 INFO:teuthology.orchestra.run.trial076.stdout:Total 2.5 MB/s | 165 kB 00:00 2026-02-25T17:13:03.319 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction check 2026-02-25T17:13:03.322 INFO:teuthology.orchestra.run.trial076.stdout:Transaction check succeeded. 2026-02-25T17:13:03.323 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction test 2026-02-25T17:13:03.349 INFO:teuthology.orchestra.run.trial076.stdout:Transaction test succeeded. 2026-02-25T17:13:03.349 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction 2026-02-25T17:13:03.399 INFO:teuthology.orchestra.run.trial076.stdout: Preparing : 1/1 2026-02-25T17:13:03.415 INFO:teuthology.orchestra.run.trial076.stdout: Installing : rbd-nbd-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:13:03.496 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: rbd-nbd-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:13:03.555 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : rbd-nbd-2:17.2.9-0.el9.x86_64 1/1 2026-02-25T17:13:03.555 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:03.555 INFO:teuthology.orchestra.run.trial076.stdout:Installed: 2026-02-25T17:13:03.555 INFO:teuthology.orchestra.run.trial076.stdout: rbd-nbd-2:17.2.9-0.el9.x86_64 2026-02-25T17:13:03.556 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:03.556 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:13:03.583 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y install librados2 2026-02-25T17:13:03.898 INFO:teuthology.orchestra.run.trial076.stdout:Last metadata expiration check: 0:00:31 ago on Wed 25 Feb 2026 05:12:32 PM UTC. 2026-02-25T17:13:03.965 INFO:teuthology.orchestra.run.trial076.stdout:Package librados2-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-25T17:13:03.983 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:13:03.983 INFO:teuthology.orchestra.run.trial076.stdout:Nothing to do. 2026-02-25T17:13:03.984 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:13:04.009 DEBUG:teuthology.parallel:result is None 2026-02-25T17:13:04.009 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-25T17:13:04.010 INFO:teuthology.packaging:ref: None 2026-02-25T17:13:04.010 INFO:teuthology.packaging:tag: None 2026-02-25T17:13:04.010 INFO:teuthology.packaging:branch: quincy 2026-02-25T17:13:04.010 INFO:teuthology.packaging:sha1: 0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28 2026-02-25T17:13:04.010 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2026-02-25T17:13:04.194 DEBUG:teuthology.orchestra.run.trial076:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-25T17:13:04.216 INFO:teuthology.orchestra.run.trial076.stdout:17.2.9-0.el9 2026-02-25T17:13:04.217 INFO:teuthology.packaging:The installed version of ceph is 17.2.9-0.el9 2026-02-25T17:13:04.217 INFO:teuthology.task.install:The correct ceph version 17.2.9-0 is installed. 2026-02-25T17:13:04.219 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-25T17:13:04.220 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:04.220 DEBUG:teuthology.orchestra.run.trial076:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-25T17:13:04.281 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-25T17:13:04.281 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:04.281 DEBUG:teuthology.orchestra.run.trial076:> sudo dd of=/usr/bin/daemon-helper 2026-02-25T17:13:04.345 DEBUG:teuthology.orchestra.run.trial076:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-25T17:13:04.409 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-25T17:13:04.410 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:04.410 DEBUG:teuthology.orchestra.run.trial076:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-25T17:13:04.474 DEBUG:teuthology.orchestra.run.trial076:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-25T17:13:04.537 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-25T17:13:04.538 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:04.538 DEBUG:teuthology.orchestra.run.trial076:> sudo dd of=/usr/bin/stdin-killer 2026-02-25T17:13:04.600 DEBUG:teuthology.orchestra.run.trial076:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-25T17:13:04.664 INFO:teuthology.run_tasks:Running task print... 2026-02-25T17:13:04.679 INFO:teuthology.task.print:**** done installing quincy 2026-02-25T17:13:04.680 INFO:teuthology.run_tasks:Running task ceph... 2026-02-25T17:13:04.787 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-25T17:13:04.788 DEBUG:teuthology.orchestra.run.trial076:> sudo chmod 777 /var/log/ceph 2026-02-25T17:13:04.812 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-25T17:13:04.812 DEBUG:teuthology.orchestra.run.trial076:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-25T17:13:04.874 INFO:tasks.ceph:Creating extra log directories... 2026-02-25T17:13:04.875 DEBUG:teuthology.orchestra.run.trial076:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-25T17:13:04.949 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-25T17:13:04.950 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'MGR_MODULE_ERROR', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'pg .* is stuck peering', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-25T17:13:04.950 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-25_15:27:50-fs-reef-release-distro-default-trial/70419', 'branch': 'reef-release', 'description': 'fs/upgrade/nofs/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-from/quincy 1-upgrade}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '70419', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'meta': [{'desc': 'install ceph/quincy latest\n'}], 'name': 'yuriw-2026-02-25_15:27:50-fs-reef-release-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'reef-release'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'MGR_MODULE_ERROR', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'pg .* is stuck peering', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'sha1': '0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef-release', 'sha1': '0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 6885, 'sha1': '0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'reef-release', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28', 'targets': {'trial076.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMLPnO86r44UbPj0jSFK40saUtolmS/AgstCCRAR1bxCrU/4rtKZH5bY9NCoa9oVr65GFvxEKZYraR9vUoNniYI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'quincy', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': '0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28'}}, {'print': '**** done installing quincy'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'MGR_MODULE_ERROR', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'pg .* is stuck peering', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'flavor': 'default', 'fs': 'xfs', 'sha1': '0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client quincy']}}, {'print': '**** done ceph'}, {'print': '*** upgrading, no cephfs present'}, {'exec': {'mon.a': ['ceph fs dump']}}, {'install.upgrade': {'mon.a': None}}, {'print': '**** done install.upgrade'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph versions', 'ceph osd dump -f json-pretty', 'ceph fs dump', 'ceph osd require-osd-release reef', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-25_15:27:50', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699'} 2026-02-25T17:13:04.951 DEBUG:teuthology.orchestra.run.trial076:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-25T17:13:04.995 DEBUG:teuthology.orchestra.run.trial076:> sudo install -d -m0777 -- /var/run/ceph 2026-02-25T17:13:05.058 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:05.059 DEBUG:teuthology.orchestra.run.trial076:> dd if=/scratch_devs of=/dev/stdout 2026-02-25T17:13:05.116 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-25T17:13:05.116 DEBUG:teuthology.orchestra.run.trial076:> stat /dev/vg_nvme/lv_1 2026-02-25T17:13:05.172 INFO:teuthology.orchestra.run.trial076.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-25T17:13:05.172 INFO:teuthology.orchestra.run.trial076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T17:13:05.173 INFO:teuthology.orchestra.run.trial076.stdout:Device: 6h/6d Inode: 915 Links: 1 2026-02-25T17:13:05.173 INFO:teuthology.orchestra.run.trial076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T17:13:05.173 INFO:teuthology.orchestra.run.trial076.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T17:13:05.173 INFO:teuthology.orchestra.run.trial076.stdout:Access: 2026-02-25 17:13:02.633466959 +0000 2026-02-25T17:13:05.173 INFO:teuthology.orchestra.run.trial076.stdout:Modify: 2026-02-25 17:12:09.888094316 +0000 2026-02-25T17:13:05.173 INFO:teuthology.orchestra.run.trial076.stdout:Change: 2026-02-25 17:12:09.888094316 +0000 2026-02-25T17:13:05.173 INFO:teuthology.orchestra.run.trial076.stdout: Birth: 2026-02-25 17:12:09.888094316 +0000 2026-02-25T17:13:05.173 DEBUG:teuthology.orchestra.run.trial076:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-25T17:13:05.235 INFO:teuthology.orchestra.run.trial076.stderr:1+0 records in 2026-02-25T17:13:05.235 INFO:teuthology.orchestra.run.trial076.stderr:1+0 records out 2026-02-25T17:13:05.235 INFO:teuthology.orchestra.run.trial076.stderr:512 bytes copied, 0.0001457 s, 3.5 MB/s 2026-02-25T17:13:05.236 DEBUG:teuthology.orchestra.run.trial076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-25T17:13:05.293 DEBUG:teuthology.orchestra.run.trial076:> stat /dev/vg_nvme/lv_2 2026-02-25T17:13:05.349 INFO:teuthology.orchestra.run.trial076.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-25T17:13:05.350 INFO:teuthology.orchestra.run.trial076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T17:13:05.350 INFO:teuthology.orchestra.run.trial076.stdout:Device: 6h/6d Inode: 943 Links: 1 2026-02-25T17:13:05.350 INFO:teuthology.orchestra.run.trial076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T17:13:05.350 INFO:teuthology.orchestra.run.trial076.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T17:13:05.350 INFO:teuthology.orchestra.run.trial076.stdout:Access: 2026-02-25 17:13:02.633466959 +0000 2026-02-25T17:13:05.350 INFO:teuthology.orchestra.run.trial076.stdout:Modify: 2026-02-25 17:12:10.129084957 +0000 2026-02-25T17:13:05.350 INFO:teuthology.orchestra.run.trial076.stdout:Change: 2026-02-25 17:12:10.129084957 +0000 2026-02-25T17:13:05.350 INFO:teuthology.orchestra.run.trial076.stdout: Birth: 2026-02-25 17:12:10.129084957 +0000 2026-02-25T17:13:05.351 DEBUG:teuthology.orchestra.run.trial076:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-25T17:13:05.413 INFO:teuthology.orchestra.run.trial076.stderr:1+0 records in 2026-02-25T17:13:05.414 INFO:teuthology.orchestra.run.trial076.stderr:1+0 records out 2026-02-25T17:13:05.414 INFO:teuthology.orchestra.run.trial076.stderr:512 bytes copied, 0.000144197 s, 3.6 MB/s 2026-02-25T17:13:05.415 DEBUG:teuthology.orchestra.run.trial076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-25T17:13:05.472 DEBUG:teuthology.orchestra.run.trial076:> stat /dev/vg_nvme/lv_3 2026-02-25T17:13:05.528 INFO:teuthology.orchestra.run.trial076.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-25T17:13:05.528 INFO:teuthology.orchestra.run.trial076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T17:13:05.529 INFO:teuthology.orchestra.run.trial076.stdout:Device: 6h/6d Inode: 972 Links: 1 2026-02-25T17:13:05.529 INFO:teuthology.orchestra.run.trial076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T17:13:05.529 INFO:teuthology.orchestra.run.trial076.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T17:13:05.529 INFO:teuthology.orchestra.run.trial076.stdout:Access: 2026-02-25 17:13:02.633466959 +0000 2026-02-25T17:13:05.529 INFO:teuthology.orchestra.run.trial076.stdout:Modify: 2026-02-25 17:12:10.366075751 +0000 2026-02-25T17:13:05.529 INFO:teuthology.orchestra.run.trial076.stdout:Change: 2026-02-25 17:12:10.366075751 +0000 2026-02-25T17:13:05.529 INFO:teuthology.orchestra.run.trial076.stdout: Birth: 2026-02-25 17:12:10.366075751 +0000 2026-02-25T17:13:05.529 DEBUG:teuthology.orchestra.run.trial076:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-25T17:13:05.592 INFO:teuthology.orchestra.run.trial076.stderr:1+0 records in 2026-02-25T17:13:05.592 INFO:teuthology.orchestra.run.trial076.stderr:1+0 records out 2026-02-25T17:13:05.592 INFO:teuthology.orchestra.run.trial076.stderr:512 bytes copied, 0.000156069 s, 3.3 MB/s 2026-02-25T17:13:05.593 DEBUG:teuthology.orchestra.run.trial076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-25T17:13:05.651 DEBUG:teuthology.orchestra.run.trial076:> stat /dev/vg_nvme/lv_4 2026-02-25T17:13:05.707 INFO:teuthology.orchestra.run.trial076.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-25T17:13:05.708 INFO:teuthology.orchestra.run.trial076.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-25T17:13:05.708 INFO:teuthology.orchestra.run.trial076.stdout:Device: 6h/6d Inode: 1001 Links: 1 2026-02-25T17:13:05.708 INFO:teuthology.orchestra.run.trial076.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-25T17:13:05.708 INFO:teuthology.orchestra.run.trial076.stdout:Context: system_u:object_r:device_t:s0 2026-02-25T17:13:05.708 INFO:teuthology.orchestra.run.trial076.stdout:Access: 2026-02-25 17:13:02.634466921 +0000 2026-02-25T17:13:05.708 INFO:teuthology.orchestra.run.trial076.stdout:Modify: 2026-02-25 17:12:10.602066586 +0000 2026-02-25T17:13:05.708 INFO:teuthology.orchestra.run.trial076.stdout:Change: 2026-02-25 17:12:10.602066586 +0000 2026-02-25T17:13:05.708 INFO:teuthology.orchestra.run.trial076.stdout: Birth: 2026-02-25 17:12:10.602066586 +0000 2026-02-25T17:13:05.709 DEBUG:teuthology.orchestra.run.trial076:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-25T17:13:05.771 INFO:teuthology.orchestra.run.trial076.stderr:1+0 records in 2026-02-25T17:13:05.771 INFO:teuthology.orchestra.run.trial076.stderr:1+0 records out 2026-02-25T17:13:05.771 INFO:teuthology.orchestra.run.trial076.stderr:512 bytes copied, 0.000138336 s, 3.7 MB/s 2026-02-25T17:13:05.773 DEBUG:teuthology.orchestra.run.trial076:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-25T17:13:05.829 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-25T17:13:05.830 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial076.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-25T17:13:05.830 INFO:tasks.ceph:Generating config... 2026-02-25T17:13:05.832 INFO:tasks.ceph:[global] mon warn on pool no app = False 2026-02-25T17:13:05.832 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-25T17:13:05.832 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2026-02-25T17:13:05.832 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2026-02-25T17:13:05.832 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2026-02-25T17:13:05.833 INFO:tasks.ceph:[client] client mount timeout = 600 2026-02-25T17:13:05.833 INFO:tasks.ceph:[client] debug client = 20 2026-02-25T17:13:05.833 INFO:tasks.ceph:[client] debug ms = 1 2026-02-25T17:13:05.833 INFO:tasks.ceph:[client] rados mon op timeout = 900 2026-02-25T17:13:05.833 INFO:tasks.ceph:[client] rados osd op timeout = 900 2026-02-25T17:13:05.833 INFO:tasks.ceph:[mds] debug mds = 20 2026-02-25T17:13:05.833 INFO:tasks.ceph:[mds] debug mds balancer = 20 2026-02-25T17:13:05.833 INFO:tasks.ceph:[mds] debug ms = 1 2026-02-25T17:13:05.833 INFO:tasks.ceph:[mds] mds debug frag = True 2026-02-25T17:13:05.833 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2026-02-25T17:13:05.833 INFO:tasks.ceph:[mds] mds op complaint time = 180 2026-02-25T17:13:05.834 INFO:tasks.ceph:[mds] mds verify scatter = True 2026-02-25T17:13:05.834 INFO:tasks.ceph:[mds] osd op complaint time = 180 2026-02-25T17:13:05.834 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2026-02-25T17:13:05.834 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2026-02-25T17:13:05.834 INFO:tasks.ceph:[mgr] client mount timeout = 30 2026-02-25T17:13:05.834 INFO:tasks.ceph:[mgr] debug client = 20 2026-02-25T17:13:05.834 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-25T17:13:05.834 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-25T17:13:05.834 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-25T17:13:05.834 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-25T17:13:05.834 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-25T17:13:05.834 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2026-02-25T17:13:05.835 INFO:tasks.ceph:[mon] mon op complaint time = 120 2026-02-25T17:13:05.835 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2026-02-25T17:13:05.835 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2026-02-25T17:13:05.835 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-25T17:13:05.835 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-25T17:13:05.835 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2026-02-25T17:13:05.835 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-25T17:13:05.835 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-25T17:13:05.835 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2026-02-25T17:13:05.835 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2026-02-25T17:13:05.835 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-25T17:13:05.835 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-25T17:13:05.836 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2026-02-25T17:13:05.836 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-25T17:13:05.836 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-25T17:13:05.836 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-25T17:13:05.836 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-25T17:13:05.836 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-25T17:13:05.836 INFO:tasks.ceph:[osd] osd op complaint time = 180 2026-02-25T17:13:05.836 INFO:tasks.ceph:Setting up mon.a... 2026-02-25T17:13:05.836 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-25T17:13:05.903 INFO:teuthology.orchestra.run.trial076.stdout:creating /etc/ceph/ceph.keyring 2026-02-25T17:13:05.905 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-25T17:13:05.979 DEBUG:teuthology.orchestra.run.trial076:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-25T17:13:06.043 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.76'), ('mon.b', '[v2:10.20.193.76:3301,v1:10.20.193.76:6790]'), ('mon.c', '[v2:10.20.193.76:3302,v1:10.20.193.76:6791]')] 2026-02-25T17:13:06.044 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.76,[v2:10.20.193.76:3301,v1:10.20.193.76:6790],[v2:10.20.193.76:3302,v1:10.20.193.76:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': 'true', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'client mount timeout': 30, 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2026-02-25T17:13:06.045 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:06.046 DEBUG:teuthology.orchestra.run.trial076:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-25T17:13:06.100 DEBUG:teuthology.orchestra.run.trial076:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.76 --addv b '[v2:10.20.193.76:3301,v1:10.20.193.76:6790]' --addv c '[v2:10.20.193.76:3302,v1:10.20.193.76:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-25T17:13:06.171 INFO:teuthology.orchestra.run.trial076.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-25T17:13:06.171 INFO:teuthology.orchestra.run.trial076.stdout:monmaptool: generated fsid 0648ee30-4e19-4268-91ad-07b0e65a8518 2026-02-25T17:13:06.171 INFO:teuthology.orchestra.run.trial076.stdout:setting min_mon_release = octopus 2026-02-25T17:13:06.171 INFO:teuthology.orchestra.run.trial076.stdout:epoch 0 2026-02-25T17:13:06.171 INFO:teuthology.orchestra.run.trial076.stdout:fsid 0648ee30-4e19-4268-91ad-07b0e65a8518 2026-02-25T17:13:06.171 INFO:teuthology.orchestra.run.trial076.stdout:last_changed 2026-02-25T17:13:06.169361+0000 2026-02-25T17:13:06.171 INFO:teuthology.orchestra.run.trial076.stdout:created 2026-02-25T17:13:06.169361+0000 2026-02-25T17:13:06.171 INFO:teuthology.orchestra.run.trial076.stdout:min_mon_release 15 (octopus) 2026-02-25T17:13:06.171 INFO:teuthology.orchestra.run.trial076.stdout:election_strategy: 1 2026-02-25T17:13:06.172 INFO:teuthology.orchestra.run.trial076.stdout:0: [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] mon.a 2026-02-25T17:13:06.172 INFO:teuthology.orchestra.run.trial076.stdout:1: [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] mon.b 2026-02-25T17:13:06.172 INFO:teuthology.orchestra.run.trial076.stdout:2: [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] mon.c 2026-02-25T17:13:06.172 INFO:teuthology.orchestra.run.trial076.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-25T17:13:06.173 DEBUG:teuthology.orchestra.run.trial076:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-25T17:13:06.229 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0648ee30-4e19-4268-91ad-07b0e65a8518... 2026-02-25T17:13:06.230 DEBUG:teuthology.orchestra.run.trial076:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-25T17:13:06.310 INFO:teuthology.orchestra.run.trial076.stdout:[global] 2026-02-25T17:13:06.310 INFO:teuthology.orchestra.run.trial076.stdout: chdir = "" 2026-02-25T17:13:06.310 INFO:teuthology.orchestra.run.trial076.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-25T17:13:06.310 INFO:teuthology.orchestra.run.trial076.stdout: auth supported = cephx 2026-02-25T17:13:06.310 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.310 INFO:teuthology.orchestra.run.trial076.stdout: filestore xattr use omap = true 2026-02-25T17:13:06.311 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.311 INFO:teuthology.orchestra.run.trial076.stdout: mon clock drift allowed = 1.000 2026-02-25T17:13:06.311 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.311 INFO:teuthology.orchestra.run.trial076.stdout: osd crush chooseleaf type = 0 2026-02-25T17:13:06.311 INFO:teuthology.orchestra.run.trial076.stdout: auth debug = true 2026-02-25T17:13:06.311 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.311 INFO:teuthology.orchestra.run.trial076.stdout: ms die on old message = true 2026-02-25T17:13:06.311 INFO:teuthology.orchestra.run.trial076.stdout: ms die on bug = true 2026-02-25T17:13:06.311 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.311 INFO:teuthology.orchestra.run.trial076.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-25T17:13:06.311 INFO:teuthology.orchestra.run.trial076.stdout: mon pg warn max object skew = 0 2026-02-25T17:13:06.312 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.312 INFO:teuthology.orchestra.run.trial076.stdout: # disable pg_autoscaler by default for new pools 2026-02-25T17:13:06.312 INFO:teuthology.orchestra.run.trial076.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-25T17:13:06.312 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.312 INFO:teuthology.orchestra.run.trial076.stdout: osd pool default size = 2 2026-02-25T17:13:06.312 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.312 INFO:teuthology.orchestra.run.trial076.stdout: mon osd allow primary affinity = true 2026-02-25T17:13:06.312 INFO:teuthology.orchestra.run.trial076.stdout: mon osd allow pg remap = true 2026-02-25T17:13:06.312 INFO:teuthology.orchestra.run.trial076.stdout: mon warn on legacy crush tunables = false 2026-02-25T17:13:06.312 INFO:teuthology.orchestra.run.trial076.stdout: mon warn on crush straw calc version zero = false 2026-02-25T17:13:06.312 INFO:teuthology.orchestra.run.trial076.stdout: mon warn on no sortbitwise = false 2026-02-25T17:13:06.312 INFO:teuthology.orchestra.run.trial076.stdout: mon warn on osd down out interval zero = false 2026-02-25T17:13:06.313 INFO:teuthology.orchestra.run.trial076.stdout: mon warn on too few osds = false 2026-02-25T17:13:06.313 INFO:teuthology.orchestra.run.trial076.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-25T17:13:06.313 INFO:teuthology.orchestra.run.trial076.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-25T17:13:06.313 INFO:teuthology.orchestra.run.trial076.stdout: mon_allow_pool_size_one = true 2026-02-25T17:13:06.313 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.313 INFO:teuthology.orchestra.run.trial076.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-25T17:13:06.313 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.313 INFO:teuthology.orchestra.run.trial076.stdout: osd default data pool replay window = 5 2026-02-25T17:13:06.313 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.313 INFO:teuthology.orchestra.run.trial076.stdout: mon allow pool delete = true 2026-02-25T17:13:06.315 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.315 INFO:teuthology.orchestra.run.trial076.stdout: mon cluster log file level = debug 2026-02-25T17:13:06.315 INFO:teuthology.orchestra.run.trial076.stdout: debug asserts on shutdown = true 2026-02-25T17:13:06.315 INFO:teuthology.orchestra.run.trial076.stdout: mon health detail to clog = false 2026-02-25T17:13:06.315 INFO:teuthology.orchestra.run.trial076.stdout: mon host = "10.20.193.76,[v2:10.20.193.76:3301,v1:10.20.193.76:6790],[v2:10.20.193.76:3302,v1:10.20.193.76:6791]" 2026-02-25T17:13:06.315 INFO:teuthology.orchestra.run.trial076.stdout: mon warn on pool no app = False 2026-02-25T17:13:06.315 INFO:teuthology.orchestra.run.trial076.stdout: ms bind msgr2 = False 2026-02-25T17:13:06.315 INFO:teuthology.orchestra.run.trial076.stdout: bluestore warn on legacy statfs = False 2026-02-25T17:13:06.315 INFO:teuthology.orchestra.run.trial076.stdout: bluestore warn on no per pool omap = False 2026-02-25T17:13:06.315 INFO:teuthology.orchestra.run.trial076.stdout: mon pg warn min per osd = 0 2026-02-25T17:13:06.315 INFO:teuthology.orchestra.run.trial076.stdout: fsid = 0648ee30-4e19-4268-91ad-07b0e65a8518 2026-02-25T17:13:06.315 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.315 INFO:teuthology.orchestra.run.trial076.stdout:[osd] 2026-02-25T17:13:06.315 INFO:teuthology.orchestra.run.trial076.stdout: osd journal size = 100 2026-02-25T17:13:06.315 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.315 INFO:teuthology.orchestra.run.trial076.stdout: osd scrub load threshold = 5.0 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: osd scrub max interval = 600 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: osd mclock profile = high_recovery_ops 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: osd mclock skip benchmark = true 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: osd recover clone overlap = true 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: osd recovery max chunk = 1048576 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: osd debug shutdown = true 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: osd debug op order = true 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: osd debug verify stray on activate = true 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: osd open classes on start = true 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: osd debug pg log writeout = true 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: osd deep scrub update digest min age = 30 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: osd map max advance = 10 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: journal zero on create = true 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: filestore ondisk finisher threads = 3 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: filestore apply finisher threads = 3 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: bdev debug aio = true 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: osd debug misdirected ops = true 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: bdev async discard = True 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: bdev enable discard = True 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: bluestore allocator = bitmap 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: bluestore block size = 96636764160 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: bluestore fsck on mount = True 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: debug bluefs = 1/20 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: debug bluestore = 1/20 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: debug ms = 1 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: debug osd = 20 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: debug rocksdb = 4/10 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: mon osd backfillfull_ratio = 0.85 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: mon osd full ratio = 0.9 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: mon osd nearfull ratio = 0.8 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: osd failsafe full ratio = 0.95 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: osd objectstore = bluestore 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: osd op complaint time = 180 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout:[mgr] 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: debug ms = 1 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: debug mgr = 20 2026-02-25T17:13:06.316 INFO:teuthology.orchestra.run.trial076.stdout: debug mon = 20 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: debug auth = 20 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: mon reweight min pgs per osd = 4 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: mon reweight min bytes per osd = 10 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: mgr/telemetry/nag = false 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: client mount timeout = 30 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: debug client = 20 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout:[mon] 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: debug ms = 1 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: debug mon = 20 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: debug paxos = 20 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: debug auth = 20 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: mon data avail warn = 5 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: mon mgr mkfs grace = 240 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: mon reweight min pgs per osd = 4 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: mon osd reporter subtree level = osd 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: mon osd prime pg temp = true 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: mon reweight min bytes per osd = 10 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: auth mon ticket ttl = 660 # 11m 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: auth service ticket ttl = 240 # 4m 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: # don't complain about insecure global_id in the test suite 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: # 1m isn't quite enough 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: mon_down_mkfs_grace = 2m 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: mon_warn_on_filestore_osds = false 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: mon down mkfs grace = 300 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: mon op complaint time = 120 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: mon warn on osd down out interval zero = False 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: mon warn on pool no app = False 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout:[client] 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: rgw cache enabled = true 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: rgw enable ops log = true 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: rgw enable usage log = true 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: client mount timeout = 600 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: debug client = 20 2026-02-25T17:13:06.317 INFO:teuthology.orchestra.run.trial076.stdout: debug ms = 1 2026-02-25T17:13:06.318 INFO:teuthology.orchestra.run.trial076.stdout: rados mon op timeout = 900 2026-02-25T17:13:06.318 INFO:teuthology.orchestra.run.trial076.stdout: rados osd op timeout = 900 2026-02-25T17:13:06.318 INFO:teuthology.orchestra.run.trial076.stdout:[mon.a] 2026-02-25T17:13:06.318 INFO:teuthology.orchestra.run.trial076.stdout:[mon.b] 2026-02-25T17:13:06.318 INFO:teuthology.orchestra.run.trial076.stdout:[mon.c] 2026-02-25T17:13:06.318 INFO:teuthology.orchestra.run.trial076.stdout:[mds] 2026-02-25T17:13:06.318 INFO:teuthology.orchestra.run.trial076.stdout: debug mds = 20 2026-02-25T17:13:06.318 INFO:teuthology.orchestra.run.trial076.stdout: debug mds balancer = 20 2026-02-25T17:13:06.318 INFO:teuthology.orchestra.run.trial076.stdout: debug ms = 1 2026-02-25T17:13:06.318 INFO:teuthology.orchestra.run.trial076.stdout: mds debug frag = True 2026-02-25T17:13:06.318 INFO:teuthology.orchestra.run.trial076.stdout: mds debug scatterstat = True 2026-02-25T17:13:06.318 INFO:teuthology.orchestra.run.trial076.stdout: mds op complaint time = 180 2026-02-25T17:13:06.318 INFO:teuthology.orchestra.run.trial076.stdout: mds verify scatter = True 2026-02-25T17:13:06.318 INFO:teuthology.orchestra.run.trial076.stdout: osd op complaint time = 180 2026-02-25T17:13:06.318 INFO:teuthology.orchestra.run.trial076.stdout: rados mon op timeout = 900 2026-02-25T17:13:06.318 INFO:teuthology.orchestra.run.trial076.stdout: rados osd op timeout = 900 2026-02-25T17:13:06.320 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-25T17:13:06.320 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-25T17:13:06.397 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-25T17:13:06.398 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:06.398 DEBUG:teuthology.orchestra.run.trial076:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-25T17:13:06.453 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:06.453 DEBUG:teuthology.orchestra.run.trial076:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-25T17:13:06.510 INFO:tasks.ceph:Sending monmap to node ubuntu@trial076.front.sepia.ceph.com 2026-02-25T17:13:06.510 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:06.511 DEBUG:teuthology.orchestra.run.trial076:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-25T17:13:06.511 DEBUG:teuthology.orchestra.run.trial076:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-25T17:13:06.583 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:06.583 DEBUG:teuthology.orchestra.run.trial076:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-25T17:13:06.639 INFO:tasks.ceph:Setting up mon nodes... 2026-02-25T17:13:06.639 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-25T17:13:06.640 DEBUG:teuthology.orchestra.run.trial076:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-25T17:13:06.719 INFO:teuthology.orchestra.run.trial076.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-25T17:13:06.722 DEBUG:teuthology.orchestra.run.trial076:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-25T17:13:06.807 INFO:teuthology.orchestra.run.trial076.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-25T17:13:06.810 INFO:tasks.ceph:Setting up mds nodes... 2026-02-25T17:13:06.810 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-25T17:13:06.810 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-25T17:13:06.810 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial076.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-25T17:13:06.811 DEBUG:teuthology.orchestra.run.trial076:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-25T17:13:06.878 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-25T17:13:06.878 INFO:tasks.ceph:role: osd.0 2026-02-25T17:13:06.878 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial076.front.sepia.ceph.com 2026-02-25T17:13:06.878 DEBUG:teuthology.orchestra.run.trial076:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-25T17:13:06.944 INFO:teuthology.orchestra.run.trial076.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T17:13:06.944 INFO:teuthology.orchestra.run.trial076.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T17:13:06.944 INFO:teuthology.orchestra.run.trial076.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T17:13:06.944 INFO:teuthology.orchestra.run.trial076.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T17:13:06.944 INFO:teuthology.orchestra.run.trial076.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T17:13:06.944 INFO:teuthology.orchestra.run.trial076.stdout: = sunit=0 swidth=0 blks 2026-02-25T17:13:06.945 INFO:teuthology.orchestra.run.trial076.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T17:13:06.945 INFO:teuthology.orchestra.run.trial076.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T17:13:06.945 INFO:teuthology.orchestra.run.trial076.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T17:13:06.945 INFO:teuthology.orchestra.run.trial076.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T17:13:07.518 INFO:teuthology.orchestra.run.trial076.stdout:Discarding blocks...Done. 2026-02-25T17:13:07.521 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial076.front.sepia.ceph.com -o noatime 2026-02-25T17:13:07.521 DEBUG:teuthology.orchestra.run.trial076:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-25T17:13:07.588 DEBUG:teuthology.orchestra.run.trial076:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-25T17:13:07.655 DEBUG:teuthology.orchestra.run.trial076:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-25T17:13:07.718 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-25T17:13:07.718 INFO:tasks.ceph:role: osd.1 2026-02-25T17:13:07.719 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial076.front.sepia.ceph.com 2026-02-25T17:13:07.719 DEBUG:teuthology.orchestra.run.trial076:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-25T17:13:07.783 INFO:teuthology.orchestra.run.trial076.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T17:13:07.783 INFO:teuthology.orchestra.run.trial076.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T17:13:07.783 INFO:teuthology.orchestra.run.trial076.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T17:13:07.783 INFO:teuthology.orchestra.run.trial076.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T17:13:07.783 INFO:teuthology.orchestra.run.trial076.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T17:13:07.784 INFO:teuthology.orchestra.run.trial076.stdout: = sunit=0 swidth=0 blks 2026-02-25T17:13:07.784 INFO:teuthology.orchestra.run.trial076.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T17:13:07.784 INFO:teuthology.orchestra.run.trial076.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T17:13:07.784 INFO:teuthology.orchestra.run.trial076.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T17:13:07.784 INFO:teuthology.orchestra.run.trial076.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T17:13:08.353 INFO:teuthology.orchestra.run.trial076.stdout:Discarding blocks...Done. 2026-02-25T17:13:08.356 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial076.front.sepia.ceph.com -o noatime 2026-02-25T17:13:08.356 DEBUG:teuthology.orchestra.run.trial076:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-25T17:13:08.423 DEBUG:teuthology.orchestra.run.trial076:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-25T17:13:08.489 DEBUG:teuthology.orchestra.run.trial076:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-25T17:13:08.552 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-25T17:13:08.553 INFO:tasks.ceph:role: osd.2 2026-02-25T17:13:08.553 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial076.front.sepia.ceph.com 2026-02-25T17:13:08.553 DEBUG:teuthology.orchestra.run.trial076:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-25T17:13:08.617 INFO:teuthology.orchestra.run.trial076.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T17:13:08.618 INFO:teuthology.orchestra.run.trial076.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T17:13:08.618 INFO:teuthology.orchestra.run.trial076.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T17:13:08.618 INFO:teuthology.orchestra.run.trial076.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T17:13:08.618 INFO:teuthology.orchestra.run.trial076.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T17:13:08.618 INFO:teuthology.orchestra.run.trial076.stdout: = sunit=0 swidth=0 blks 2026-02-25T17:13:08.618 INFO:teuthology.orchestra.run.trial076.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T17:13:08.618 INFO:teuthology.orchestra.run.trial076.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T17:13:08.618 INFO:teuthology.orchestra.run.trial076.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T17:13:08.618 INFO:teuthology.orchestra.run.trial076.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T17:13:09.177 INFO:teuthology.orchestra.run.trial076.stdout:Discarding blocks...Done. 2026-02-25T17:13:09.179 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial076.front.sepia.ceph.com -o noatime 2026-02-25T17:13:09.180 DEBUG:teuthology.orchestra.run.trial076:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-25T17:13:09.247 DEBUG:teuthology.orchestra.run.trial076:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-25T17:13:09.315 DEBUG:teuthology.orchestra.run.trial076:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-25T17:13:09.379 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-25T17:13:09.380 INFO:tasks.ceph:role: osd.3 2026-02-25T17:13:09.380 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial076.front.sepia.ceph.com 2026-02-25T17:13:09.380 DEBUG:teuthology.orchestra.run.trial076:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-25T17:13:09.444 INFO:teuthology.orchestra.run.trial076.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-25T17:13:09.444 INFO:teuthology.orchestra.run.trial076.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-25T17:13:09.444 INFO:teuthology.orchestra.run.trial076.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-25T17:13:09.444 INFO:teuthology.orchestra.run.trial076.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-25T17:13:09.444 INFO:teuthology.orchestra.run.trial076.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-25T17:13:09.445 INFO:teuthology.orchestra.run.trial076.stdout: = sunit=0 swidth=0 blks 2026-02-25T17:13:09.445 INFO:teuthology.orchestra.run.trial076.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-25T17:13:09.445 INFO:teuthology.orchestra.run.trial076.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-25T17:13:09.445 INFO:teuthology.orchestra.run.trial076.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-25T17:13:09.445 INFO:teuthology.orchestra.run.trial076.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-25T17:13:10.002 INFO:teuthology.orchestra.run.trial076.stdout:Discarding blocks...Done. 2026-02-25T17:13:10.005 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial076.front.sepia.ceph.com -o noatime 2026-02-25T17:13:10.005 DEBUG:teuthology.orchestra.run.trial076:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2026-02-25T17:13:10.072 DEBUG:teuthology.orchestra.run.trial076:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-25T17:13:10.139 DEBUG:teuthology.orchestra.run.trial076:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T17:13:10.215 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:10.212+0000 7f66c6809440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-25T17:13:10.215 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:10.213+0000 7f66c6809440 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-25T17:13:10.215 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:10.213+0000 7f66c6809440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2026-02-25T17:13:10.215 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:10.213+0000 7f66c6809440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2026-02-25T17:13:10.216 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:10.213+0000 7f66c6809440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2026-02-25T17:13:10.216 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:10.213+0000 7f66c6809440 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-25T17:13:10.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:10.735+0000 7f66c6809440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-25T17:13:11.499 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:11.497+0000 7f66c6809440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-25T17:13:12.261 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:12.259+0000 7f66c6809440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-25T17:13:13.066 DEBUG:teuthology.orchestra.run.trial076:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-25T17:13:13.132 DEBUG:teuthology.orchestra.run.trial076:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T17:13:13.207 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:13.204+0000 7f5bc2bd5440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-25T17:13:13.207 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:13.204+0000 7f5bc2bd5440 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-25T17:13:13.207 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:13.204+0000 7f5bc2bd5440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2026-02-25T17:13:13.207 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:13.204+0000 7f5bc2bd5440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2026-02-25T17:13:13.207 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:13.204+0000 7f5bc2bd5440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2026-02-25T17:13:13.208 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:13.205+0000 7f5bc2bd5440 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-25T17:13:13.727 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:13.725+0000 7f5bc2bd5440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-25T17:13:14.490 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:14.487+0000 7f5bc2bd5440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-25T17:13:15.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:15.247+0000 7f5bc2bd5440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-25T17:13:16.045 DEBUG:teuthology.orchestra.run.trial076:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-25T17:13:16.110 DEBUG:teuthology.orchestra.run.trial076:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T17:13:16.188 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:16.184+0000 7f4d09c09440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-25T17:13:16.216 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:16.184+0000 7f4d09c09440 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-25T17:13:16.216 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:16.185+0000 7f4d09c09440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2026-02-25T17:13:16.216 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:16.185+0000 7f4d09c09440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2026-02-25T17:13:16.216 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:16.185+0000 7f4d09c09440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2026-02-25T17:13:16.217 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:16.185+0000 7f4d09c09440 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-25T17:13:16.710 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:16.707+0000 7f4d09c09440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-25T17:13:17.472 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:17.468+0000 7f4d09c09440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-25T17:13:18.234 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:18.231+0000 7f4d09c09440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-25T17:13:19.028 DEBUG:teuthology.orchestra.run.trial076:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-25T17:13:19.094 DEBUG:teuthology.orchestra.run.trial076:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-25T17:13:19.174 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:19.170+0000 7fdce3415440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-25T17:13:19.174 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:19.170+0000 7fdce3415440 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-25T17:13:19.174 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:19.170+0000 7fdce3415440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2026-02-25T17:13:19.174 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:19.170+0000 7fdce3415440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2026-02-25T17:13:19.174 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:19.170+0000 7fdce3415440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2026-02-25T17:13:19.174 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:19.171+0000 7fdce3415440 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-25T17:13:19.695 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:19.691+0000 7fdce3415440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-25T17:13:20.457 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:20.454+0000 7fdce3415440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-25T17:13:21.220 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:21.216+0000 7fdce3415440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-25T17:13:22.016 DEBUG:teuthology.orchestra.run.trial076:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-25T17:13:22.081 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-25T17:13:22.082 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:22.082 DEBUG:teuthology.orchestra.run.trial076:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-25T17:13:22.145 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:22.145 DEBUG:teuthology.orchestra.run.trial076:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-25T17:13:22.209 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:22.209 DEBUG:teuthology.orchestra.run.trial076:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-25T17:13:22.273 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:22.273 DEBUG:teuthology.orchestra.run.trial076:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-25T17:13:22.337 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:22.337 DEBUG:teuthology.orchestra.run.trial076:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-25T17:13:22.400 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:22.400 DEBUG:teuthology.orchestra.run.trial076:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-25T17:13:22.464 INFO:tasks.ceph:Adding keys to all mons... 2026-02-25T17:13:22.464 DEBUG:teuthology.orchestra.run.trial076:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-25T17:13:22.526 INFO:teuthology.orchestra.run.trial076.stdout:[mgr.x] 2026-02-25T17:13:22.527 INFO:teuthology.orchestra.run.trial076.stdout: key = AQCiLZ9pAhDOKhAAxn8shGWyF7VUz87curEiKg== 2026-02-25T17:13:22.527 INFO:teuthology.orchestra.run.trial076.stdout:[mgr.y] 2026-02-25T17:13:22.527 INFO:teuthology.orchestra.run.trial076.stdout: key = AQCiLZ9pGY8LMBAADdwVtDOj+x9/8K3CWemvmg== 2026-02-25T17:13:22.527 INFO:teuthology.orchestra.run.trial076.stdout:[osd.0] 2026-02-25T17:13:22.527 INFO:teuthology.orchestra.run.trial076.stdout: key = AQCmLZ9pIwy6DBAAZY0aii8ce0lYrn27g4E7rQ== 2026-02-25T17:13:22.527 INFO:teuthology.orchestra.run.trial076.stdout:[osd.1] 2026-02-25T17:13:22.527 INFO:teuthology.orchestra.run.trial076.stdout: key = AQCpLZ9pSyk2DBAAmWjuwIaCxw6qTi/jdza0YA== 2026-02-25T17:13:22.527 INFO:teuthology.orchestra.run.trial076.stdout:[osd.2] 2026-02-25T17:13:22.528 INFO:teuthology.orchestra.run.trial076.stdout: key = AQCsLZ9pHR0bCxAAi/da31pJh92CzQseXWbcNA== 2026-02-25T17:13:22.528 INFO:teuthology.orchestra.run.trial076.stdout:[osd.3] 2026-02-25T17:13:22.528 INFO:teuthology.orchestra.run.trial076.stdout: key = AQCvLZ9pLEY9ChAApcyK3SwBRuFiEhzpG8ZW6A== 2026-02-25T17:13:22.529 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-25T17:13:22.608 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-25T17:13:22.685 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T17:13:22.761 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T17:13:22.839 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T17:13:22.917 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-25T17:13:22.994 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-25T17:13:22.995 DEBUG:teuthology.orchestra.run.trial076:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-25T17:13:23.058 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-25T17:13:23.140 DEBUG:teuthology.orchestra.run.trial076:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-25T17:13:23.202 DEBUG:teuthology.orchestra.run.trial076:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-25T17:13:23.266 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-25T17:13:23.346 DEBUG:teuthology.orchestra.run.trial076:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-25T17:13:23.410 DEBUG:teuthology.orchestra.run.trial076:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-25T17:13:23.472 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-25T17:13:23.552 DEBUG:teuthology.orchestra.run.trial076:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-25T17:13:23.616 DEBUG:teuthology.orchestra.run.trial076:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-25T17:13:23.672 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-25T17:13:23.672 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-25T17:13:23.672 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-25T17:13:23.714 INFO:tasks.ceph.mon.a:Started 2026-02-25T17:13:23.714 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-25T17:13:23.714 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-25T17:13:23.715 INFO:tasks.ceph.mon.b:Started 2026-02-25T17:13:23.715 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-25T17:13:23.715 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-25T17:13:23.717 INFO:tasks.ceph.mon.c:Started 2026-02-25T17:13:23.717 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-25T17:13:23.717 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-25T17:13:23.717 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-25T17:13:23.718 INFO:tasks.ceph.mgr.x:Started 2026-02-25T17:13:23.718 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-25T17:13:23.718 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2026-02-25T17:13:23.719 INFO:tasks.ceph.mgr.y:Started 2026-02-25T17:13:23.720 INFO:tasks.ceph:Setting crush tunables to default 2026-02-25T17:13:23.720 DEBUG:teuthology.orchestra.run.trial076:> sudo ceph --cluster ceph osd crush tunables default 2026-02-25T17:13:23.781 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.778+0000 7fb4374db640 1 Processor -- start 2026-02-25T17:13:23.781 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.778+0000 7fb4374db640 1 -- start start 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.778+0000 7fb4374db640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb4300970e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.778+0000 7fb4374db640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb43012a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.778+0000 7fb4374db640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb43012a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.778+0000 7fb4374db640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43012af20 con 0x7fb43012a540 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.778+0000 7fb4374db640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb430099460 con 0x7fb430097620 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.778+0000 7fb4374db640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb430098ee0 con 0x7fb430096d10 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.779+0000 7fb434a76640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb43012a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.779+0000 7fb434a76640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb43012a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:40822/0 (socket says 10.20.193.76:40822) 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.779+0000 7fb435277640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb4300970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.779+0000 7fb434a76640 1 -- 10.20.193.76:0/385603473 learned_addr learned my addr 10.20.193.76:0/385603473 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.779+0000 7fb435a78640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb43012a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.779+0000 7fb434a76640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 msgr2=0x7fb43012a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.779+0000 7fb434a76640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 msgr2=0x7fb43012a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.779+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb43012a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.779+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb43012a000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.779+0000 7fb435a78640 1 -- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 msgr2=0x7fb43012a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.779+0000 7fb435a78640 1 -- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 msgr2=0x7fb43012a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.779+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 msgr2=0x7fb4300970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.779+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 msgr2=0x7fb4300970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.779+0000 7fb435a78640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb43012a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:23.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.779+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb4300970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:23.783 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.779+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb4300970e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-25T17:13:23.783 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.779+0000 7fb435a78640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb43012a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-25T17:13:23.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.980+0000 7fb435a78640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb43012a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:23.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.980+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb4300970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:23.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.980+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb43012a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:23.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.980+0000 7fb435a78640 1 -- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 msgr2=0x7fb43012a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-25T17:13:23.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.980+0000 7fb435a78640 1 -- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 msgr2=0x7fb43012a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:23.985 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.980+0000 7fb435a78640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb43012a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:23.985 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.980+0000 7fb435a78640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb43012a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-25T17:13:23.985 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.980+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 msgr2=0x7fb4300970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-25T17:13:23.985 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.980+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 msgr2=0x7fb4300970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:23.985 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.980+0000 7fb434a76640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 msgr2=0x7fb43012a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-25T17:13:23.985 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.980+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb4300970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:23.985 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.980+0000 7fb434a76640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 msgr2=0x7fb43012a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:23.985 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.980+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb43012a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:23.985 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.980+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb4300970e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-25T17:13:23.985 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:23.980+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb43012a000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-25T17:13:24.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:24.381+0000 7fb435a78640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb43012a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:24.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:24.381+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb4300970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:24.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:24.381+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb43012a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:24.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:24.381+0000 7fb435a78640 1 -- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 msgr2=0x7fb43012a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-25T17:13:24.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:24.381+0000 7fb435a78640 1 -- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 msgr2=0x7fb43012a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:24.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:24.381+0000 7fb435a78640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb43012a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:24.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:24.381+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 msgr2=0x7fb4300970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-25T17:13:24.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:24.381+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 msgr2=0x7fb4300970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:24.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:24.381+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb4300970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:24.386 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:24.381+0000 7fb435a78640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb43012a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-25T17:13:24.386 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:24.381+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb4300970e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-25T17:13:24.386 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:24.381+0000 7fb434a76640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 msgr2=0x7fb43012a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-25T17:13:24.386 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:24.381+0000 7fb434a76640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 msgr2=0x7fb43012a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:24.386 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:24.381+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb43012a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:24.386 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:24.381+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb43012a000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-25T17:13:25.185 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:25.182+0000 7fb435a78640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb43012a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:25.185 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:25.182+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb4300970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:25.185 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:25.182+0000 7fb435a78640 1 -- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 msgr2=0x7fb43012a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-25T17:13:25.185 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:25.182+0000 7fb435a78640 1 -- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 msgr2=0x7fb43012a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:25.185 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:25.182+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb43012a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:25.185 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:25.182+0000 7fb435a78640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb43012a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:25.185 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:25.182+0000 7fb435a78640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb43012a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-25T17:13:25.185 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:25.182+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 msgr2=0x7fb4300970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-25T17:13:25.185 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:25.182+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 msgr2=0x7fb4300970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:25.185 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:25.182+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb4300970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:25.185 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:25.182+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb4300970e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-25T17:13:25.185 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:25.182+0000 7fb434a76640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 msgr2=0x7fb43012a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-25T17:13:25.185 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:25.182+0000 7fb434a76640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 msgr2=0x7fb43012a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:25.185 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:25.182+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb43012a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:25.185 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:25.182+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb43012a000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-25T17:13:26.783 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:26.780+0000 7fb426ffd640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 msgr2=0x7fb4300970e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T17:13:26.783 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:26.780+0000 7fb426ffd640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb4300970e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:26.783 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:26.780+0000 7fb426ffd640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 msgr2=0x7fb43012a000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T17:13:26.783 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:26.780+0000 7fb426ffd640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb43012a000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:26.783 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:26.780+0000 7fb426ffd640 1 -- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 msgr2=0x7fb43012a9e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T17:13:26.783 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:26.780+0000 7fb426ffd640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb43012a9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:26.783 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:26.780+0000 7fb426ffd640 1 -- 10.20.193.76:0/385603473 --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43009a450 con 0x7fb41c003650 2026-02-25T17:13:29.784 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.780+0000 7fb426ffd640 1 -- 10.20.193.76:0/385603473 >> v1:10.20.193.76:6789/0 conn(0x7fb41c003650 legacy=0x7fb41c005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:29.784 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.780+0000 7fb426ffd640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb41c0073c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:29.784 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.780+0000 7fb426ffd640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb41c007920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:29.784 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.780+0000 7fb426ffd640 1 -- 10.20.193.76:0/385603473 --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb41c0082c0 con 0x7fb41c003650 2026-02-25T17:13:29.784 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.780+0000 7fb426ffd640 1 -- 10.20.193.76:0/385603473 --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43012af20 con 0x7fb43012a540 2026-02-25T17:13:29.784 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.780+0000 7fb426ffd640 1 -- 10.20.193.76:0/385603473 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb430099460 con 0x7fb430096d10 2026-02-25T17:13:29.784 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.780+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb41c0073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:29.785 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.780+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb41c007920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:29.785 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.780+0000 7fb434a76640 1 -- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 msgr2=0x7fb41c007920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-25T17:13:29.785 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.780+0000 7fb434a76640 1 -- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 msgr2=0x7fb41c007920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:29.785 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.780+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb41c007920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:29.785 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.780+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 msgr2=0x7fb41c0073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-25T17:13:29.785 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.780+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 msgr2=0x7fb41c0073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:29.785 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.780+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb41c0073c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:29.785 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.780+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb41c007920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-25T17:13:29.785 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.780+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb41c0073c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-25T17:13:29.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.981+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb41c0073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:29.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.981+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb41c007920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:29.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.981+0000 7fb434a76640 1 -- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 msgr2=0x7fb41c007920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-25T17:13:29.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.981+0000 7fb434a76640 1 -- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 msgr2=0x7fb41c007920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:29.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.981+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 msgr2=0x7fb41c0073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-25T17:13:29.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.981+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb41c007920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:29.985 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.981+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 msgr2=0x7fb41c0073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:29.985 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.981+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb41c0073c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:29.985 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.981+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb41c007920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-25T17:13:29.985 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:29.981+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb41c0073c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-25T17:13:30.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:30.382+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb41c0073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:30.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:30.382+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb41c007920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:30.386 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:30.382+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 msgr2=0x7fb41c0073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-25T17:13:30.386 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:30.382+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 msgr2=0x7fb41c0073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:30.386 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:30.382+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb41c0073c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:30.386 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:30.382+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb41c0073c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-25T17:13:30.386 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:30.382+0000 7fb434a76640 1 -- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 msgr2=0x7fb41c007920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-25T17:13:30.386 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:30.382+0000 7fb434a76640 1 -- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 msgr2=0x7fb41c007920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:30.386 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:30.382+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb41c007920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:30.386 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:30.382+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb41c007920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-25T17:13:31.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:31.183+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb41c007920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:31.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:31.183+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb41c0073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:31.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:31.183+0000 7fb434a76640 1 -- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 msgr2=0x7fb41c007920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-25T17:13:31.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:31.183+0000 7fb434a76640 1 -- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 msgr2=0x7fb41c007920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:31.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:31.183+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 msgr2=0x7fb41c0073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-25T17:13:31.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:31.183+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 msgr2=0x7fb41c0073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:31.187 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:31.183+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb41c007920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:31.187 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:31.183+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb41c0073c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:31.187 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:31.183+0000 7fb434a76640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb41c007920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-25T17:13:31.187 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:31.183+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb41c0073c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-25T17:13:32.783 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:32.780+0000 7fb426ffd640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 msgr2=0x7fb41c0073c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T17:13:32.784 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:32.780+0000 7fb426ffd640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb41c0073c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:32.784 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:32.780+0000 7fb426ffd640 1 -- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 msgr2=0x7fb41c007920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T17:13:32.784 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:32.780+0000 7fb426ffd640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb41c007920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:32.784 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:32.780+0000 7fb426ffd640 1 -- 10.20.193.76:0/385603473 >> v1:10.20.193.76:6789/0 conn(0x7fb41c003650 legacy=0x7fb41c005b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:32.784 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:32.780+0000 7fb426ffd640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb41c00e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:32.784 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:32.780+0000 7fb426ffd640 1 -- 10.20.193.76:0/385603473 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43012af20 con 0x7fb430097620 2026-02-25T17:13:32.784 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:32.780+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb41c00e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:32.784 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:32.780+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 msgr2=0x7fb41c00e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-25T17:13:32.784 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:32.780+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 msgr2=0x7fb41c00e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:32.785 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:32.780+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb41c00e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:32.785 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:32.780+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb41c00e5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-25T17:13:32.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:32.981+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb41c00e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:32.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:32.981+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 msgr2=0x7fb41c00e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-25T17:13:32.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:32.981+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 msgr2=0x7fb41c00e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:32.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:32.981+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb41c00e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:32.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:32.981+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb41c00e5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-25T17:13:33.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:33.382+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb41c00e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:33.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:33.382+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 msgr2=0x7fb41c00e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-25T17:13:33.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:33.382+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 msgr2=0x7fb41c00e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:13:33.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:33.382+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb41c00e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-25T17:13:33.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:33.382+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb41c00e5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-25T17:13:33.889 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:33.886+0000 7f646ca23ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-25T17:13:33.890 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:33.886+0000 7f281da14ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-25T17:13:33.996 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:33.994+0000 7f281da14ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-25T17:13:33.997 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:33.994+0000 7f646ca23ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-25T17:13:34.022 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.019+0000 7f646ca23ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-25T17:13:34.023 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.020+0000 7f281da14ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-25T17:13:34.054 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.052+0000 7f646ca23ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-25T17:13:34.055 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.052+0000 7f281da14ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-25T17:13:34.076 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.074+0000 7f646ca23ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-25T17:13:34.077 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.074+0000 7f281da14ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-25T17:13:34.102 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.099+0000 7f281da14ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-25T17:13:34.102 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.099+0000 7f646ca23ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-25T17:13:34.165 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.162+0000 7f281da14ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-25T17:13:34.166 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.162+0000 7f646ca23ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-25T17:13:34.185 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.183+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb41c00e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.183+0000 7fb435277640 1 -- 10.20.193.76:0/385603473 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41c007ff0 con 0x7fb430097620 2026-02-25T17:13:34.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.183+0000 7fb435277640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb41c00e5e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb42c006fd0 tx=0x7fb42c031660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daca06fe9ffdf3a0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:34.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.183+0000 7fb427fff640 1 -- 10.20.193.76:0/385603473 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c038400 con 0x7fb430097620 2026-02-25T17:13:34.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.184+0000 7fb427fff640 1 -- 10.20.193.76:0/385603473 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42c034050 con 0x7fb430097620 2026-02-25T17:13:34.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.184+0000 7fb427fff640 1 -- 10.20.193.76:0/385603473 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c0387b0 con 0x7fb430097620 2026-02-25T17:13:34.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.184+0000 7fb4374db640 1 -- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 msgr2=0x7fb41c00e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.184+0000 7fb4374db640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb41c00e5e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb42c006fd0 tx=0x7fb42c031660 comp rx=0 tx=0).stop 2026-02-25T17:13:34.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.184+0000 7fb4374db640 1 -- 10.20.193.76:0/385603473 shutdown_connections 2026-02-25T17:13:34.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.184+0000 7fb4374db640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb41c00e5e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.184+0000 7fb4374db640 1 --2- 10.20.193.76:0/385603473 >> v2:10.20.193.76:3300/0 conn(0x7fb43012a540 0x7fb41c007920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.184+0000 7fb4374db640 1 --2- 10.20.193.76:0/385603473 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb430096d10 0x7fb41c0073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.184+0000 7fb4374db640 1 -- 10.20.193.76:0/385603473 >> 10.20.193.76:0/385603473 conn(0x7fb43009db30 msgr2=0x7fb43009df30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:34.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.184+0000 7fb4374db640 1 -- 10.20.193.76:0/385603473 shutdown_connections 2026-02-25T17:13:34.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.184+0000 7fb4374db640 1 -- 10.20.193.76:0/385603473 wait complete. 2026-02-25T17:13:34.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb4374db640 1 Processor -- start 2026-02-25T17:13:34.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb4374db640 1 -- start start 2026-02-25T17:13:34.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb4374db640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb41c003650 0x7fb4301be080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb4374db640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb430096d10 0x7fb4301be5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb4374db640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb43011bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb4374db640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43011f1a0 con 0x7fb430096d10 2026-02-25T17:13:34.192 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb4374db640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43011d6d0 con 0x7fb430097620 2026-02-25T17:13:34.192 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb4374db640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb43011dfd0 con 0x7fb41c003650 2026-02-25T17:13:34.192 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb435277640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb41c003650 0x7fb4301be080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.192 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb435a78640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb43011bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.192 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb435277640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb41c003650 0x7fb4301be080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:46696/0 (socket says 10.20.193.76:46696) 2026-02-25T17:13:34.192 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb435a78640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb43011bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:46234/0 (socket says 10.20.193.76:46234) 2026-02-25T17:13:34.192 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb435277640 1 -- 10.20.193.76:0/2456786265 learned_addr learned my addr 10.20.193.76:0/2456786265 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:34.192 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb434a76640 1 --2- 10.20.193.76:0/2456786265 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb430096d10 0x7fb4301be5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.192 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb435277640 1 -- 10.20.193.76:0/2456786265 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 msgr2=0x7fb43011bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.192 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb435277640 1 --2- 10.20.193.76:0/2456786265 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb43011bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.192 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb435277640 1 -- 10.20.193.76:0/2456786265 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb430096d10 msgr2=0x7fb4301be5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.192 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb435277640 1 --2- 10.20.193.76:0/2456786265 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb430096d10 0x7fb4301be5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb435277640 1 -- 10.20.193.76:0/2456786265 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43009a450 con 0x7fb41c003650 2026-02-25T17:13:34.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb435277640 1 --2- 10.20.193.76:0/2456786265 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb41c003650 0x7fb4301be080 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb42c006e20 tx=0x7fb42c03b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:34.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb425ffb640 1 -- 10.20.193.76:0/2456786265 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c043720 con 0x7fb41c003650 2026-02-25T17:13:34.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb425ffb640 1 -- 10.20.193.76:0/2456786265 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42c043880 con 0x7fb41c003650 2026-02-25T17:13:34.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb4374db640 1 -- 10.20.193.76:0/2456786265 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4301beb00 con 0x7fb41c003650 2026-02-25T17:13:34.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb425ffb640 1 -- 10.20.193.76:0/2456786265 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42c043c00 con 0x7fb41c003650 2026-02-25T17:13:34.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.185+0000 7fb4374db640 1 -- 10.20.193.76:0/2456786265 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43011c360 con 0x7fb41c003650 2026-02-25T17:13:34.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.186+0000 7fb425ffb640 1 -- 10.20.193.76:0/2456786265 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fb42c04c460 con 0x7fb41c003650 2026-02-25T17:13:34.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.186+0000 7fb425ffb640 1 -- 10.20.193.76:0/2456786265 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb42c031e40 con 0x7fb41c003650 2026-02-25T17:13:34.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.186+0000 7fb4374db640 1 -- 10.20.193.76:0/2456786265 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb430064c00 con 0x7fb41c003650 2026-02-25T17:13:34.194 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.187+0000 7f281da14ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-25T17:13:34.194 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.188+0000 7fb425ffb640 1 -- 10.20.193.76:0/2456786265 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7fb42c06c990 con 0x7fb41c003650 2026-02-25T17:13:34.195 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.188+0000 7f646ca23ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-25T17:13:34.220 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.217+0000 7fb4374db640 1 -- 10.20.193.76:0/2456786265 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb430063e70 con 0x7fb41c003650 2026-02-25T17:13:34.223 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.219+0000 7fb425ffb640 1 -- 10.20.193.76:0/2456786265 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb42c05b020 con 0x7fb41c003650 2026-02-25T17:13:34.224 INFO:teuthology.orchestra.run.trial076.stderr:adjusted tunables profile to default 2026-02-25T17:13:34.224 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.220+0000 7fb4374db640 1 -- 10.20.193.76:0/2456786265 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb41c003650 msgr2=0x7fb4301be080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.224 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.220+0000 7fb4374db640 1 --2- 10.20.193.76:0/2456786265 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb41c003650 0x7fb4301be080 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb42c006e20 tx=0x7fb42c03b000 comp rx=0 tx=0).stop 2026-02-25T17:13:34.224 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.220+0000 7fb4374db640 1 -- 10.20.193.76:0/2456786265 shutdown_connections 2026-02-25T17:13:34.224 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.220+0000 7fb4374db640 1 --2- 10.20.193.76:0/2456786265 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb430097620 0x7fb43011bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.224 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.220+0000 7fb4374db640 1 --2- 10.20.193.76:0/2456786265 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb430096d10 0x7fb4301be5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.224 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.220+0000 7fb4374db640 1 --2- 10.20.193.76:0/2456786265 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb41c003650 0x7fb4301be080 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.225 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.220+0000 7fb4374db640 1 -- 10.20.193.76:0/2456786265 >> 10.20.193.76:0/2456786265 conn(0x7fb43009db30 msgr2=0x7fb430128cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:34.225 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.220+0000 7fb4374db640 1 -- 10.20.193.76:0/2456786265 shutdown_connections 2026-02-25T17:13:34.225 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.220+0000 7fb4374db640 1 -- 10.20.193.76:0/2456786265 wait complete. 2026-02-25T17:13:34.230 INFO:tasks.ceph:check_enable_crimson: False 2026-02-25T17:13:34.230 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-25T17:13:34.231 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:34.231 DEBUG:teuthology.orchestra.run.trial076:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-25T17:13:34.239 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.237+0000 7f646ca23ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-25T17:13:34.239 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.237+0000 7f281da14ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-25T17:13:34.256 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:34.256 DEBUG:teuthology.orchestra.run.trial076:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-25T17:13:34.281 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.278+0000 7f281da14ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-25T17:13:34.281 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.278+0000 7f646ca23ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-25T17:13:34.304 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:34.305 DEBUG:teuthology.orchestra.run.trial076:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-25T17:13:34.306 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.303+0000 7f646ca23ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-25T17:13:34.307 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.303+0000 7f281da14ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-25T17:13:34.329 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:34.329 DEBUG:teuthology.orchestra.run.trial076:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-25T17:13:34.330 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.327+0000 7f281da14ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-25T17:13:34.331 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.328+0000 7f646ca23ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-25T17:13:34.353 DEBUG:teuthology.orchestra.run.trial076:> sudo ceph --cluster ceph osd new 85909bd3-2540-48a9-a649-33709fa74613 0 2026-02-25T17:13:34.355 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.353+0000 7f281da14ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-25T17:13:34.358 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.354+0000 7f646ca23ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-25T17:13:34.377 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.375+0000 7f281da14ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-25T17:13:34.378 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.375+0000 7f646ca23ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-25T17:13:34.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.413+0000 7f25ae377640 1 Processor -- start 2026-02-25T17:13:34.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.413+0000 7f25ae377640 1 -- start start 2026-02-25T17:13:34.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.413+0000 7f25ae377640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25a8096cb0 0x7f25a8097080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.413+0000 7f25ae377640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f25a80975c0 0x7f25a812a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.413+0000 7f25ae377640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a8099560 con 0x7f25a812a540 2026-02-25T17:13:34.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.413+0000 7f25ae377640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a809a550 con 0x7f25a80975c0 2026-02-25T17:13:34.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.413+0000 7f25ae377640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25a80980e0 con 0x7f25a8096cb0 2026-02-25T17:13:34.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.414+0000 7f25a7fff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25a8096cb0 0x7f25a8097080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.414+0000 7f25a7fff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25a8096cb0 0x7f25a8097080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:46708/0 (socket says 10.20.193.76:46708) 2026-02-25T17:13:34.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.414+0000 7f25a7fff640 1 -- 10.20.193.76:0/1582873265 learned_addr learned my addr 10.20.193.76:0/1582873265 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:34.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.414+0000 7f259ffff640 1 --2- 10.20.193.76:0/1582873265 >> v2:10.20.193.76:3300/0 conn(0x7f25a80975c0 0x7f25a812a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.414+0000 7f25a7fff640 1 -- 10.20.193.76:0/1582873265 >> v2:10.20.193.76:3300/0 conn(0x7f25a80975c0 msgr2=0x7f25a812a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:34.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.414+0000 7f25a7fff640 1 --2- 10.20.193.76:0/1582873265 >> v2:10.20.193.76:3300/0 conn(0x7f25a80975c0 0x7f25a812a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.414+0000 7f25a7fff640 1 -- 10.20.193.76:0/1582873265 >> v1:10.20.193.76:6789/0 conn(0x7f25a812a540 legacy=0x7f25a8131340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.414+0000 7f25a7fff640 1 -- 10.20.193.76:0/1582873265 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a80998c0 con 0x7f25a8096cb0 2026-02-25T17:13:34.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.414+0000 7f25a7fff640 1 --2- 10.20.193.76:0/1582873265 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25a8096cb0 0x7f25a8097080 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2598009910 tx=0x7f259802ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea02024a2bc4498f server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:34.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.414+0000 7f25a77fe640 1 -- 10.20.193.76:0/1582873265 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259802f970 con 0x7f25a8096cb0 2026-02-25T17:13:34.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.414+0000 7f25a77fe640 1 -- 10.20.193.76:0/1582873265 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259802fad0 con 0x7f25a8096cb0 2026-02-25T17:13:34.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.414+0000 7f25a77fe640 1 -- 10.20.193.76:0/1582873265 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2598037440 con 0x7f25a8096cb0 2026-02-25T17:13:34.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.414+0000 7f25ae377640 1 -- 10.20.193.76:0/1582873265 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25a8096cb0 msgr2=0x7f25a8097080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.414+0000 7f25ae377640 1 --2- 10.20.193.76:0/1582873265 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25a8096cb0 0x7f25a8097080 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2598009910 tx=0x7f259802ee10 comp rx=0 tx=0).stop 2026-02-25T17:13:34.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.415+0000 7f25ae377640 1 -- 10.20.193.76:0/1582873265 shutdown_connections 2026-02-25T17:13:34.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.415+0000 7f25ae377640 1 --2- 10.20.193.76:0/1582873265 >> v2:10.20.193.76:3300/0 conn(0x7f25a80975c0 0x7f25a812a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.415+0000 7f25ae377640 1 --2- 10.20.193.76:0/1582873265 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25a8096cb0 0x7f25a8097080 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.418 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.415+0000 7f25ae377640 1 -- 10.20.193.76:0/1582873265 >> 10.20.193.76:0/1582873265 conn(0x7f25a809dac0 msgr2=0x7f25a809dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:34.418 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.415+0000 7f25ae377640 1 -- 10.20.193.76:0/1582873265 shutdown_connections 2026-02-25T17:13:34.418 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.415+0000 7f25ae377640 1 -- 10.20.193.76:0/1582873265 wait complete. 2026-02-25T17:13:34.419 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.415+0000 7f25ae377640 1 Processor -- start 2026-02-25T17:13:34.419 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.415+0000 7f25ae377640 1 -- start start 2026-02-25T17:13:34.420 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.415+0000 7f25ae377640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25a8096cb0 0x7f25a81beaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.420 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.415+0000 7f25ae377640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f25a80975c0 0x7f25a81befe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.420 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.415+0000 7f25ae377640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f25a812a540 0x7f25a811c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.420 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.415+0000 7f25ae377640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a811e8f0 con 0x7f25a80975c0 2026-02-25T17:13:34.420 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.415+0000 7f25ae377640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a81200e0 con 0x7f25a812a540 2026-02-25T17:13:34.420 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.415+0000 7f25ae377640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25a811ed30 con 0x7f25a8096cb0 2026-02-25T17:13:34.420 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.415+0000 7f25a7fff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25a8096cb0 0x7f25a81beaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.420 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.415+0000 7f259ffff640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f25a80975c0 0x7f25a81befe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.420 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.415+0000 7f25a7fff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25a8096cb0 0x7f25a81beaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:46712/0 (socket says 10.20.193.76:46712) 2026-02-25T17:13:34.420 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.415+0000 7f25a7fff640 1 -- 10.20.193.76:0/129169812 learned_addr learned my addr 10.20.193.76:0/129169812 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:34.420 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.416+0000 7f25ac914640 1 --2- 10.20.193.76:0/129169812 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f25a812a540 0x7f25a811c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.420 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.416+0000 7f25a7fff640 1 -- 10.20.193.76:0/129169812 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f25a812a540 msgr2=0x7f25a811c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.420 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.416+0000 7f25a7fff640 1 --2- 10.20.193.76:0/129169812 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f25a812a540 0x7f25a811c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.420 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.416+0000 7f25a7fff640 1 -- 10.20.193.76:0/129169812 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f25a80975c0 msgr2=0x7f25a81befe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.420 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.416+0000 7f25a7fff640 1 --2- 10.20.193.76:0/129169812 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f25a80975c0 0x7f25a81befe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.420 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.416+0000 7f25a7fff640 1 -- 10.20.193.76:0/129169812 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2598009450 con 0x7f25a8096cb0 2026-02-25T17:13:34.420 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.416+0000 7f259ffff640 1 --2- 10.20.193.76:0/129169812 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f25a80975c0 0x7f25a81befe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:34.421 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.416+0000 7f25a7fff640 1 --2- 10.20.193.76:0/129169812 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25a8096cb0 0x7f25a81beaa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f259802ee50 tx=0x7f2598037000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:34.421 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.416+0000 7f25a57fa640 1 -- 10.20.193.76:0/129169812 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2598000c40 con 0x7f25a8096cb0 2026-02-25T17:13:34.421 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.416+0000 7f25a57fa640 1 -- 10.20.193.76:0/129169812 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2598042440 con 0x7f25a8096cb0 2026-02-25T17:13:34.421 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.416+0000 7f25ae377640 1 -- 10.20.193.76:0/129169812 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a811fd10 con 0x7f25a8096cb0 2026-02-25T17:13:34.421 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.416+0000 7f25a57fa640 1 -- 10.20.193.76:0/129169812 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2598042800 con 0x7f25a8096cb0 2026-02-25T17:13:34.421 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.416+0000 7f25ae377640 1 -- 10.20.193.76:0/129169812 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a81bf520 con 0x7f25a8096cb0 2026-02-25T17:13:34.421 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.416+0000 7f25a57fa640 1 -- 10.20.193.76:0/129169812 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f259803e040 con 0x7f25a8096cb0 2026-02-25T17:13:34.421 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.416+0000 7f25a57fa640 1 -- 10.20.193.76:0/129169812 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2598040740 con 0x7f25a8096cb0 2026-02-25T17:13:34.421 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.416+0000 7f25ae377640 1 -- 10.20.193.76:0/129169812 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a8064c00 con 0x7f25a8096cb0 2026-02-25T17:13:34.421 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.417+0000 7f25a57fa640 1 -- 10.20.193.76:0/129169812 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7f2598046030 con 0x7f25a8096cb0 2026-02-25T17:13:34.422 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.419+0000 7f281da14ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-25T17:13:34.422 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.419+0000 7f646ca23ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-25T17:13:34.443 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.441+0000 7f281da14ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-25T17:13:34.444 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.441+0000 7f646ca23ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-25T17:13:34.451 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.449+0000 7f25ae377640 1 -- 10.20.193.76:0/129169812 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd new", "uuid": "85909bd3-2540-48a9-a649-33709fa74613", "id": 0} v 0) v1 -- 0x7f25a8063e70 con 0x7f25a8096cb0 2026-02-25T17:13:34.454 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.451+0000 7f25a57fa640 1 -- 10.20.193.76:0/129169812 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "85909bd3-2540-48a9-a649-33709fa74613", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f259803c070 con 0x7f25a8096cb0 2026-02-25T17:13:34.454 INFO:teuthology.orchestra.run.trial076.stdout:0 2026-02-25T17:13:34.455 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.452+0000 7f25ae377640 1 -- 10.20.193.76:0/129169812 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25a8096cb0 msgr2=0x7f25a81beaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.455 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.452+0000 7f25ae377640 1 --2- 10.20.193.76:0/129169812 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25a8096cb0 0x7f25a81beaa0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f259802ee50 tx=0x7f2598037000 comp rx=0 tx=0).stop 2026-02-25T17:13:34.455 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.452+0000 7f25ae377640 1 -- 10.20.193.76:0/129169812 shutdown_connections 2026-02-25T17:13:34.455 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.452+0000 7f25ae377640 1 --2- 10.20.193.76:0/129169812 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f25a812a540 0x7f25a811c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.456 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.452+0000 7f25ae377640 1 --2- 10.20.193.76:0/129169812 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f25a80975c0 0x7f25a81befe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.456 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.452+0000 7f25ae377640 1 --2- 10.20.193.76:0/129169812 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25a8096cb0 0x7f25a81beaa0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.456 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.452+0000 7f25ae377640 1 -- 10.20.193.76:0/129169812 >> 10.20.193.76:0/129169812 conn(0x7f25a809dac0 msgr2=0x7f25a8115bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:34.456 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.452+0000 7f25ae377640 1 -- 10.20.193.76:0/129169812 shutdown_connections 2026-02-25T17:13:34.456 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.452+0000 7f25ae377640 1 -- 10.20.193.76:0/129169812 wait complete. 2026-02-25T17:13:34.463 DEBUG:teuthology.orchestra.run.trial076:> sudo ceph --cluster ceph osd new f0a0a51c-d629-464e-bc04-dacbaaf78efa 1 2026-02-25T17:13:34.467 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.464+0000 7f281da14ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-25T17:13:34.467 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.464+0000 7f646ca23ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-25T17:13:34.506 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.503+0000 7f646ca23ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-25T17:13:34.506 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.503+0000 7f281da14ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-25T17:13:34.526 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.523+0000 7f281da14ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-25T17:13:34.526 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.523+0000 7f646ca23ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-25T17:13:34.531 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.525+0000 7f462b5fc640 1 Processor -- start 2026-02-25T17:13:34.532 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.525+0000 7f462b5fc640 1 -- start start 2026-02-25T17:13:34.532 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.526+0000 7f462b5fc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f46240977f0 0x7f462412f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.532 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.526+0000 7f462b5fc640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f462412f870 0x7f4624131c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.532 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.526+0000 7f462b5fc640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4624099460 con 0x7f4624096d10 2026-02-25T17:13:34.532 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.526+0000 7f462b5fc640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4624097be0 con 0x7f462412f870 2026-02-25T17:13:34.532 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.526+0000 7f462b5fc640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4624098ee0 con 0x7f46240977f0 2026-02-25T17:13:34.532 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.526+0000 7f4628b97640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f46240977f0 0x7f462412f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.532 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.526+0000 7f4629b99640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f462412f870 0x7f4624131c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.532 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.526+0000 7f4628b97640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f46240977f0 0x7f462412f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:46726/0 (socket says 10.20.193.76:46726) 2026-02-25T17:13:34.532 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.526+0000 7f4628b97640 1 -- 10.20.193.76:0/3992538435 learned_addr learned my addr 10.20.193.76:0/3992538435 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:34.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.526+0000 7f4628b97640 1 -- 10.20.193.76:0/3992538435 >> v2:10.20.193.76:3300/0 conn(0x7f462412f870 msgr2=0x7f4624131c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:34.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.526+0000 7f4628b97640 1 --2- 10.20.193.76:0/3992538435 >> v2:10.20.193.76:3300/0 conn(0x7f462412f870 0x7f4624131c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.526+0000 7f4628b97640 1 -- 10.20.193.76:0/3992538435 >> v1:10.20.193.76:6789/0 conn(0x7f4624096d10 legacy=0x7f46240970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.526+0000 7f4628b97640 1 -- 10.20.193.76:0/3992538435 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462409a450 con 0x7f46240977f0 2026-02-25T17:13:34.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.526+0000 7f4628b97640 1 --2- 10.20.193.76:0/3992538435 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f46240977f0 0x7f462412f330 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4614009970 tx=0x7f461402eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7402103a97214da server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:34.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.526+0000 7f461bfff640 1 -- 10.20.193.76:0/3992538435 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461402f9d0 con 0x7f46240977f0 2026-02-25T17:13:34.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.527+0000 7f461bfff640 1 -- 10.20.193.76:0/3992538435 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461402fb30 con 0x7f46240977f0 2026-02-25T17:13:34.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.527+0000 7f461bfff640 1 -- 10.20.193.76:0/3992538435 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4614037440 con 0x7f46240977f0 2026-02-25T17:13:34.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.527+0000 7f462b5fc640 1 -- 10.20.193.76:0/3992538435 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f46240977f0 msgr2=0x7f462412f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.527+0000 7f462b5fc640 1 --2- 10.20.193.76:0/3992538435 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f46240977f0 0x7f462412f330 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4614009970 tx=0x7f461402eeb0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.527+0000 7f462b5fc640 1 -- 10.20.193.76:0/3992538435 shutdown_connections 2026-02-25T17:13:34.534 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.527+0000 7f462b5fc640 1 --2- 10.20.193.76:0/3992538435 >> v2:10.20.193.76:3300/0 conn(0x7f462412f870 0x7f4624131c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.534 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.527+0000 7f462b5fc640 1 --2- 10.20.193.76:0/3992538435 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f46240977f0 0x7f462412f330 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.534 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.527+0000 7f462b5fc640 1 -- 10.20.193.76:0/3992538435 >> 10.20.193.76:0/3992538435 conn(0x7f462409db30 msgr2=0x7f462409df30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:34.534 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.527+0000 7f462b5fc640 1 -- 10.20.193.76:0/3992538435 shutdown_connections 2026-02-25T17:13:34.534 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.527+0000 7f462b5fc640 1 -- 10.20.193.76:0/3992538435 wait complete. 2026-02-25T17:13:34.534 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.527+0000 7f462b5fc640 1 Processor -- start 2026-02-25T17:13:34.534 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.527+0000 7f462b5fc640 1 -- start start 2026-02-25T17:13:34.534 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.527+0000 7f462b5fc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4624096d10 0x7f462412c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.534 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.527+0000 7f462b5fc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f46240977f0 0x7f462412caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.534 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.527+0000 7f462b5fc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f462412f870 0x7f462412cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.534 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.527+0000 7f462b5fc640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46241145f0 con 0x7f4624096d10 2026-02-25T17:13:34.534 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.527+0000 7f462b5fc640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462412e090 con 0x7f46240977f0 2026-02-25T17:13:34.534 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.527+0000 7f462b5fc640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4624113d50 con 0x7f462412f870 2026-02-25T17:13:34.535 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.528+0000 7f4629398640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4624096d10 0x7f462412c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.535 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.528+0000 7f4629b99640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f462412f870 0x7f462412cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.535 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.528+0000 7f4628b97640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f46240977f0 0x7f462412caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.535 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.528+0000 7f4629398640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4624096d10 0x7f462412c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:56988/0 (socket says 10.20.193.76:56988) 2026-02-25T17:13:34.535 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.528+0000 7f4629b99640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f462412f870 0x7f462412cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:46734/0 (socket says 10.20.193.76:46734) 2026-02-25T17:13:34.535 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.528+0000 7f4629398640 1 -- 10.20.193.76:0/1583845291 learned_addr learned my addr 10.20.193.76:0/1583845291 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:34.535 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.528+0000 7f4629b99640 1 -- 10.20.193.76:0/1583845291 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f46240977f0 msgr2=0x7f462412caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.535 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.528+0000 7f4629b99640 1 --2- 10.20.193.76:0/1583845291 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f46240977f0 0x7f462412caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.535 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.528+0000 7f4629b99640 1 -- 10.20.193.76:0/1583845291 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4624096d10 msgr2=0x7f462412c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.535 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.528+0000 7f4629b99640 1 --2- 10.20.193.76:0/1583845291 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4624096d10 0x7f462412c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.535 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.528+0000 7f4629b99640 1 -- 10.20.193.76:0/1583845291 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4614009450 con 0x7f462412f870 2026-02-25T17:13:34.535 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.528+0000 7f4629b99640 1 --2- 10.20.193.76:0/1583845291 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f462412f870 0x7f462412cfe0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f461c009e20 tx=0x7f461c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:34.536 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.528+0000 7f4619ffb640 1 -- 10.20.193.76:0/1583845291 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c00ce20 con 0x7f462412f870 2026-02-25T17:13:34.536 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.528+0000 7f4619ffb640 1 -- 10.20.193.76:0/1583845291 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461c00f040 con 0x7f462412f870 2026-02-25T17:13:34.536 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.528+0000 7f462b5fc640 1 -- 10.20.193.76:0/1583845291 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4624123840 con 0x7f462412f870 2026-02-25T17:13:34.536 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.528+0000 7f4619ffb640 1 -- 10.20.193.76:0/1583845291 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c0146d0 con 0x7f462412f870 2026-02-25T17:13:34.536 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.528+0000 7f462b5fc640 1 -- 10.20.193.76:0/1583845291 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f462412d6c0 con 0x7f462412f870 2026-02-25T17:13:34.536 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.528+0000 7f4619ffb640 1 -- 10.20.193.76:0/1583845291 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f461c014cd0 con 0x7f462412f870 2026-02-25T17:13:34.536 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.528+0000 7f4619ffb640 1 -- 10.20.193.76:0/1583845291 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f461c0133e0 con 0x7f462412f870 2026-02-25T17:13:34.536 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.528+0000 7f462b5fc640 1 -- 10.20.193.76:0/1583845291 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4624113f70 con 0x7f462412f870 2026-02-25T17:13:34.537 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.530+0000 7f4619ffb640 1 -- 10.20.193.76:0/1583845291 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7f461c03b990 con 0x7f462412f870 2026-02-25T17:13:34.563 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.561+0000 7f281da14ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-25T17:13:34.564 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.561+0000 7f646ca23ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-25T17:13:34.564 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.561+0000 7f462b5fc640 1 -- 10.20.193.76:0/1583845291 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd new", "uuid": "f0a0a51c-d629-464e-bc04-dacbaaf78efa", "id": 1} v 0) v1 -- 0x7f4624064c00 con 0x7f462412f870 2026-02-25T17:13:34.566 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.563+0000 7f4619ffb640 1 -- 10.20.193.76:0/1583845291 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f0a0a51c-d629-464e-bc04-dacbaaf78efa", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f461c02a070 con 0x7f462412f870 2026-02-25T17:13:34.566 INFO:teuthology.orchestra.run.trial076.stdout:1 2026-02-25T17:13:34.567 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.564+0000 7f462b5fc640 1 -- 10.20.193.76:0/1583845291 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f462412f870 msgr2=0x7f462412cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.567 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.564+0000 7f462b5fc640 1 --2- 10.20.193.76:0/1583845291 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f462412f870 0x7f462412cfe0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f461c009e20 tx=0x7f461c00b040 comp rx=0 tx=0).stop 2026-02-25T17:13:34.567 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.564+0000 7f462b5fc640 1 -- 10.20.193.76:0/1583845291 shutdown_connections 2026-02-25T17:13:34.567 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.564+0000 7f462b5fc640 1 --2- 10.20.193.76:0/1583845291 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f462412f870 0x7f462412cfe0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.567 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.564+0000 7f462b5fc640 1 --2- 10.20.193.76:0/1583845291 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f46240977f0 0x7f462412caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.567 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.564+0000 7f462b5fc640 1 --2- 10.20.193.76:0/1583845291 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4624096d10 0x7f462412c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.567 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.564+0000 7f462b5fc640 1 -- 10.20.193.76:0/1583845291 >> 10.20.193.76:0/1583845291 conn(0x7f462409db30 msgr2=0x7f462409c250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:34.567 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.564+0000 7f462b5fc640 1 -- 10.20.193.76:0/1583845291 shutdown_connections 2026-02-25T17:13:34.567 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.564+0000 7f462b5fc640 1 -- 10.20.193.76:0/1583845291 wait complete. 2026-02-25T17:13:34.572 DEBUG:teuthology.orchestra.run.trial076:> sudo ceph --cluster ceph osd new 9633000b-764d-457a-b560-539dc5830e9e 2 2026-02-25T17:13:34.623 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.621+0000 7f281da14ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-25T17:13:34.624 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.621+0000 7f646ca23ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-25T17:13:34.645 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.642+0000 7f646ca23ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-25T17:13:34.645 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.642+0000 7f281da14ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-25T17:13:34.680 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.673+0000 7f150181d640 1 Processor -- start 2026-02-25T17:13:34.680 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.673+0000 7f150181d640 1 -- start start 2026-02-25T17:13:34.680 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.673+0000 7f150181d640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f14fc096d10 0x7f14fc0970e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.680 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.673+0000 7f150181d640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f14fc097620 0x7f14fc12a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.680 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.673+0000 7f150181d640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f14fc12a540 0x7f14fc12a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.673+0000 7f150181d640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14fc12af20 con 0x7f14fc096d10 2026-02-25T17:13:34.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.673+0000 7f150181d640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc099460 con 0x7f14fc12a540 2026-02-25T17:13:34.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.673+0000 7f150181d640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc098ee0 con 0x7f14fc097620 2026-02-25T17:13:34.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.673+0000 7f14faffd640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f14fc096d10 0x7f14fc0970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.673+0000 7f14f3fff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f14fc097620 0x7f14fc12a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.673+0000 7f14faffd640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f14fc096d10 0x7f14fc0970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:56994/0 (socket says 10.20.193.76:56994) 2026-02-25T17:13:34.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.673+0000 7f14faffd640 1 -- 10.20.193.76:0/1470710059 learned_addr learned my addr 10.20.193.76:0/1470710059 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:34.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.673+0000 7f14fb7fe640 1 --2- 10.20.193.76:0/1470710059 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f14fc12a540 0x7f14fc12a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.674+0000 7f14faffd640 1 -- 10.20.193.76:0/1470710059 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f14fc097620 msgr2=0x7f14fc12a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:34.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.674+0000 7f14faffd640 1 --2- 10.20.193.76:0/1470710059 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f14fc097620 0x7f14fc12a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.674+0000 7f14faffd640 1 -- 10.20.193.76:0/1470710059 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f14fc12a540 msgr2=0x7f14fc12a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:34.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.674+0000 7f14faffd640 1 --2- 10.20.193.76:0/1470710059 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f14fc12a540 0x7f14fc12a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.674+0000 7f14faffd640 1 -- 10.20.193.76:0/1470710059 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc09a450 con 0x7f14fc096d10 2026-02-25T17:13:34.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.674+0000 7f14faffd640 1 --2- 10.20.193.76:0/1470710059 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f14fc096d10 0x7f14fc0970e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f14ec009910 tx=0x7f14ec02eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beeefce4fc811a3c server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:34.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.674+0000 7f14fa7fc640 1 -- 10.20.193.76:0/1470710059 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec02f9c0 con 0x7f14fc096d10 2026-02-25T17:13:34.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.674+0000 7f14fa7fc640 1 -- 10.20.193.76:0/1470710059 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ec02fb20 con 0x7f14fc096d10 2026-02-25T17:13:34.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.674+0000 7f14fa7fc640 1 -- 10.20.193.76:0/1470710059 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec037440 con 0x7f14fc096d10 2026-02-25T17:13:34.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.674+0000 7f150181d640 1 -- 10.20.193.76:0/1470710059 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f14fc096d10 msgr2=0x7f14fc0970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.674+0000 7f150181d640 1 --2- 10.20.193.76:0/1470710059 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f14fc096d10 0x7f14fc0970e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f14ec009910 tx=0x7f14ec02eeb0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.674+0000 7f150181d640 1 -- 10.20.193.76:0/1470710059 shutdown_connections 2026-02-25T17:13:34.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.674+0000 7f150181d640 1 --2- 10.20.193.76:0/1470710059 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f14fc12a540 0x7f14fc12a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.674+0000 7f150181d640 1 --2- 10.20.193.76:0/1470710059 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f14fc097620 0x7f14fc12a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.674+0000 7f150181d640 1 --2- 10.20.193.76:0/1470710059 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f14fc096d10 0x7f14fc0970e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.674+0000 7f150181d640 1 -- 10.20.193.76:0/1470710059 >> 10.20.193.76:0/1470710059 conn(0x7f14fc09db30 msgr2=0x7f14fc09df30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:34.683 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.674+0000 7f150181d640 1 -- 10.20.193.76:0/1470710059 shutdown_connections 2026-02-25T17:13:34.683 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.674+0000 7f150181d640 1 -- 10.20.193.76:0/1470710059 wait complete. 2026-02-25T17:13:34.683 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f150181d640 1 Processor -- start 2026-02-25T17:13:34.683 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f150181d640 1 -- start start 2026-02-25T17:13:34.683 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f150181d640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f14fc096d10 0x7f14fc1be450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.683 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f150181d640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f14fc097620 0x7f14fc1be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.683 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f150181d640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f14fc12a540 0x7f14fc1beed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.683 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f150181d640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc11a8c0 con 0x7f14fc097620 2026-02-25T17:13:34.683 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f150181d640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc11c550 con 0x7f14fc096d10 2026-02-25T17:13:34.683 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f150181d640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc11c180 con 0x7f14fc12a540 2026-02-25T17:13:34.683 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f14faffd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f14fc096d10 0x7f14fc1be450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.683 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f14f3fff640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f14fc097620 0x7f14fc1be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f14fb7fe640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f14fc12a540 0x7f14fc1beed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f14faffd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f14fc096d10 0x7f14fc1be450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:46270/0 (socket says 10.20.193.76:46270) 2026-02-25T17:13:34.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f14f3fff640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f14fc097620 0x7f14fc1be990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:56998/0 (socket says 10.20.193.76:56998) 2026-02-25T17:13:34.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f14faffd640 1 -- 10.20.193.76:0/3644138172 learned_addr learned my addr 10.20.193.76:0/3644138172 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:34.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f14faffd640 1 -- 10.20.193.76:0/3644138172 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f14fc12a540 msgr2=0x7f14fc1beed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f14faffd640 1 --2- 10.20.193.76:0/3644138172 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f14fc12a540 0x7f14fc1beed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f14faffd640 1 -- 10.20.193.76:0/3644138172 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f14fc097620 msgr2=0x7f14fc1be990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f14faffd640 1 --2- 10.20.193.76:0/3644138172 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f14fc097620 0x7f14fc1be990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f14faffd640 1 -- 10.20.193.76:0/3644138172 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec009450 con 0x7f14fc096d10 2026-02-25T17:13:34.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f14fb7fe640 1 --2- 10.20.193.76:0/3644138172 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f14fc12a540 0x7f14fc1beed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:34.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.675+0000 7f14faffd640 1 --2- 10.20.193.76:0/3644138172 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f14fc096d10 0x7f14fc1be450 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f14ec02eef0 tx=0x7f14ec037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:34.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.676+0000 7f14f8ff9640 1 -- 10.20.193.76:0/3644138172 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec042650 con 0x7f14fc096d10 2026-02-25T17:13:34.685 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.676+0000 7f14f8ff9640 1 -- 10.20.193.76:0/3644138172 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ec0427b0 con 0x7f14fc096d10 2026-02-25T17:13:34.685 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.676+0000 7f150181d640 1 -- 10.20.193.76:0/3644138172 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14fc118d20 con 0x7f14fc096d10 2026-02-25T17:13:34.685 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.676+0000 7f14f8ff9640 1 -- 10.20.193.76:0/3644138172 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec042bb0 con 0x7f14fc096d10 2026-02-25T17:13:34.685 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.676+0000 7f150181d640 1 -- 10.20.193.76:0/3644138172 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14fc119260 con 0x7f14fc096d10 2026-02-25T17:13:34.685 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.676+0000 7f14f8ff9640 1 -- 10.20.193.76:0/3644138172 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f14ec03e040 con 0x7f14fc096d10 2026-02-25T17:13:34.685 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.676+0000 7f14f8ff9640 1 -- 10.20.193.76:0/3644138172 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f14ec040820 con 0x7f14fc096d10 2026-02-25T17:13:34.685 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.676+0000 7f150181d640 1 -- 10.20.193.76:0/3644138172 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14fc064c00 con 0x7f14fc096d10 2026-02-25T17:13:34.685 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.677+0000 7f14f8ff9640 1 -- 10.20.193.76:0/3644138172 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7f14ec047070 con 0x7f14fc096d10 2026-02-25T17:13:34.711 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.708+0000 7f150181d640 1 -- 10.20.193.76:0/3644138172 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9633000b-764d-457a-b560-539dc5830e9e", "id": 2} v 0) v1 -- 0x7f14fc063e70 con 0x7f14fc096d10 2026-02-25T17:13:34.713 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.710+0000 7f14f8ff9640 1 -- 10.20.193.76:0/3644138172 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9633000b-764d-457a-b560-539dc5830e9e", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f14ec03c070 con 0x7f14fc096d10 2026-02-25T17:13:34.713 INFO:teuthology.orchestra.run.trial076.stdout:2 2026-02-25T17:13:34.714 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.711+0000 7f150181d640 1 -- 10.20.193.76:0/3644138172 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f14fc096d10 msgr2=0x7f14fc1be450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.714 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.711+0000 7f150181d640 1 --2- 10.20.193.76:0/3644138172 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f14fc096d10 0x7f14fc1be450 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f14ec02eef0 tx=0x7f14ec037000 comp rx=0 tx=0).stop 2026-02-25T17:13:34.714 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.711+0000 7f150181d640 1 -- 10.20.193.76:0/3644138172 shutdown_connections 2026-02-25T17:13:34.715 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.711+0000 7f150181d640 1 --2- 10.20.193.76:0/3644138172 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f14fc12a540 0x7f14fc1beed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.715 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.711+0000 7f150181d640 1 --2- 10.20.193.76:0/3644138172 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f14fc097620 0x7f14fc1be990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.715 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.711+0000 7f150181d640 1 --2- 10.20.193.76:0/3644138172 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f14fc096d10 0x7f14fc1be450 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.715 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.711+0000 7f150181d640 1 -- 10.20.193.76:0/3644138172 >> 10.20.193.76:0/3644138172 conn(0x7f14fc09db30 msgr2=0x7f14fc1b1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:34.715 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.711+0000 7f150181d640 1 -- 10.20.193.76:0/3644138172 shutdown_connections 2026-02-25T17:13:34.715 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.711+0000 7f150181d640 1 -- 10.20.193.76:0/3644138172 wait complete. 2026-02-25T17:13:34.721 DEBUG:teuthology.orchestra.run.trial076:> sudo ceph --cluster ceph osd new fc098e34-48a8-4414-ad41-60abdf7388a5 3 2026-02-25T17:13:34.802 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:34.799+0000 7f281da14ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-25T17:13:34.802 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:13:34.799+0000 7f646ca23ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-25T17:13:34.828 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.822+0000 7f97e179c640 1 Processor -- start 2026-02-25T17:13:34.829 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.822+0000 7f97e179c640 1 -- start start 2026-02-25T17:13:34.829 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.822+0000 7f97e179c640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f97dc096d10 0x7f97dc0970e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.829 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.822+0000 7f97e179c640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f97dc097620 0x7f97dc12a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.829 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.822+0000 7f97e179c640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97dc099460 con 0x7f97dc12a540 2026-02-25T17:13:34.829 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.822+0000 7f97e179c640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97dc098ee0 con 0x7f97dc096d10 2026-02-25T17:13:34.829 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.822+0000 7f97e179c640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc09a450 con 0x7f97dc097620 2026-02-25T17:13:34.829 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.822+0000 7f97daffd640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f97dc096d10 0x7f97dc0970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.829 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.822+0000 7f97daffd640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f97dc096d10 0x7f97dc0970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:57054/0 (socket says 10.20.193.76:57054) 2026-02-25T17:13:34.829 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.822+0000 7f97daffd640 1 -- 10.20.193.76:0/2014201884 learned_addr learned my addr 10.20.193.76:0/2014201884 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:34.829 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.822+0000 7f97db7fe640 1 --1- 10.20.193.76:0/2014201884 >> v1:10.20.193.76:6789/0 conn(0x7f97dc12a540 0x7f97dc131340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:56480/0 (socket says 10.20.193.76:56480) 2026-02-25T17:13:34.829 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.822+0000 7f97cbfff640 1 --2- 10.20.193.76:0/2014201884 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f97dc097620 0x7f97dc12a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.830 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.822+0000 7f97daffd640 1 -- 10.20.193.76:0/2014201884 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f97dc097620 msgr2=0x7f97dc12a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:34.830 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.822+0000 7f97daffd640 1 --2- 10.20.193.76:0/2014201884 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f97dc097620 0x7f97dc12a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.830 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.822+0000 7f97daffd640 1 -- 10.20.193.76:0/2014201884 >> v1:10.20.193.76:6789/0 conn(0x7f97dc12a540 legacy=0x7f97dc131340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.830 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.822+0000 7f97daffd640 1 -- 10.20.193.76:0/2014201884 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc09a080 con 0x7f97dc096d10 2026-02-25T17:13:34.830 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.822+0000 7f97cbfff640 1 --2- 10.20.193.76:0/2014201884 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f97dc097620 0x7f97dc12a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-25T17:13:34.830 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.823+0000 7f97daffd640 1 --2- 10.20.193.76:0/2014201884 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f97dc096d10 0x7f97dc0970e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009f20 tx=0x7f97cc02f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fdce969e14d6b09 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:34.830 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.823+0000 7f97da7fc640 1 -- 10.20.193.76:0/2014201884 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc02fc60 con 0x7f97dc096d10 2026-02-25T17:13:34.830 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.823+0000 7f97da7fc640 1 -- 10.20.193.76:0/2014201884 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc02fdc0 con 0x7f97dc096d10 2026-02-25T17:13:34.830 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.823+0000 7f97da7fc640 1 -- 10.20.193.76:0/2014201884 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc007630 con 0x7f97dc096d10 2026-02-25T17:13:34.830 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.823+0000 7f97e179c640 1 -- 10.20.193.76:0/2014201884 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f97dc096d10 msgr2=0x7f97dc0970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.830 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.823+0000 7f97e179c640 1 --2- 10.20.193.76:0/2014201884 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f97dc096d10 0x7f97dc0970e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009f20 tx=0x7f97cc02f310 comp rx=0 tx=0).stop 2026-02-25T17:13:34.830 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.823+0000 7f97e179c640 1 -- 10.20.193.76:0/2014201884 shutdown_connections 2026-02-25T17:13:34.831 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.823+0000 7f97e179c640 1 --2- 10.20.193.76:0/2014201884 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f97dc097620 0x7f97dc12a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.831 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.823+0000 7f97e179c640 1 --2- 10.20.193.76:0/2014201884 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f97dc096d10 0x7f97dc0970e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.831 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.823+0000 7f97e179c640 1 -- 10.20.193.76:0/2014201884 >> 10.20.193.76:0/2014201884 conn(0x7f97dc09db30 msgr2=0x7f97dc09df30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:34.831 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.823+0000 7f97e179c640 1 -- 10.20.193.76:0/2014201884 shutdown_connections 2026-02-25T17:13:34.831 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.823+0000 7f97e179c640 1 -- 10.20.193.76:0/2014201884 wait complete. 2026-02-25T17:13:34.831 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.823+0000 7f97e179c640 1 Processor -- start 2026-02-25T17:13:34.831 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97e179c640 1 -- start start 2026-02-25T17:13:34.831 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97e179c640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f97dc096d10 0x7f97dc1bea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.831 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97e179c640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f97dc097620 0x7f97dc1bef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.831 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97e179c640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f97dc12a540 0x7f97dc11c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.831 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97e179c640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc11eaa0 con 0x7f97dc096d10 2026-02-25T17:13:34.831 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97e179c640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc11fd00 con 0x7f97dc097620 2026-02-25T17:13:34.832 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97e179c640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc127b60 con 0x7f97dc12a540 2026-02-25T17:13:34.832 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97daffd640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f97dc096d10 0x7f97dc1bea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.832 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97daffd640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f97dc096d10 0x7f97dc1bea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:57070/0 (socket says 10.20.193.76:57070) 2026-02-25T17:13:34.832 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97daffd640 1 -- 10.20.193.76:0/31036077 learned_addr learned my addr 10.20.193.76:0/31036077 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:34.832 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97db7fe640 1 --2- 10.20.193.76:0/31036077 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f97dc12a540 0x7f97dc11c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.832 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97cbfff640 1 --2- 10.20.193.76:0/31036077 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f97dc097620 0x7f97dc1bef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.832 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97daffd640 1 -- 10.20.193.76:0/31036077 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f97dc12a540 msgr2=0x7f97dc11c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.832 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97daffd640 1 --2- 10.20.193.76:0/31036077 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f97dc12a540 0x7f97dc11c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.832 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97daffd640 1 -- 10.20.193.76:0/31036077 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f97dc097620 msgr2=0x7f97dc1bef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.832 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97daffd640 1 --2- 10.20.193.76:0/31036077 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f97dc097620 0x7f97dc1bef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.832 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97daffd640 1 -- 10.20.193.76:0/31036077 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc009ae0 con 0x7f97dc096d10 2026-02-25T17:13:34.832 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97db7fe640 1 --2- 10.20.193.76:0/31036077 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f97dc12a540 0x7f97dc11c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-25T17:13:34.833 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97daffd640 1 --2- 10.20.193.76:0/31036077 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f97dc096d10 0x7f97dc1bea10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00b150 tx=0x7f97cc039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:34.833 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97cb7fe640 1 -- 10.20.193.76:0/31036077 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc043680 con 0x7f97dc096d10 2026-02-25T17:13:34.833 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97cb7fe640 1 -- 10.20.193.76:0/31036077 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc043820 con 0x7f97dc096d10 2026-02-25T17:13:34.833 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97e179c640 1 -- 10.20.193.76:0/31036077 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97dc129bb0 con 0x7f97dc096d10 2026-02-25T17:13:34.833 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97cb7fe640 1 -- 10.20.193.76:0/31036077 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc043be0 con 0x7f97dc096d10 2026-02-25T17:13:34.833 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97e179c640 1 -- 10.20.193.76:0/31036077 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97dc1bf510 con 0x7f97dc096d10 2026-02-25T17:13:34.833 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.824+0000 7f97cb7fe640 1 -- 10.20.193.76:0/31036077 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 2) v1 ==== 29536+0+0 (secure 0 0 0) 0x7f97cc043d40 con 0x7f97dc096d10 2026-02-25T17:13:34.833 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.825+0000 7f97cb7fe640 1 -- 10.20.193.76:0/31036077 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f97cc05c180 con 0x7f97dc096d10 2026-02-25T17:13:34.833 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.825+0000 7f97e179c640 1 -- 10.20.193.76:0/31036077 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97dc064c00 con 0x7f97dc096d10 2026-02-25T17:13:34.833 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.826+0000 7f97cb7fe640 1 -- 10.20.193.76:0/31036077 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7f97cc048030 con 0x7f97dc096d10 2026-02-25T17:13:34.860 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.858+0000 7f97e179c640 1 -- 10.20.193.76:0/31036077 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fc098e34-48a8-4414-ad41-60abdf7388a5", "id": 3} v 0) v1 -- 0x7f97dc063e70 con 0x7f97dc096d10 2026-02-25T17:13:34.862 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.859+0000 7f97cb7fe640 1 -- 10.20.193.76:0/31036077 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc098e34-48a8-4414-ad41-60abdf7388a5", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f97cc0375b0 con 0x7f97dc096d10 2026-02-25T17:13:34.862 INFO:teuthology.orchestra.run.trial076.stdout:3 2026-02-25T17:13:34.863 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.860+0000 7f97e179c640 1 -- 10.20.193.76:0/31036077 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f97dc096d10 msgr2=0x7f97dc1bea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.863 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.860+0000 7f97e179c640 1 --2- 10.20.193.76:0/31036077 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f97dc096d10 0x7f97dc1bea10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00b150 tx=0x7f97cc039000 comp rx=0 tx=0).stop 2026-02-25T17:13:34.863 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.860+0000 7f97e179c640 1 -- 10.20.193.76:0/31036077 shutdown_connections 2026-02-25T17:13:34.863 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.860+0000 7f97e179c640 1 --2- 10.20.193.76:0/31036077 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f97dc12a540 0x7f97dc11c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.864 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.860+0000 7f97e179c640 1 --2- 10.20.193.76:0/31036077 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f97dc097620 0x7f97dc1bef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.864 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.860+0000 7f97e179c640 1 --2- 10.20.193.76:0/31036077 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f97dc096d10 0x7f97dc1bea10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.864 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.860+0000 7f97e179c640 1 -- 10.20.193.76:0/31036077 >> 10.20.193.76:0/31036077 conn(0x7f97dc09db30 msgr2=0x7f97dc115c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:34.864 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.860+0000 7f97e179c640 1 -- 10.20.193.76:0/31036077 shutdown_connections 2026-02-25T17:13:34.864 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.860+0000 7f97e179c640 1 -- 10.20.193.76:0/31036077 wait complete. 2026-02-25T17:13:34.869 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-25T17:13:34.869 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-25T17:13:34.911 INFO:tasks.ceph.osd.0:Started 2026-02-25T17:13:34.912 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-25T17:13:34.912 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-25T17:13:34.914 INFO:tasks.ceph.osd.1:Started 2026-02-25T17:13:34.914 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-25T17:13:34.914 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-25T17:13:34.916 INFO:tasks.ceph.osd.2:Started 2026-02-25T17:13:34.917 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-25T17:13:34.917 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-25T17:13:34.919 INFO:tasks.ceph.osd.3:Started 2026-02-25T17:13:34.920 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T17:13:34.989 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.983+0000 7f89186db640 1 Processor -- start 2026-02-25T17:13:34.989 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.983+0000 7f89186db640 1 -- start start 2026-02-25T17:13:34.989 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.983+0000 7f89186db640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f8910096cb0 0x7f8910097080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.989 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.983+0000 7f89186db640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8910097990 0x7f891012a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.989 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.983+0000 7f89186db640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8910099350 con 0x7f89100975c0 2026-02-25T17:13:34.990 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.983+0000 7f89186db640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891009a4a0 con 0x7f8910096cb0 2026-02-25T17:13:34.990 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.983+0000 7f89186db640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f891009a6a0 con 0x7f8910097990 2026-02-25T17:13:34.990 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.983+0000 7f8916477640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f8910096cb0 0x7f8910097080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.990 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.983+0000 7f8915c76640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f89100975c0 0x7f8910129ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:56526/0 (socket says 10.20.193.76:56526) 2026-02-25T17:13:34.990 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.983+0000 7f8915c76640 1 -- 10.20.193.76:0/2539774236 learned_addr learned my addr 10.20.193.76:0/2539774236 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:13:34.990 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.983+0000 7f8916477640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f8910096cb0 0x7f8910097080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:46362/0 (socket says 10.20.193.76:46362) 2026-02-25T17:13:34.990 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.983+0000 7f8916c78640 1 --2- 10.20.193.76:0/2539774236 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8910097990 0x7f891012a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.990 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.983+0000 7f8916477640 1 -- 10.20.193.76:0/2539774236 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8910097990 msgr2=0x7f891012a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:34.990 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.983+0000 7f8916477640 1 --2- 10.20.193.76:0/2539774236 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8910097990 0x7f891012a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.990 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.983+0000 7f8916477640 1 -- 10.20.193.76:0/2539774236 >> v1:10.20.193.76:6789/0 conn(0x7f89100975c0 legacy=0x7f8910129ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.990 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.983+0000 7f8916477640 1 -- 10.20.193.76:0/2539774236 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891009a010 con 0x7f8910096cb0 2026-02-25T17:13:34.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.983+0000 7f8915475640 1 -- 10.20.193.76:0/2539774236 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702687779 0 0) 0x7f8910099350 con 0x7f89100975c0 2026-02-25T17:13:34.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.983+0000 7f8916477640 1 --2- 10.20.193.76:0/2539774236 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f8910096cb0 0x7f8910097080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f890c009880 tx=0x7f890c02ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fea59b685a7aad3 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:34.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.984+0000 7f8915475640 1 -- 10.20.193.76:0/2539774236 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c02f890 con 0x7f8910096cb0 2026-02-25T17:13:34.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.984+0000 7f8915475640 1 -- 10.20.193.76:0/2539774236 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c02f9f0 con 0x7f8910096cb0 2026-02-25T17:13:34.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.984+0000 7f8915475640 1 -- 10.20.193.76:0/2539774236 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c02fd90 con 0x7f8910096cb0 2026-02-25T17:13:34.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.984+0000 7f89186db640 1 -- 10.20.193.76:0/2539774236 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f8910096cb0 msgr2=0x7f8910097080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.984+0000 7f89186db640 1 --2- 10.20.193.76:0/2539774236 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f8910096cb0 0x7f8910097080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f890c009880 tx=0x7f890c02ed80 comp rx=0 tx=0).stop 2026-02-25T17:13:34.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.984+0000 7f89186db640 1 -- 10.20.193.76:0/2539774236 shutdown_connections 2026-02-25T17:13:34.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.984+0000 7f89186db640 1 --2- 10.20.193.76:0/2539774236 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8910097990 0x7f891012a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.984+0000 7f89186db640 1 --2- 10.20.193.76:0/2539774236 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f8910096cb0 0x7f8910097080 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.984+0000 7f89186db640 1 -- 10.20.193.76:0/2539774236 >> 10.20.193.76:0/2539774236 conn(0x7f891009dac0 msgr2=0x7f891009dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:34.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.984+0000 7f89186db640 1 -- 10.20.193.76:0/2539774236 shutdown_connections 2026-02-25T17:13:34.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.984+0000 7f89186db640 1 -- 10.20.193.76:0/2539774236 wait complete. 2026-02-25T17:13:34.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.984+0000 7f89186db640 1 Processor -- start 2026-02-25T17:13:34.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.984+0000 7f89186db640 1 -- start start 2026-02-25T17:13:34.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f89186db640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8910096cb0 0x7f89101be4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f89186db640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f89100975c0 0x7f89101bea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f89186db640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f8910097990 0x7f89101bef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:34.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f89186db640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8910131970 con 0x7f8910097990 2026-02-25T17:13:34.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f89186db640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8910116540 con 0x7f89100975c0 2026-02-25T17:13:34.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f89186db640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8910116170 con 0x7f8910096cb0 2026-02-25T17:13:34.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f8916477640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8910096cb0 0x7f89101be4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f8915c76640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f89100975c0 0x7f89101bea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f8916477640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8910096cb0 0x7f89101be4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:46892/0 (socket says 10.20.193.76:46892) 2026-02-25T17:13:34.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f8916477640 1 -- 10.20.193.76:0/1645017544 learned_addr learned my addr 10.20.193.76:0/1645017544 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:34.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f8916c78640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f8910097990 0x7f89101bef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:34.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f8915c76640 1 -- 10.20.193.76:0/1645017544 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8910096cb0 msgr2=0x7f89101be4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f8915c76640 1 --2- 10.20.193.76:0/1645017544 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8910096cb0 0x7f89101be4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f8915c76640 1 -- 10.20.193.76:0/1645017544 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f8910097990 msgr2=0x7f89101bef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:34.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f8915c76640 1 --2- 10.20.193.76:0/1645017544 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f8910097990 0x7f89101bef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:34.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f8915c76640 1 -- 10.20.193.76:0/1645017544 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890c009390 con 0x7f89100975c0 2026-02-25T17:13:34.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f8915c76640 1 --2- 10.20.193.76:0/1645017544 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f89100975c0 0x7f89101bea20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8900000c00 tx=0x7f8900007c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:34.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f8906ffd640 1 -- 10.20.193.76:0/1645017544 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8900005aa0 con 0x7f89100975c0 2026-02-25T17:13:34.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f8906ffd640 1 -- 10.20.193.76:0/1645017544 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8900005c20 con 0x7f89100975c0 2026-02-25T17:13:34.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f89186db640 1 -- 10.20.193.76:0/1645017544 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8910130e10 con 0x7f89100975c0 2026-02-25T17:13:34.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f8906ffd640 1 -- 10.20.193.76:0/1645017544 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8900007320 con 0x7f89100975c0 2026-02-25T17:13:34.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f89186db640 1 -- 10.20.193.76:0/1645017544 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8910113d50 con 0x7f89100975c0 2026-02-25T17:13:34.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.985+0000 7f8906ffd640 1 -- 10.20.193.76:0/1645017544 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 2) v1 ==== 29536+0+0 (secure 0 0 0) 0x7f890001b3b0 con 0x7f89100975c0 2026-02-25T17:13:34.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.986+0000 7f8906ffd640 1 -- 10.20.193.76:0/1645017544 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f8900036080 con 0x7f89100975c0 2026-02-25T17:13:34.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.986+0000 7f89186db640 1 -- 10.20.193.76:0/1645017544 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8910064c00 con 0x7f89100975c0 2026-02-25T17:13:34.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:34.987+0000 7f8906ffd640 1 -- 10.20.193.76:0/1645017544 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7f8900017030 con 0x7f89100975c0 2026-02-25T17:13:35.016 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:35.013+0000 7f89186db640 1 -- 10.20.193.76:0/1645017544 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8910063e70 con 0x7f89100975c0 2026-02-25T17:13:35.017 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:35.013+0000 7f8906ffd640 1 -- 10.20.193.76:0/1645017544 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4108 (secure 0 0 0) 0x7f890001a360 con 0x7f89100975c0 2026-02-25T17:13:35.017 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:35.017 INFO:teuthology.orchestra.run.trial076.stdout:{"epoch":6,"fsid":"0648ee30-4e19-4268-91ad-07b0e65a8518","created":"2026-02-25T17:13:33.780133+0000","modified":"2026-02-25T17:13:34.859194+0000","last_up_change":"0.000000","last_in_change":"2026-02-25T17:13:34.859194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"85909bd3-2540-48a9-a649-33709fa74613","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f0a0a51c-d629-464e-bc04-dacbaaf78efa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9633000b-764d-457a-b560-539dc5830e9e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fc098e34-48a8-4414-ad41-60abdf7388a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T17:13:35.018 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:35.014+0000 7f89186db640 1 -- 10.20.193.76:0/1645017544 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f89100975c0 msgr2=0x7f89101bea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:35.018 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:35.014+0000 7f89186db640 1 --2- 10.20.193.76:0/1645017544 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f89100975c0 0x7f89101bea20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8900000c00 tx=0x7f8900007c40 comp rx=0 tx=0).stop 2026-02-25T17:13:35.018 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:35.014+0000 7f89186db640 1 -- 10.20.193.76:0/1645017544 shutdown_connections 2026-02-25T17:13:35.018 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:35.014+0000 7f89186db640 1 --2- 10.20.193.76:0/1645017544 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f8910097990 0x7f89101bef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:35.019 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:35.014+0000 7f89186db640 1 --2- 10.20.193.76:0/1645017544 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f89100975c0 0x7f89101bea20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:35.019 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:35.014+0000 7f89186db640 1 --2- 10.20.193.76:0/1645017544 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8910096cb0 0x7f89101be4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:35.019 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:35.014+0000 7f89186db640 1 -- 10.20.193.76:0/1645017544 >> 10.20.193.76:0/1645017544 conn(0x7f891009dac0 msgr2=0x7f8910127ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:35.019 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:35.014+0000 7f89186db640 1 -- 10.20.193.76:0/1645017544 shutdown_connections 2026-02-25T17:13:35.019 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:35.014+0000 7f89186db640 1 -- 10.20.193.76:0/1645017544 wait complete. 2026-02-25T17:13:35.022 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-25T17:13:35.023 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-25T17:13:35.425 DEBUG:teuthology.orchestra.run.trial076:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-25T17:13:35.487 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.480+0000 7f6c9f831640 1 Processor -- start 2026-02-25T17:13:35.487 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.480+0000 7f6c9f831640 1 -- start start 2026-02-25T17:13:35.487 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.481+0000 7f6c9f831640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f6c98069030 0x7f6c98096a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:35.487 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.481+0000 7f6c9f831640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f6c98097380 0x7f6c98127640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:35.487 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.481+0000 7f6c9f831640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c9809b6a0 con 0x7f6c98096fb0 2026-02-25T17:13:35.488 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.481+0000 7f6c9f831640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9809bab0 con 0x7f6c98097380 2026-02-25T17:13:35.488 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.481+0000 7f6c9f831640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9809cc90 con 0x7f6c98069030 2026-02-25T17:13:35.488 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.481+0000 7f6c9d5cd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f6c98069030 0x7f6c98096a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:35.488 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.481+0000 7f6c9d5cd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f6c98069030 0x7f6c98096a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:46902/0 (socket says 10.20.193.76:46902) 2026-02-25T17:13:35.488 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.481+0000 7f6c9d5cd640 1 -- 10.20.193.76:0/2434251052 learned_addr learned my addr 10.20.193.76:0/2434251052 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:35.488 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.481+0000 7f6c9cdcc640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f6c98096fb0 0x7f6c98126f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:56542/0 (socket says 10.20.193.76:56542) 2026-02-25T17:13:35.488 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.481+0000 7f6c9ddce640 1 --2- 10.20.193.76:0/2434251052 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f6c98097380 0x7f6c98127640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:35.488 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.481+0000 7f6c9d5cd640 1 -- 10.20.193.76:0/2434251052 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f6c98097380 msgr2=0x7f6c98127640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:35.488 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.481+0000 7f6c8ffff640 1 -- 10.20.193.76:0/2434251052 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115903548 0 0) 0x7f6c9809b6a0 con 0x7f6c98096fb0 2026-02-25T17:13:35.488 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.481+0000 7f6c9d5cd640 1 --2- 10.20.193.76:0/2434251052 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f6c98097380 0x7f6c98127640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:35.488 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.481+0000 7f6c9d5cd640 1 -- 10.20.193.76:0/2434251052 >> v1:10.20.193.76:6789/0 conn(0x7f6c98096fb0 legacy=0x7f6c98126f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:35.488 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.481+0000 7f6c9d5cd640 1 -- 10.20.193.76:0/2434251052 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9809c9a0 con 0x7f6c98069030 2026-02-25T17:13:35.489 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.481+0000 7f6c9d5cd640 1 --2- 10.20.193.76:0/2434251052 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f6c98069030 0x7f6c98096a70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6c94009940 tx=0x7f6c9402ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9daabeb7f31effe server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:35.489 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.481+0000 7f6c8ffff640 1 -- 10.20.193.76:0/2434251052 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9402f950 con 0x7f6c98069030 2026-02-25T17:13:35.489 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.481+0000 7f6c8ffff640 1 -- 10.20.193.76:0/2434251052 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9402fab0 con 0x7f6c98069030 2026-02-25T17:13:35.489 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.481+0000 7f6c8ffff640 1 -- 10.20.193.76:0/2434251052 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9402fe50 con 0x7f6c98069030 2026-02-25T17:13:35.489 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.482+0000 7f6c9f831640 1 -- 10.20.193.76:0/2434251052 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f6c98069030 msgr2=0x7f6c98096a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:35.489 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.482+0000 7f6c9f831640 1 --2- 10.20.193.76:0/2434251052 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f6c98069030 0x7f6c98096a70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6c94009940 tx=0x7f6c9402ee80 comp rx=0 tx=0).stop 2026-02-25T17:13:35.489 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.482+0000 7f6c9f831640 1 -- 10.20.193.76:0/2434251052 shutdown_connections 2026-02-25T17:13:35.489 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.482+0000 7f6c9f831640 1 --2- 10.20.193.76:0/2434251052 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f6c98097380 0x7f6c98127640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:35.489 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.482+0000 7f6c9f831640 1 --2- 10.20.193.76:0/2434251052 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f6c98069030 0x7f6c98096a70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:35.489 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.482+0000 7f6c9f831640 1 -- 10.20.193.76:0/2434251052 >> 10.20.193.76:0/2434251052 conn(0x7f6c9809db40 msgr2=0x7f6c9809df40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:35.489 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.482+0000 7f6c9f831640 1 -- 10.20.193.76:0/2434251052 shutdown_connections 2026-02-25T17:13:35.489 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.482+0000 7f6c9f831640 1 -- 10.20.193.76:0/2434251052 wait complete. 2026-02-25T17:13:35.490 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.482+0000 7f6c9f831640 1 Processor -- start 2026-02-25T17:13:35.490 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.482+0000 7f6c9f831640 1 -- start start 2026-02-25T17:13:35.490 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.482+0000 7f6c9f831640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f6c98069030 0x7f6c9811d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:35.490 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c9f831640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f6c98096fb0 0x7f6c9811de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:35.490 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c9f831640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f6c98097380 0x7f6c9811e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:35.490 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c9f831640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c98125210 con 0x7f6c98096fb0 2026-02-25T17:13:35.490 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c9f831640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c98126e80 con 0x7f6c98097380 2026-02-25T17:13:35.490 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c9f831640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c98120610 con 0x7f6c98069030 2026-02-25T17:13:35.490 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c9cdcc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f6c98096fb0 0x7f6c9811de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:35.490 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c9ddce640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f6c98097380 0x7f6c9811e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:35.490 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c9d5cd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f6c98069030 0x7f6c9811d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:35.490 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c9ddce640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f6c98097380 0x7f6c9811e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:46386/0 (socket says 10.20.193.76:46386) 2026-02-25T17:13:35.491 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c9ddce640 1 -- 10.20.193.76:0/1871712544 learned_addr learned my addr 10.20.193.76:0/1871712544 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:35.491 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c9ddce640 1 -- 10.20.193.76:0/1871712544 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f6c98069030 msgr2=0x7f6c9811d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:35.491 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c9ddce640 1 --2- 10.20.193.76:0/1871712544 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f6c98069030 0x7f6c9811d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:35.491 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c9ddce640 1 -- 10.20.193.76:0/1871712544 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f6c98096fb0 msgr2=0x7f6c9811de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:35.491 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c9ddce640 1 --2- 10.20.193.76:0/1871712544 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f6c98096fb0 0x7f6c9811de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:35.491 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c9ddce640 1 -- 10.20.193.76:0/1871712544 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c94009450 con 0x7f6c98097380 2026-02-25T17:13:35.491 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c9ddce640 1 --2- 10.20.193.76:0/1871712544 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f6c98097380 0x7f6c9811e340 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009ef0 tx=0x7f6c9000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:35.491 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c8dffb640 1 -- 10.20.193.76:0/1871712544 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9000ce80 con 0x7f6c98097380 2026-02-25T17:13:35.491 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c8dffb640 1 -- 10.20.193.76:0/1871712544 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9000f040 con 0x7f6c98097380 2026-02-25T17:13:35.491 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c9f831640 1 -- 10.20.193.76:0/1871712544 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c98120c30 con 0x7f6c98097380 2026-02-25T17:13:35.491 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c8dffb640 1 -- 10.20.193.76:0/1871712544 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900146d0 con 0x7f6c98097380 2026-02-25T17:13:35.491 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c9f831640 1 -- 10.20.193.76:0/1871712544 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9811e880 con 0x7f6c98097380 2026-02-25T17:13:35.491 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c8dffb640 1 -- 10.20.193.76:0/1871712544 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 2) v1 ==== 29536+0+0 (secure 0 0 0) 0x7f6c90014a80 con 0x7f6c98097380 2026-02-25T17:13:35.492 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c8dffb640 1 -- 10.20.193.76:0/1871712544 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f6c90037600 con 0x7f6c98097380 2026-02-25T17:13:35.492 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.483+0000 7f6c9f831640 1 -- 10.20.193.76:0/1871712544 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c98120bd0 con 0x7f6c98097380 2026-02-25T17:13:35.492 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.484+0000 7f6c8dffb640 1 -- 10.20.193.76:0/1871712544 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7f6c90018070 con 0x7f6c98097380 2026-02-25T17:13:35.496 INFO:tasks.ceph.osd.3.trial076.stderr:2026-02-25T17:13:35.493+0000 7f46c8e14440 -1 Falling back to public interface 2026-02-25T17:13:35.497 INFO:tasks.ceph.osd.0.trial076.stderr:2026-02-25T17:13:35.494+0000 7f0ac2fcd440 -1 Falling back to public interface 2026-02-25T17:13:35.497 INFO:tasks.ceph.osd.1.trial076.stderr:2026-02-25T17:13:35.494+0000 7fab49c0c440 -1 Falling back to public interface 2026-02-25T17:13:35.497 INFO:tasks.ceph.osd.0.trial076.stderr:2026-02-25T17:13:35.494+0000 7f0ac11fd640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6805/0: (98) Address already in use 2026-02-25T17:13:35.499 INFO:tasks.ceph.osd.2.trial076.stderr:2026-02-25T17:13:35.497+0000 7f22af20c440 -1 Falling back to public interface 2026-02-25T17:13:35.514 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.511+0000 7f6c9f831640 1 -- 10.20.193.76:0/1871712544 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c9805f010 con 0x7f6c98097380 2026-02-25T17:13:35.514 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.512+0000 7f6c8dffb640 1 -- 10.20.193.76:0/1871712544 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4108 (secure 0 0 0) 0x7f6c9002b090 con 0x7f6c98097380 2026-02-25T17:13:35.515 INFO:teuthology.misc.health.trial076.stdout: 2026-02-25T17:13:35.515 INFO:teuthology.misc.health.trial076.stdout:{"epoch":6,"fsid":"0648ee30-4e19-4268-91ad-07b0e65a8518","created":"2026-02-25T17:13:33.780133+0000","modified":"2026-02-25T17:13:34.859194+0000","last_up_change":"0.000000","last_in_change":"2026-02-25T17:13:34.859194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"85909bd3-2540-48a9-a649-33709fa74613","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f0a0a51c-d629-464e-bc04-dacbaaf78efa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9633000b-764d-457a-b560-539dc5830e9e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fc098e34-48a8-4414-ad41-60abdf7388a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T17:13:35.516 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.512+0000 7f6c9f831640 1 -- 10.20.193.76:0/1871712544 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f6c98097380 msgr2=0x7f6c9811e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:35.516 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.512+0000 7f6c9f831640 1 --2- 10.20.193.76:0/1871712544 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f6c98097380 0x7f6c9811e340 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009ef0 tx=0x7f6c9000b040 comp rx=0 tx=0).stop 2026-02-25T17:13:35.516 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.512+0000 7f6c9f831640 1 -- 10.20.193.76:0/1871712544 shutdown_connections 2026-02-25T17:13:35.516 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.512+0000 7f6c9f831640 1 --2- 10.20.193.76:0/1871712544 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f6c98097380 0x7f6c9811e340 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:35.516 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.512+0000 7f6c9f831640 1 --2- 10.20.193.76:0/1871712544 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f6c98096fb0 0x7f6c9811de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:35.516 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.512+0000 7f6c9f831640 1 --2- 10.20.193.76:0/1871712544 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f6c98069030 0x7f6c9811d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:35.516 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.512+0000 7f6c9f831640 1 -- 10.20.193.76:0/1871712544 >> 10.20.193.76:0/1871712544 conn(0x7f6c9809db40 msgr2=0x7f6c98126540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:35.517 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.512+0000 7f6c9f831640 1 -- 10.20.193.76:0/1871712544 shutdown_connections 2026-02-25T17:13:35.517 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:35.512+0000 7f6c9f831640 1 -- 10.20.193.76:0/1871712544 wait complete. 2026-02-25T17:13:35.521 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-25T17:13:35.808 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:35.806+0000 7f2806c89640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-25T17:13:35.809 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:13:35.806+0000 7f2806c89640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-25T17:13:38.954 INFO:tasks.ceph.osd.3.trial076.stderr:2026-02-25T17:13:38.952+0000 7f46c8e14440 -1 osd.3 0 log_to_monitors true 2026-02-25T17:13:38.976 INFO:tasks.ceph.osd.2.trial076.stderr:2026-02-25T17:13:38.973+0000 7f22af20c440 -1 osd.2 0 log_to_monitors true 2026-02-25T17:13:38.986 INFO:tasks.ceph.osd.1.trial076.stderr:2026-02-25T17:13:38.983+0000 7fab49c0c440 -1 osd.1 0 log_to_monitors true 2026-02-25T17:13:38.996 INFO:tasks.ceph.osd.0.trial076.stderr:2026-02-25T17:13:38.994+0000 7f0ac2fcd440 -1 osd.0 0 log_to_monitors true 2026-02-25T17:13:40.011 INFO:tasks.ceph.osd.3.trial076.stderr:2026-02-25T17:13:40.008+0000 7f46c35f6640 -1 osd.3 0 waiting for initial osdmap 2026-02-25T17:13:40.011 INFO:tasks.ceph.osd.1.trial076.stderr:2026-02-25T17:13:40.008+0000 7fab443f6640 -1 osd.1 0 waiting for initial osdmap 2026-02-25T17:13:40.012 INFO:tasks.ceph.osd.2.trial076.stderr:2026-02-25T17:13:40.008+0000 7f22a99f6640 -1 osd.2 0 waiting for initial osdmap 2026-02-25T17:13:40.012 INFO:tasks.ceph.osd.0.trial076.stderr:2026-02-25T17:13:40.008+0000 7f0abd9f6640 -1 osd.0 0 waiting for initial osdmap 2026-02-25T17:13:40.013 INFO:tasks.ceph.osd.0.trial076.stderr:2026-02-25T17:13:40.010+0000 7f0ab69e8640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T17:13:40.013 INFO:tasks.ceph.osd.3.trial076.stderr:2026-02-25T17:13:40.010+0000 7f46bc485640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T17:13:40.013 INFO:tasks.ceph.osd.1.trial076.stderr:2026-02-25T17:13:40.011+0000 7fab3d285640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T17:13:40.014 INFO:tasks.ceph.osd.2.trial076.stderr:2026-02-25T17:13:40.011+0000 7f22a29e8640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T17:13:41.924 DEBUG:teuthology.orchestra.run.trial076:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-25T17:13:41.988 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.981+0000 7fb204e6d640 1 Processor -- start 2026-02-25T17:13:41.988 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.981+0000 7fb204e6d640 1 -- start start 2026-02-25T17:13:41.988 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.981+0000 7fb204e6d640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb200095870 0x7fb20012d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:41.988 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.981+0000 7fb204e6d640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb20012da70 0x7fb20012fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:41.988 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.981+0000 7fb204e6d640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2000936b0 con 0x7fb200094d90 2026-02-25T17:13:41.988 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.981+0000 7fb204e6d640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20008ff00 con 0x7fb20012da70 2026-02-25T17:13:41.988 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.981+0000 7fb204e6d640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb200090fc0 con 0x7fb200095870 2026-02-25T17:13:41.989 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.981+0000 7fb1fe59c640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7fb200094d90 0x7fb200095160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:44524/0 (socket says 10.20.193.76:44524) 2026-02-25T17:13:41.989 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.981+0000 7fb1fe59c640 1 -- 10.20.193.76:0/3695496816 learned_addr learned my addr 10.20.193.76:0/3695496816 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:13:41.989 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.981+0000 7fb1fdd9b640 1 --2- 10.20.193.76:0/3695496816 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb200095870 0x7fb20012d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:41.989 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.981+0000 7fb1fed9d640 1 --2- 10.20.193.76:0/3695496816 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb20012da70 0x7fb20012fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:41.989 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.981+0000 7fb1fd59a640 1 -- 10.20.193.76:0/3695496816 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391855667 0 0) 0x7fb2000936b0 con 0x7fb200094d90 2026-02-25T17:13:41.989 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.981+0000 7fb1fd59a640 1 -- 10.20.193.76:0/3695496816 --> v1:10.20.193.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1e80034e0 con 0x7fb200094d90 2026-02-25T17:13:41.989 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.981+0000 7fb1fdd9b640 1 -- 10.20.193.76:0/3695496816 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb20012da70 msgr2=0x7fb20012fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:41.989 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.981+0000 7fb1fdd9b640 1 --2- 10.20.193.76:0/3695496816 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb20012da70 0x7fb20012fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:41.989 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.981+0000 7fb1fdd9b640 1 -- 10.20.193.76:0/3695496816 >> v1:10.20.193.76:6789/0 conn(0x7fb200094d90 legacy=0x7fb200095160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:41.989 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.981+0000 7fb1fdd9b640 1 -- 10.20.193.76:0/3695496816 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20008fc70 con 0x7fb200095870 2026-02-25T17:13:41.989 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.982+0000 7fb1fdd9b640 1 --2- 10.20.193.76:0/3695496816 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb200095870 0x7fb20012d530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009880 tx=0x7fb1f402ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3898845667cf41db server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:41.989 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.982+0000 7fb1fd59a640 1 -- 10.20.193.76:0/3695496816 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f402f890 con 0x7fb200095870 2026-02-25T17:13:41.990 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.982+0000 7fb1fd59a640 1 -- 10.20.193.76:0/3695496816 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f402f9f0 con 0x7fb200095870 2026-02-25T17:13:41.990 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.982+0000 7fb1fd59a640 1 -- 10.20.193.76:0/3695496816 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f402fd90 con 0x7fb200095870 2026-02-25T17:13:41.990 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.982+0000 7fb204e6d640 1 -- 10.20.193.76:0/3695496816 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb200095870 msgr2=0x7fb20012d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:41.990 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.982+0000 7fb204e6d640 1 --2- 10.20.193.76:0/3695496816 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb200095870 0x7fb20012d530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009880 tx=0x7fb1f402ed80 comp rx=0 tx=0).stop 2026-02-25T17:13:41.990 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.982+0000 7fb204e6d640 1 -- 10.20.193.76:0/3695496816 shutdown_connections 2026-02-25T17:13:41.990 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.982+0000 7fb204e6d640 1 --2- 10.20.193.76:0/3695496816 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb20012da70 0x7fb20012fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:41.990 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.982+0000 7fb204e6d640 1 --2- 10.20.193.76:0/3695496816 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb200095870 0x7fb20012d530 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:41.990 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.982+0000 7fb204e6d640 1 -- 10.20.193.76:0/3695496816 >> 10.20.193.76:0/3695496816 conn(0x7fb200095e80 msgr2=0x7fb200096280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:41.990 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.982+0000 7fb204e6d640 1 -- 10.20.193.76:0/3695496816 shutdown_connections 2026-02-25T17:13:41.990 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.982+0000 7fb204e6d640 1 -- 10.20.193.76:0/3695496816 wait complete. 2026-02-25T17:13:41.990 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.983+0000 7fb204e6d640 1 Processor -- start 2026-02-25T17:13:41.990 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.983+0000 7fb204e6d640 1 -- start start 2026-02-25T17:13:41.990 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.983+0000 7fb204e6d640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb200094d90 0x7fb20012d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:41.991 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.983+0000 7fb204e6d640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb200095870 0x7fb20006e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:41.991 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.983+0000 7fb204e6d640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb20012da70 0x7fb20006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:41.991 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.983+0000 7fb204e6d640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb200120610 con 0x7fb200095870 2026-02-25T17:13:41.991 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.983+0000 7fb204e6d640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb200120180 con 0x7fb200094d90 2026-02-25T17:13:41.991 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.983+0000 7fb204e6d640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb20011f9a0 con 0x7fb20012da70 2026-02-25T17:13:41.991 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.983+0000 7fb1fe59c640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb200094d90 0x7fb20012d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:41.991 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.983+0000 7fb1fe59c640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb200094d90 0x7fb20012d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:46868/0 (socket says 10.20.193.76:46868) 2026-02-25T17:13:41.991 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.983+0000 7fb1fed9d640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb20012da70 0x7fb20006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:41.991 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.983+0000 7fb1fdd9b640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb200095870 0x7fb20006e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:41.991 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.983+0000 7fb1fe59c640 1 -- 10.20.193.76:0/75510179 learned_addr learned my addr 10.20.193.76:0/75510179 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:41.991 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.983+0000 7fb1fed9d640 1 -- 10.20.193.76:0/75510179 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb200094d90 msgr2=0x7fb20012d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:41.992 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.983+0000 7fb1fed9d640 1 --2- 10.20.193.76:0/75510179 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb200094d90 0x7fb20012d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:41.992 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.983+0000 7fb1fed9d640 1 -- 10.20.193.76:0/75510179 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb200095870 msgr2=0x7fb20006e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:41.992 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.983+0000 7fb1fed9d640 1 --2- 10.20.193.76:0/75510179 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb200095870 0x7fb20006e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:41.992 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.983+0000 7fb1fed9d640 1 -- 10.20.193.76:0/75510179 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f4009390 con 0x7fb20012da70 2026-02-25T17:13:41.992 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.983+0000 7fb1fe59c640 1 --2- 10.20.193.76:0/75510179 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb200094d90 0x7fb20012d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:41.992 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.983+0000 7fb1fed9d640 1 --2- 10.20.193.76:0/75510179 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb20012da70 0x7fb20006e7c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8009e20 tx=0x7fb1f800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:41.992 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.984+0000 7fb1eeffd640 1 -- 10.20.193.76:0/75510179 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f800ce20 con 0x7fb20012da70 2026-02-25T17:13:41.992 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.984+0000 7fb1eeffd640 1 -- 10.20.193.76:0/75510179 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f800f040 con 0x7fb20012da70 2026-02-25T17:13:41.992 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.984+0000 7fb204e6d640 1 -- 10.20.193.76:0/75510179 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20011f180 con 0x7fb20012da70 2026-02-25T17:13:41.992 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.984+0000 7fb1eeffd640 1 -- 10.20.193.76:0/75510179 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f80146d0 con 0x7fb20012da70 2026-02-25T17:13:41.992 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.984+0000 7fb204e6d640 1 -- 10.20.193.76:0/75510179 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20006ef70 con 0x7fb20012da70 2026-02-25T17:13:41.992 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.984+0000 7fb204e6d640 1 -- 10.20.193.76:0/75510179 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20011e880 con 0x7fb20012da70 2026-02-25T17:13:41.992 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.984+0000 7fb1eeffd640 1 -- 10.20.193.76:0/75510179 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 4) v1 ==== 59153+0+0 (secure 0 0 0) 0x7fb1f8014a40 con 0x7fb20012da70 2026-02-25T17:13:41.993 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.984+0000 7fb1eeffd640 1 -- 10.20.193.76:0/75510179 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2067+0+0 (secure 0 0 0) 0x7fb1f8064410 con 0x7fb20012da70 2026-02-25T17:13:41.993 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:41.987+0000 7fb1eeffd640 1 -- 10.20.193.76:0/75510179 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7fb1f803f580 con 0x7fb20012da70 2026-02-25T17:13:42.052 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:42.050+0000 7fb204e6d640 1 -- 10.20.193.76:0/75510179 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb20005f010 con 0x7fb20012da70 2026-02-25T17:13:42.053 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:42.050+0000 7fb1eeffd640 1 -- 10.20.193.76:0/75510179 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+4903 (secure 0 0 0) 0x7fb1f8018030 con 0x7fb20012da70 2026-02-25T17:13:42.053 INFO:teuthology.misc.health.trial076.stdout: 2026-02-25T17:13:42.053 INFO:teuthology.misc.health.trial076.stdout:{"epoch":9,"fsid":"0648ee30-4e19-4268-91ad-07b0e65a8518","created":"2026-02-25T17:13:33.780133+0000","modified":"2026-02-25T17:13:41.008215+0000","last_up_change":"2026-02-25T17:13:41.008215+0000","last_in_change":"2026-02-25T17:13:34.859194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"85909bd3-2540-48a9-a649-33709fa74613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6806","nonce":43127}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6808","nonce":43127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6812","nonce":43127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6810","nonce":43127}]},"public_addr":"10.20.193.76:6806/43127","cluster_addr":"10.20.193.76:6808/43127","heartbeat_back_addr":"10.20.193.76:6812/43127","heartbeat_front_addr":"10.20.193.76:6810/43127","state":["exists","up"]},{"osd":1,"uuid":"f0a0a51c-d629-464e-bc04-dacbaaf78efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6805","nonce":43126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6807","nonce":43126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6811","nonce":43126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6809","nonce":43126}]},"public_addr":"10.20.193.76:6805/43126","cluster_addr":"10.20.193.76:6807/43126","heartbeat_back_addr":"10.20.193.76:6811/43126","heartbeat_front_addr":"10.20.193.76:6809/43126","state":["exists","up"]},{"osd":2,"uuid":"9633000b-764d-457a-b560-539dc5830e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6813","nonce":43128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6814","nonce":43128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6816","nonce":43128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6815","nonce":43128}]},"public_addr":"10.20.193.76:6813/43128","cluster_addr":"10.20.193.76:6814/43128","heartbeat_back_addr":"10.20.193.76:6816/43128","heartbeat_front_addr":"10.20.193.76:6815/43128","state":["exists","up"]},{"osd":3,"uuid":"fc098e34-48a8-4414-ad41-60abdf7388a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6801","nonce":43129}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6802","nonce":43129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6804","nonce":43129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6803","nonce":43129}]},"public_addr":"10.20.193.76:6801/43129","cluster_addr":"10.20.193.76:6802/43129","heartbeat_back_addr":"10.20.193.76:6804/43129","heartbeat_front_addr":"10.20.193.76:6803/43129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T17:13:42.054 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:42.051+0000 7fb204e6d640 1 -- 10.20.193.76:0/75510179 >> v1:10.20.193.76:6800/42442 conn(0x7fb1e004d040 legacy=0x7fb1e004f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:42.054 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:42.051+0000 7fb204e6d640 1 -- 10.20.193.76:0/75510179 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb20012da70 msgr2=0x7fb20006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:42.054 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:42.051+0000 7fb204e6d640 1 --2- 10.20.193.76:0/75510179 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb20012da70 0x7fb20006e7c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8009e20 tx=0x7fb1f800b040 comp rx=0 tx=0).stop 2026-02-25T17:13:42.054 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:42.051+0000 7fb204e6d640 1 -- 10.20.193.76:0/75510179 shutdown_connections 2026-02-25T17:13:42.055 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:42.051+0000 7fb204e6d640 1 --2- 10.20.193.76:0/75510179 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb20012da70 0x7fb20006e7c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:42.055 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:42.051+0000 7fb204e6d640 1 --2- 10.20.193.76:0/75510179 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb200095870 0x7fb20006e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:42.055 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:42.051+0000 7fb204e6d640 1 --2- 10.20.193.76:0/75510179 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb200094d90 0x7fb20012d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:42.055 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:42.051+0000 7fb204e6d640 1 -- 10.20.193.76:0/75510179 >> 10.20.193.76:0/75510179 conn(0x7fb200095e80 msgr2=0x7fb200098b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:42.055 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:42.051+0000 7fb204e6d640 1 -- 10.20.193.76:0/75510179 shutdown_connections 2026-02-25T17:13:42.055 INFO:teuthology.misc.health.trial076.stderr:2026-02-25T17:13:42.051+0000 7fb204e6d640 1 -- 10.20.193.76:0/75510179 wait complete. 2026-02-25T17:13:42.060 DEBUG:teuthology.misc:4 of 4 OSDs are up 2026-02-25T17:13:42.060 INFO:tasks.ceph:Creating RBD pool 2026-02-25T17:13:42.061 DEBUG:teuthology.orchestra.run.trial076:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-25T17:13:42.124 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.119+0000 7fb07c1d4640 1 Processor -- start 2026-02-25T17:13:42.124 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.119+0000 7fb07c1d4640 1 -- start start 2026-02-25T17:13:42.124 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.120+0000 7fb07c1d4640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fb0741280b0 0x7fb074128480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:42.124 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.120+0000 7fb07c1d4640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb07406b530 0x7fb0741300c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:42.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.120+0000 7fb07c1d4640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0741100f0 con 0x7fb0741289c0 2026-02-25T17:13:42.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.120+0000 7fb07c1d4640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb074127e90 con 0x7fb0741280b0 2026-02-25T17:13:42.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.120+0000 7fb07c1d4640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb07406ead0 con 0x7fb07406b530 2026-02-25T17:13:42.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.120+0000 7fb079f70640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fb0741280b0 0x7fb074128480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:42.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.120+0000 7fb07976f640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7fb0741289c0 0x7fb07406ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:44534/0 (socket says 10.20.193.76:44534) 2026-02-25T17:13:42.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.120+0000 7fb07976f640 1 -- 10.20.193.76:0/982065824 learned_addr learned my addr 10.20.193.76:0/982065824 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:13:42.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.120+0000 7fb07a771640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb07406b530 0x7fb0741300c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:42.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.120+0000 7fb079f70640 1 -- 10.20.193.76:0/982065824 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb07406b530 msgr2=0x7fb0741300c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:42.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.120+0000 7fb079f70640 1 --2- 10.20.193.76:0/982065824 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb07406b530 0x7fb0741300c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:42.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.120+0000 7fb079f70640 1 -- 10.20.193.76:0/982065824 >> v1:10.20.193.76:6789/0 conn(0x7fb0741289c0 legacy=0x7fb07406ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:42.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.120+0000 7fb078f6e640 1 -- 10.20.193.76:0/982065824 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891261568 0 0) 0x7fb0741100f0 con 0x7fb0741289c0 2026-02-25T17:13:42.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.120+0000 7fb079f70640 1 -- 10.20.193.76:0/982065824 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb074110310 con 0x7fb0741280b0 2026-02-25T17:13:42.126 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.120+0000 7fb079f70640 1 --2- 10.20.193.76:0/982065824 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb0741280b0 0x7fb074128480 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb070009850 tx=0x7fb07002ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc12799871b5acb server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:42.126 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.120+0000 7fb078f6e640 1 -- 10.20.193.76:0/982065824 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07002f8b0 con 0x7fb0741280b0 2026-02-25T17:13:42.126 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.120+0000 7fb078f6e640 1 -- 10.20.193.76:0/982065824 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07002fa10 con 0x7fb0741280b0 2026-02-25T17:13:42.126 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.120+0000 7fb078f6e640 1 -- 10.20.193.76:0/982065824 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07002fdb0 con 0x7fb0741280b0 2026-02-25T17:13:42.126 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.121+0000 7fb07c1d4640 1 -- 10.20.193.76:0/982065824 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb0741280b0 msgr2=0x7fb074128480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:42.126 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.121+0000 7fb07c1d4640 1 --2- 10.20.193.76:0/982065824 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb0741280b0 0x7fb074128480 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb070009850 tx=0x7fb07002ed50 comp rx=0 tx=0).stop 2026-02-25T17:13:42.126 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.121+0000 7fb07c1d4640 1 -- 10.20.193.76:0/982065824 shutdown_connections 2026-02-25T17:13:42.126 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.121+0000 7fb07c1d4640 1 --2- 10.20.193.76:0/982065824 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb07406b530 0x7fb0741300c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:42.126 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.121+0000 7fb07c1d4640 1 --2- 10.20.193.76:0/982065824 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb0741280b0 0x7fb074128480 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:42.126 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.121+0000 7fb07c1d4640 1 -- 10.20.193.76:0/982065824 >> 10.20.193.76:0/982065824 conn(0x7fb074099420 msgr2=0x7fb074099820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:42.126 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.121+0000 7fb07c1d4640 1 -- 10.20.193.76:0/982065824 shutdown_connections 2026-02-25T17:13:42.126 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.121+0000 7fb07c1d4640 1 -- 10.20.193.76:0/982065824 wait complete. 2026-02-25T17:13:42.127 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.121+0000 7fb07c1d4640 1 Processor -- start 2026-02-25T17:13:42.127 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb07c1d4640 1 -- start start 2026-02-25T17:13:42.129 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb07c1d4640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb07406b530 0x7fb074115350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:42.129 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb07c1d4640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb0741280b0 0x7fb074115890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:42.129 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb07c1d4640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb0741289c0 0x7fb074115dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:42.129 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb07c1d4640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb074117ac0 con 0x7fb07406b530 2026-02-25T17:13:42.129 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb07c1d4640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb074118080 con 0x7fb0741289c0 2026-02-25T17:13:42.129 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb07c1d4640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb07406c800 con 0x7fb0741280b0 2026-02-25T17:13:42.130 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb079f70640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb07406b530 0x7fb074115350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:42.130 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb07976f640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb0741280b0 0x7fb074115890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:42.130 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb079f70640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb07406b530 0x7fb074115350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:58078/0 (socket says 10.20.193.76:58078) 2026-02-25T17:13:42.130 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb079f70640 1 -- 10.20.193.76:0/3970783494 learned_addr learned my addr 10.20.193.76:0/3970783494 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:42.130 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb07a771640 1 --2- 10.20.193.76:0/3970783494 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb0741289c0 0x7fb074115dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:42.130 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb079f70640 1 -- 10.20.193.76:0/3970783494 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb0741280b0 msgr2=0x7fb074115890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:42.130 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb079f70640 1 --2- 10.20.193.76:0/3970783494 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb0741280b0 0x7fb074115890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:42.130 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb079f70640 1 -- 10.20.193.76:0/3970783494 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb0741289c0 msgr2=0x7fb074115dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:42.130 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb079f70640 1 --2- 10.20.193.76:0/3970783494 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb0741289c0 0x7fb074115dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:42.130 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb079f70640 1 -- 10.20.193.76:0/3970783494 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb070009390 con 0x7fb07406b530 2026-02-25T17:13:42.130 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb079f70640 1 --2- 10.20.193.76:0/3970783494 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb07406b530 0x7fb074115350 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb070009850 tx=0x7fb070037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:42.130 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb06a7fc640 1 -- 10.20.193.76:0/3970783494 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb070037e60 con 0x7fb07406b530 2026-02-25T17:13:42.131 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb06a7fc640 1 -- 10.20.193.76:0/3970783494 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb070041400 con 0x7fb07406b530 2026-02-25T17:13:42.131 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb07c1d4640 1 -- 10.20.193.76:0/3970783494 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb074118310 con 0x7fb07406b530 2026-02-25T17:13:42.131 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb06a7fc640 1 -- 10.20.193.76:0/3970783494 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb070041780 con 0x7fb07406b530 2026-02-25T17:13:42.131 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.122+0000 7fb07c1d4640 1 -- 10.20.193.76:0/3970783494 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07411dfc0 con 0x7fb07406b530 2026-02-25T17:13:42.131 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.123+0000 7fb06a7fc640 1 -- 10.20.193.76:0/3970783494 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 4) v1 ==== 59153+0+0 (secure 0 0 0) 0x7fb070041af0 con 0x7fb07406b530 2026-02-25T17:13:42.131 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.123+0000 7fb06a7fc640 1 -- 10.20.193.76:0/3970783494 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2067+0+0 (secure 0 0 0) 0x7fb070088700 con 0x7fb07406b530 2026-02-25T17:13:42.131 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.123+0000 7fb07c1d4640 1 -- 10.20.193.76:0/3970783494 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb074064c00 con 0x7fb07406b530 2026-02-25T17:13:42.131 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.125+0000 7fb06a7fc640 1 -- 10.20.193.76:0/3970783494 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7fb07003c070 con 0x7fb07406b530 2026-02-25T17:13:42.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:42.187+0000 7fb07c1d4640 1 -- 10.20.193.76:0/3970783494 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fb074120b20 con 0x7fb07406b530 2026-02-25T17:13:43.018 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.015+0000 7fb06a7fc640 1 -- 10.20.193.76:0/3970783494 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v10) v1 ==== 109+0+0 (secure 0 0 0) 0x7fb070063a20 con 0x7fb07406b530 2026-02-25T17:13:43.018 INFO:teuthology.orchestra.run.trial076.stderr:pool 'rbd' created 2026-02-25T17:13:43.020 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.017+0000 7fb07c1d4640 1 -- 10.20.193.76:0/3970783494 >> v1:10.20.193.76:6800/42442 conn(0x7fb05804d040 legacy=0x7fb05804f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:43.020 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.017+0000 7fb07c1d4640 1 -- 10.20.193.76:0/3970783494 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb07406b530 msgr2=0x7fb074115350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:43.020 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.017+0000 7fb07c1d4640 1 --2- 10.20.193.76:0/3970783494 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb07406b530 0x7fb074115350 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb070009850 tx=0x7fb070037000 comp rx=0 tx=0).stop 2026-02-25T17:13:43.020 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.017+0000 7fb07c1d4640 1 -- 10.20.193.76:0/3970783494 shutdown_connections 2026-02-25T17:13:43.020 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.017+0000 7fb07c1d4640 1 --2- 10.20.193.76:0/3970783494 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb0741289c0 0x7fb074115dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:43.020 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.017+0000 7fb07c1d4640 1 --2- 10.20.193.76:0/3970783494 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb0741280b0 0x7fb074115890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:43.020 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.017+0000 7fb07c1d4640 1 --2- 10.20.193.76:0/3970783494 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb07406b530 0x7fb074115350 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:43.020 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.017+0000 7fb07c1d4640 1 -- 10.20.193.76:0/3970783494 >> 10.20.193.76:0/3970783494 conn(0x7fb074099420 msgr2=0x7fb07411e690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:43.020 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.017+0000 7fb07c1d4640 1 -- 10.20.193.76:0/3970783494 shutdown_connections 2026-02-25T17:13:43.020 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.017+0000 7fb07c1d4640 1 -- 10.20.193.76:0/3970783494 wait complete. 2026-02-25T17:13:43.027 DEBUG:teuthology.orchestra.run.trial076:> rbd --cluster ceph pool init rbd 2026-02-25T17:13:43.054 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.050+0000 7f589e630b80 1 Processor -- start 2026-02-25T17:13:43.054 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.050+0000 7f589e630b80 1 -- start start 2026-02-25T17:13:43.054 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.051+0000 7f589e630b80 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x55b2c0d9aa10 0x55b2c0d9ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:43.055 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.051+0000 7f589e630b80 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x55b2c0d9b320 0x55b2c0d99610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:43.055 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.051+0000 7f589e630b80 1 --2- >> v2:10.20.193.76:3300/0 conn(0x55b2c0d99b50 0x55b2c0d99fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:43.055 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.051+0000 7f589e630b80 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b2c0c7eb30 con 0x55b2c0d99b50 2026-02-25T17:13:43.055 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.051+0000 7f589e630b80 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2c0c7c100 con 0x55b2c0d9aa10 2026-02-25T17:13:43.055 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.051+0000 7f589e630b80 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x55b2c0c77de0 con 0x55b2c0d9b320 2026-02-25T17:13:43.055 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.051+0000 7f589c4af640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x55b2c0d9aa10 0x55b2c0d9ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:43.055 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.051+0000 7f5893fff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x55b2c0d9b320 0x55b2c0d99610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:43.055 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.051+0000 7f589d711640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x55b2c0d99b50 0x55b2c0d99fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:43.055 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.051+0000 7f589c4af640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x55b2c0d9aa10 0x55b2c0d9ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:46888/0 (socket says 10.20.193.76:46888) 2026-02-25T17:13:43.055 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.051+0000 7f589c4af640 1 -- 10.20.193.76:0/3517519727 learned_addr learned my addr 10.20.193.76:0/3517519727 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:43.055 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.051+0000 7f589c4af640 1 -- 10.20.193.76:0/3517519727 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x55b2c0d9b320 msgr2=0x55b2c0d99610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:43.055 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.051+0000 7f589c4af640 1 --2- 10.20.193.76:0/3517519727 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x55b2c0d9b320 0x55b2c0d99610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:43.056 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.051+0000 7f589c4af640 1 -- 10.20.193.76:0/3517519727 >> v2:10.20.193.76:3300/0 conn(0x55b2c0d99b50 msgr2=0x55b2c0d99fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:43.056 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.051+0000 7f589c4af640 1 --2- 10.20.193.76:0/3517519727 >> v2:10.20.193.76:3300/0 conn(0x55b2c0d99b50 0x55b2c0d99fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:43.056 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.051+0000 7f589c4af640 1 -- 10.20.193.76:0/3517519727 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2c0c434d0 con 0x55b2c0d9aa10 2026-02-25T17:13:43.056 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.051+0000 7f589d711640 1 --2- 10.20.193.76:0/3517519727 >> v2:10.20.193.76:3300/0 conn(0x55b2c0d99b50 0x55b2c0d99fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:43.059 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.052+0000 7f589c4af640 1 --2- 10.20.193.76:0/3517519727 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x55b2c0d9aa10 0x55b2c0d9ade0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f588c00a6d0 tx=0x7f588c058950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f1d544b609f5eab server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:43.059 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.052+0000 7f589bcae640 1 -- 10.20.193.76:0/3517519727 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c068440 con 0x55b2c0d9aa10 2026-02-25T17:13:43.059 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.052+0000 7f589bcae640 1 -- 10.20.193.76:0/3517519727 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c0685a0 con 0x55b2c0d9aa10 2026-02-25T17:13:43.060 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.052+0000 7f589bcae640 1 -- 10.20.193.76:0/3517519727 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c068730 con 0x55b2c0d9aa10 2026-02-25T17:13:43.060 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.052+0000 7f589e630b80 1 -- 10.20.193.76:0/3517519727 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x55b2c0d9aa10 msgr2=0x55b2c0d9ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:43.060 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.052+0000 7f589e630b80 1 --2- 10.20.193.76:0/3517519727 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x55b2c0d9aa10 0x55b2c0d9ade0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f588c00a6d0 tx=0x7f588c058950 comp rx=0 tx=0).stop 2026-02-25T17:13:43.060 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.052+0000 7f589e630b80 1 -- 10.20.193.76:0/3517519727 shutdown_connections 2026-02-25T17:13:43.060 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.052+0000 7f589e630b80 1 --2- 10.20.193.76:0/3517519727 >> v2:10.20.193.76:3300/0 conn(0x55b2c0d99b50 0x55b2c0d99fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:43.060 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.052+0000 7f589e630b80 1 --2- 10.20.193.76:0/3517519727 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x55b2c0d9b320 0x55b2c0d99610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:43.060 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.052+0000 7f589e630b80 1 --2- 10.20.193.76:0/3517519727 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x55b2c0d9aa10 0x55b2c0d9ade0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:43.060 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.052+0000 7f589e630b80 1 -- 10.20.193.76:0/3517519727 >> 10.20.193.76:0/3517519727 conn(0x55b2c0da6980 msgr2=0x55b2c0da6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:43.060 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.052+0000 7f589e630b80 1 -- 10.20.193.76:0/3517519727 shutdown_connections 2026-02-25T17:13:43.060 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.052+0000 7f589e630b80 1 -- 10.20.193.76:0/3517519727 wait complete. 2026-02-25T17:13:43.060 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f589e630b80 1 Processor -- start 2026-02-25T17:13:43.061 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f589e630b80 1 -- start start 2026-02-25T17:13:43.061 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f589e630b80 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x55b2c0d99b50 0x55b2c0d95c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:43.061 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f589e630b80 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x55b2c0d9aa10 0x55b2c0d961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:43.061 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f589e630b80 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x55b2c0d9b320 0x55b2c0e420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:43.061 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f589e630b80 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2c0c1d120 con 0x55b2c0d9aa10 2026-02-25T17:13:43.061 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f589e630b80 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2c0c1cdc0 con 0x55b2c0d99b50 2026-02-25T17:13:43.061 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f589e630b80 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x55b2c0bfd110 con 0x55b2c0d9b320 2026-02-25T17:13:43.061 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f589c4af640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x55b2c0d99b50 0x55b2c0d95c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:43.061 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f589c4af640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x55b2c0d99b50 0x55b2c0d95c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:46904/0 (socket says 10.20.193.76:46904) 2026-02-25T17:13:43.061 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f589c4af640 1 -- 10.20.193.76:0/2295114147 learned_addr learned my addr 10.20.193.76:0/2295114147 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:43.061 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f5893fff640 1 --2- 10.20.193.76:0/2295114147 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x55b2c0d9aa10 0x55b2c0d961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:43.061 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f589d711640 1 --2- 10.20.193.76:0/2295114147 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x55b2c0d9b320 0x55b2c0e420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:43.061 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f589c4af640 1 -- 10.20.193.76:0/2295114147 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x55b2c0d9b320 msgr2=0x55b2c0e420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:43.062 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f589c4af640 1 --2- 10.20.193.76:0/2295114147 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x55b2c0d9b320 0x55b2c0e420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:43.062 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f589c4af640 1 -- 10.20.193.76:0/2295114147 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x55b2c0d9aa10 msgr2=0x55b2c0d961b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:43.062 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f589c4af640 1 --2- 10.20.193.76:0/2295114147 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x55b2c0d9aa10 0x55b2c0d961b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:43.062 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f589c4af640 1 -- 10.20.193.76:0/2295114147 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589400a0e0 con 0x55b2c0d99b50 2026-02-25T17:13:43.062 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f589c4af640 1 --2- 10.20.193.76:0/2295114147 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x55b2c0d99b50 0x55b2c0d95c70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f588c027b30 tx=0x7f588c06b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:43.062 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f58994a9640 1 -- 10.20.193.76:0/2295114147 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c068710 con 0x55b2c0d99b50 2026-02-25T17:13:43.062 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.053+0000 7f58994a9640 1 -- 10.20.193.76:0/2295114147 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c073630 con 0x55b2c0d99b50 2026-02-25T17:13:43.062 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.054+0000 7f589e630b80 1 -- 10.20.193.76:0/2295114147 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588c005db0 con 0x55b2c0d99b50 2026-02-25T17:13:43.062 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.054+0000 7f58994a9640 1 -- 10.20.193.76:0/2295114147 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c0739d0 con 0x55b2c0d99b50 2026-02-25T17:13:43.062 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.054+0000 7f589e630b80 1 -- 10.20.193.76:0/2295114147 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b2c0c1bc50 con 0x55b2c0d99b50 2026-02-25T17:13:43.062 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.054+0000 7f58994a9640 1 -- 10.20.193.76:0/2295114147 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 4) v1 ==== 59153+0+0 (secure 0 0 0) 0x7f588c073d40 con 0x55b2c0d99b50 2026-02-25T17:13:43.062 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.054+0000 7f58994a9640 1 -- 10.20.193.76:0/2295114147 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2784+0+0 (secure 0 0 0) 0x7f588c0b9d80 con 0x55b2c0d99b50 2026-02-25T17:13:43.063 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:43.055+0000 7f589e630b80 1 -- 10.20.193.76:0/2295114147 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) v1 -- 0x55b2c0c28af0 con 0x55b2c0d99b50 2026-02-25T17:13:44.019 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:44.016+0000 7f58994a9640 1 -- 10.20.193.76:0/2295114147 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v11) v1 ==== 141+0+0 (secure 0 0 0) 0x7f588c06d070 con 0x55b2c0d99b50 2026-02-25T17:13:44.020 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:44.016+0000 7f589e630b80 1 -- 10.20.193.76:0/2295114147 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x55b2c0c4a9c0 con 0x55b2c0d99b50 2026-02-25T17:13:44.021 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:44.018+0000 7f58994a9640 1 -- 10.20.193.76:0/2295114147 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mon_get_version_reply(handle=1 version=11) v2 ==== 24+0+0 (secure 0 0 0) 0x7f588c0b8fb0 con 0x55b2c0d99b50 2026-02-25T17:13:44.021 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:44.018+0000 7f589b4ad640 1 -- 10.20.193.76:0/2295114147 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=11}) v3 -- 0x7f5880002990 con 0x55b2c0d99b50 2026-02-25T17:13:44.021 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:44.018+0000 7f58994a9640 1 -- 10.20.193.76:0/2295114147 <== mon.1 v2:10.20.193.76:3301/0 8 ==== osd_map(11..11 src has 1..11) v4 ==== 1020+0+0 (secure 0 0 0) 0x7f588c0989f0 con 0x55b2c0d99b50 2026-02-25T17:13:44.021 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:44.018+0000 7f589e630b80 1 -- 10.20.193.76:0/2295114147 --> v1:10.20.193.76:6805/43126 -- osd_op(unknown.0.0:1 1.3 1:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11) v8 -- 0x55b2c0e4cf00 con 0x55b2c0e49400 2026-02-25T17:13:44.022 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:44.019+0000 7f589d711640 1 -- 10.20.193.76:0/2295114147 <== osd.1 v1:10.20.193.76:6805/43126 1 ==== osd_op_reply(1 rbd_trash [create] v11'1 uv1 ondisk = 0) v8 ==== 153+0+0 (unknown 2473213795 0 0) 0x7f589400a660 con 0x55b2c0e49400 2026-02-25T17:13:44.023 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:44.021+0000 7f589e630b80 1 -- 10.20.193.76:0/2295114147 --> v1:10.20.193.76:6806/43127 -- osd_op(unknown.0.0:2 1.2 1:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e11) v8 -- 0x55b2c0e9ea30 con 0x55b2c0e9ae40 2026-02-25T17:13:44.024 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:44.021+0000 7f589c4af640 1 -- 10.20.193.76:0/2295114147 <== osd.0 v1:10.20.193.76:6806/43127 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (unknown 3067770393 0 0) 0x7f588c079070 con 0x55b2c0e9ae40 2026-02-25T17:13:44.024 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:44.021+0000 7f589e630b80 1 -- 10.20.193.76:0/2295114147 --> v1:10.20.193.76:6806/43127 -- osd_op(unknown.0.0:3 1.2 1:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e11) v8 -- 0x55b2c0e998b0 con 0x55b2c0e9ae40 2026-02-25T17:13:44.024 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:44.021+0000 7f589c4af640 1 -- 10.20.193.76:0/2295114147 <== osd.0 v1:10.20.193.76:6806/43127 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (unknown 3079310357 0 0) 0x7f588c079070 con 0x55b2c0e9ae40 2026-02-25T17:13:44.024 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:44.021+0000 7f589b4ad640 1 -- 10.20.193.76:0/2295114147 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- pool_op(create unmanaged snap pool 1 tid 4 name v0) v4 -- 0x7f5880003d30 con 0x55b2c0d99b50 2026-02-25T17:13:45.025 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:45.022+0000 7f58994a9640 1 -- 10.20.193.76:0/2295114147 <== mon.1 v2:10.20.193.76:3301/0 9 ==== pool_op_reply(tid 4 (0) Success v12) v1 ==== 55+0+0 (secure 0 0 0) 0x7f588c077030 con 0x55b2c0d99b50 2026-02-25T17:13:45.025 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:45.022+0000 7f58994a9640 1 -- 10.20.193.76:0/2295114147 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=12}) v3 -- 0x7f587c0526d0 con 0x55b2c0d99b50 2026-02-25T17:13:45.025 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:45.022+0000 7f58994a9640 1 -- 10.20.193.76:0/2295114147 <== mon.1 v2:10.20.193.76:3301/0 10 ==== osd_map(12..12 src has 1..12) v4 ==== 988+0+0 (secure 0 0 0) 0x7f588c095570 con 0x55b2c0d99b50 2026-02-25T17:13:45.025 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:45.022+0000 7f589b4ad640 1 -- 10.20.193.76:0/2295114147 --> v1:10.20.193.76:6806/43127 -- osd_op(unknown.0.0:5 1.2 1:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e12) v8 -- 0x7f58800056d0 con 0x55b2c0e9ae40 2026-02-25T17:13:45.027 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:45.024+0000 7f589c4af640 1 -- 10.20.193.76:0/2295114147 <== osd.0 v1:10.20.193.76:6806/43127 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v12'1 uv1 ondisk = 0) v8 ==== 194+0+0 (unknown 265107415 0 0) 0x7f588c079070 con 0x55b2c0e9ae40 2026-02-25T17:13:45.027 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:45.024+0000 7f589b4ad640 1 -- 10.20.193.76:0/2295114147 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- pool_op(delete unmanaged snap pool 1 tid 6 name v12) v4 -- 0x7f58800051c0 con 0x55b2c0d99b50 2026-02-25T17:13:45.275 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:45.271+0000 7f58994a9640 1 -- 10.20.193.76:0/2295114147 <== mon.1 v2:10.20.193.76:3301/0 11 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f588c0948f0 con 0x55b2c0d99b50 2026-02-25T17:13:46.028 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.023+0000 7f58994a9640 1 -- 10.20.193.76:0/2295114147 <== mon.1 v2:10.20.193.76:3301/0 12 ==== pool_op_reply(tid 6 (0) Success v13) v1 ==== 43+0+0 (secure 0 0 0) 0x7f588c002ca0 con 0x55b2c0d99b50 2026-02-25T17:13:46.028 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.023+0000 7f58994a9640 1 -- 10.20.193.76:0/2295114147 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=13}) v3 -- 0x7f587c0260c0 con 0x55b2c0d99b50 2026-02-25T17:13:46.028 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.023+0000 7f58994a9640 1 -- 10.20.193.76:0/2295114147 <== mon.1 v2:10.20.193.76:3301/0 13 ==== osd_map(13..13 src has 1..13) v4 ==== 646+0+0 (secure 0 0 0) 0x7f588c07f2c0 con 0x55b2c0d99b50 2026-02-25T17:13:46.028 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.023+0000 7f589b4ad640 1 -- 10.20.193.76:0/2295114147 --> v1:10.20.193.76:6806/43127 -- osd_op(unknown.0.0:7 1.2 1:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13) v8 -- 0x7f5880005f70 con 0x55b2c0e9ae40 2026-02-25T17:13:46.030 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.027+0000 7f589c4af640 1 -- 10.20.193.76:0/2295114147 <== osd.0 v1:10.20.193.76:6806/43127 4 ==== osd_op_reply(7 rbd_info [write 0~19] v13'2 uv2 ondisk = 0) v8 ==== 152+0+0 (unknown 3677271976 0 0) 0x7f588c079070 con 0x55b2c0e9ae40 2026-02-25T17:13:46.032 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.027+0000 7f589e630b80 1 -- 10.20.193.76:0/2295114147 >> v1:10.20.193.76:6806/43127 conn(0x55b2c0e9ae40 legacy=0x55b2c0e9d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.032 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.027+0000 7f589e630b80 1 -- 10.20.193.76:0/2295114147 >> v1:10.20.193.76:6805/43126 conn(0x55b2c0e49400 legacy=0x55b2c0e4b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.032 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.027+0000 7f589e630b80 1 -- 10.20.193.76:0/2295114147 >> v1:10.20.193.76:6800/42442 conn(0x7f587c04b970 legacy=0x7f587c04de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.032 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.027+0000 7f589e630b80 1 -- 10.20.193.76:0/2295114147 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x55b2c0d99b50 msgr2=0x55b2c0d95c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.032 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.027+0000 7f589e630b80 1 --2- 10.20.193.76:0/2295114147 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x55b2c0d99b50 0x55b2c0d95c70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f588c027b30 tx=0x7f588c06b000 comp rx=0 tx=0).stop 2026-02-25T17:13:46.032 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.027+0000 7f589d711640 1 -- 10.20.193.76:0/2295114147 reap_dead start 2026-02-25T17:13:46.032 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.027+0000 7f589e630b80 1 -- 10.20.193.76:0/2295114147 shutdown_connections 2026-02-25T17:13:46.032 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.027+0000 7f589e630b80 1 --2- 10.20.193.76:0/2295114147 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x55b2c0d99b50 0x55b2c0d95c70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.032 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.027+0000 7f589e630b80 1 -- 10.20.193.76:0/2295114147 >> 10.20.193.76:0/2295114147 conn(0x55b2c0da6980 msgr2=0x55b2c0d8f570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.033 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.027+0000 7f589e630b80 1 -- 10.20.193.76:0/2295114147 shutdown_connections 2026-02-25T17:13:46.033 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.027+0000 7f589e630b80 1 -- 10.20.193.76:0/2295114147 wait complete. 2026-02-25T17:13:46.034 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-25T17:13:46.034 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-25T17:13:46.034 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-25T17:13:46.035 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-25T17:13:46.035 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-25T17:13:46.142 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.134+0000 7f038a887640 1 Processor -- start 2026-02-25T17:13:46.142 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.134+0000 7f038a887640 1 -- start start 2026-02-25T17:13:46.142 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.134+0000 7f038a887640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0384097a10 0x7f0384097de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.142 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.134+0000 7f038a887640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f03841273f0 0x7f03841324f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.142 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.134+0000 7f038a887640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f038409a4c0 con 0x7f0384098320 2026-02-25T17:13:46.143 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.134+0000 7f038a887640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038409a710 con 0x7f03841273f0 2026-02-25T17:13:46.143 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.134+0000 7f038a887640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0384099460 con 0x7f0384097a10 2026-02-25T17:13:46.143 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.134+0000 7f0388e24640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f03841273f0 0x7f03841324f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.143 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.134+0000 7f0383fff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0384097a10 0x7f0384097de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.143 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.134+0000 7f03837fe640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f0384098320 0x7f0384126ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:44536/0 (socket says 10.20.193.76:44536) 2026-02-25T17:13:46.143 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.134+0000 7f03837fe640 1 -- 10.20.193.76:0/2711811448 learned_addr learned my addr 10.20.193.76:0/2711811448 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:13:46.143 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.135+0000 7f0382ffd640 1 -- 10.20.193.76:0/2711811448 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 409395687 0 0) 0x7f038409a4c0 con 0x7f0384098320 2026-02-25T17:13:46.143 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.135+0000 7f0388e24640 1 -- 10.20.193.76:0/2711811448 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0384097a10 msgr2=0x7f0384097de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:46.143 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.135+0000 7f0388e24640 1 --2- 10.20.193.76:0/2711811448 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0384097a10 0x7f0384097de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.143 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.135+0000 7f0388e24640 1 -- 10.20.193.76:0/2711811448 >> v1:10.20.193.76:6789/0 conn(0x7f0384098320 legacy=0x7f0384126ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.143 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.135+0000 7f0388e24640 1 -- 10.20.193.76:0/2711811448 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0384068e60 con 0x7f03841273f0 2026-02-25T17:13:46.144 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.135+0000 7f0383fff640 1 --2- 10.20.193.76:0/2711811448 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0384097a10 0x7f0384097de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:46.144 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.135+0000 7f0388e24640 1 --2- 10.20.193.76:0/2711811448 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f03841273f0 0x7f03841324f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f037c009e90 tx=0x7f037c02f2b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=561110ca1c879745 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.144 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.135+0000 7f0382ffd640 1 -- 10.20.193.76:0/2711811448 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c02fd80 con 0x7f03841273f0 2026-02-25T17:13:46.144 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.135+0000 7f0382ffd640 1 -- 10.20.193.76:0/2711811448 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c037440 con 0x7f03841273f0 2026-02-25T17:13:46.144 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.135+0000 7f0382ffd640 1 -- 10.20.193.76:0/2711811448 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c0377e0 con 0x7f03841273f0 2026-02-25T17:13:46.144 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.135+0000 7f038a887640 1 -- 10.20.193.76:0/2711811448 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f03841273f0 msgr2=0x7f03841324f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.144 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.135+0000 7f038a887640 1 --2- 10.20.193.76:0/2711811448 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f03841273f0 0x7f03841324f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f037c009e90 tx=0x7f037c02f2b0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.144 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.136+0000 7f038a887640 1 -- 10.20.193.76:0/2711811448 shutdown_connections 2026-02-25T17:13:46.144 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.136+0000 7f038a887640 1 --2- 10.20.193.76:0/2711811448 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f03841273f0 0x7f03841324f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.144 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.136+0000 7f038a887640 1 --2- 10.20.193.76:0/2711811448 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0384097a10 0x7f0384097de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.144 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.136+0000 7f038a887640 1 -- 10.20.193.76:0/2711811448 >> 10.20.193.76:0/2711811448 conn(0x7f038409db30 msgr2=0x7f0384068520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.144 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.136+0000 7f038a887640 1 -- 10.20.193.76:0/2711811448 shutdown_connections 2026-02-25T17:13:46.145 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.136+0000 7f038a887640 1 -- 10.20.193.76:0/2711811448 wait complete. 2026-02-25T17:13:46.145 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.136+0000 7f038a887640 1 Processor -- start 2026-02-25T17:13:46.145 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.136+0000 7f038a887640 1 -- start start 2026-02-25T17:13:46.145 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.136+0000 7f038a887640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0384097a10 0x7f03841be100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.145 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.136+0000 7f038a887640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0384098320 0x7f03841be640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.145 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.136+0000 7f038a887640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f03841273f0 0x7f03841beb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.145 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.136+0000 7f038a887640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038411c090 con 0x7f03841273f0 2026-02-25T17:13:46.145 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.136+0000 7f038a887640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038411e640 con 0x7f0384098320 2026-02-25T17:13:46.145 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.136+0000 7f038a887640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f038411da90 con 0x7f0384097a10 2026-02-25T17:13:46.145 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.137+0000 7f0383fff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0384097a10 0x7f03841be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.145 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.137+0000 7f03837fe640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0384098320 0x7f03841be640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.145 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.137+0000 7f0383fff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0384097a10 0x7f03841be100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:54064/0 (socket says 10.20.193.76:54064) 2026-02-25T17:13:46.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.137+0000 7f0383fff640 1 -- 10.20.193.76:0/2882280344 learned_addr learned my addr 10.20.193.76:0/2882280344 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:46.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.137+0000 7f0388e24640 1 --2- 10.20.193.76:0/2882280344 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f03841273f0 0x7f03841beb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.137+0000 7f0383fff640 1 -- 10.20.193.76:0/2882280344 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0384098320 msgr2=0x7f03841be640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.137+0000 7f0383fff640 1 --2- 10.20.193.76:0/2882280344 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0384098320 0x7f03841be640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.137+0000 7f0383fff640 1 -- 10.20.193.76:0/2882280344 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f03841273f0 msgr2=0x7f03841beb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.137+0000 7f0383fff640 1 --2- 10.20.193.76:0/2882280344 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f03841273f0 0x7f03841beb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.137+0000 7f0383fff640 1 -- 10.20.193.76:0/2882280344 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0374009390 con 0x7f0384097a10 2026-02-25T17:13:46.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.137+0000 7f03837fe640 1 --2- 10.20.193.76:0/2882280344 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0384098320 0x7f03841be640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:46.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.137+0000 7f0383fff640 1 --2- 10.20.193.76:0/2882280344 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0384097a10 0x7f03841be100 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f037400ec80 tx=0x7f03740090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.137+0000 7f0380ff9640 1 -- 10.20.193.76:0/2882280344 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037400cbd0 con 0x7f0384097a10 2026-02-25T17:13:46.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.137+0000 7f0380ff9640 1 -- 10.20.193.76:0/2882280344 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037400cd30 con 0x7f0384097a10 2026-02-25T17:13:46.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.137+0000 7f038a887640 1 -- 10.20.193.76:0/2882280344 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037c009a20 con 0x7f0384097a10 2026-02-25T17:13:46.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.137+0000 7f0380ff9640 1 -- 10.20.193.76:0/2882280344 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03740136a0 con 0x7f0384097a10 2026-02-25T17:13:46.147 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.137+0000 7f038a887640 1 -- 10.20.193.76:0/2882280344 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038411af00 con 0x7f0384097a10 2026-02-25T17:13:46.147 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.137+0000 7f038a887640 1 -- 10.20.193.76:0/2882280344 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0384064c00 con 0x7f0384097a10 2026-02-25T17:13:46.147 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.138+0000 7f0380ff9640 1 -- 10.20.193.76:0/2882280344 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f0374013a10 con 0x7f0384097a10 2026-02-25T17:13:46.147 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.138+0000 7f0380ff9640 1 -- 10.20.193.76:0/2882280344 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f0374064060 con 0x7f0384097a10 2026-02-25T17:13:46.147 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.140+0000 7f0380ff9640 1 -- 10.20.193.76:0/2882280344 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f037403eef0 con 0x7f0384097a10 2026-02-25T17:13:46.215 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.212+0000 7f038a887640 1 -- 10.20.193.76:0/2882280344 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0384063e70 con 0x7f0384097a10 2026-02-25T17:13:46.217 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.213+0000 7f0380ff9640 1 -- 10.20.193.76:0/2882280344 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+117053 (secure 0 0 0) 0x7f0374042700 con 0x7f0384097a10 2026-02-25T17:13:46.218 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:46.220 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.214+0000 7f038a887640 1 -- 10.20.193.76:0/2882280344 >> v1:10.20.193.76:6800/42442 conn(0x7f037004d0d0 legacy=0x7f037004f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.220 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.214+0000 7f038a887640 1 -- 10.20.193.76:0/2882280344 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0384097a10 msgr2=0x7f03841be100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.220 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.214+0000 7f038a887640 1 --2- 10.20.193.76:0/2882280344 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0384097a10 0x7f03841be100 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f037400ec80 tx=0x7f03740090f0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.220 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.214+0000 7f038a887640 1 -- 10.20.193.76:0/2882280344 shutdown_connections 2026-02-25T17:13:46.220 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.214+0000 7f038a887640 1 --2- 10.20.193.76:0/2882280344 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f03841273f0 0x7f03841beb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.220 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.214+0000 7f038a887640 1 --2- 10.20.193.76:0/2882280344 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0384098320 0x7f03841be640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.220 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.214+0000 7f038a887640 1 --2- 10.20.193.76:0/2882280344 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0384097a10 0x7f03841be100 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.221 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.214+0000 7f038a887640 1 -- 10.20.193.76:0/2882280344 >> 10.20.193.76:0/2882280344 conn(0x7f038409db30 msgr2=0x7f0384113bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.221 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.214+0000 7f038a887640 1 -- 10.20.193.76:0/2882280344 shutdown_connections 2026-02-25T17:13:46.221 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.214+0000 7f038a887640 1 -- 10.20.193.76:0/2882280344 wait complete. 2026-02-25T17:13:46.224 INFO:teuthology.orchestra.run.trial076.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6800","nonce":42442}]},"active_addr":"10.20.193.76:6800/42442","active_change":"2026-02-25T17:13:34.800806+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4099,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.76:0","nonce":1432153956}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.76:0","nonce":94912213}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.76:0","nonce":1754372634}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.76:0","nonce":599075350}]}]} 2026-02-25T17:13:46.229 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-25T17:13:46.229 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-25T17:13:46.230 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T17:13:46.295 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.291+0000 7ff885c31640 1 Processor -- start 2026-02-25T17:13:46.295 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.291+0000 7ff885c31640 1 -- start start 2026-02-25T17:13:46.295 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.291+0000 7ff885c31640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff880097790 0x7ff88012f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.295 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.291+0000 7ff885c31640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff88012f870 0x7ff880131c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.295 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.291+0000 7ff885c31640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff880099560 con 0x7ff880096cb0 2026-02-25T17:13:46.295 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.291+0000 7ff885c31640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88009a550 con 0x7ff880097790 2026-02-25T17:13:46.295 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.291+0000 7ff885c31640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff880097b60 con 0x7ff88012f870 2026-02-25T17:13:46.295 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.291+0000 7ff87f7fe640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7ff880096cb0 0x7ff880097080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:44552/0 (socket says 10.20.193.76:44552) 2026-02-25T17:13:46.295 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.291+0000 7ff87f7fe640 1 -- 10.20.193.76:0/310599847 learned_addr learned my addr 10.20.193.76:0/310599847 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:13:46.295 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.291+0000 7ff87ffff640 1 --2- 10.20.193.76:0/310599847 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff88012f870 0x7ff880131c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.295 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.291+0000 7ff87effd640 1 --2- 10.20.193.76:0/310599847 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff880097790 0x7ff88012f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.295 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.291+0000 7ff87e7fc640 1 -- 10.20.193.76:0/310599847 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4252283882 0 0) 0x7ff880099560 con 0x7ff880096cb0 2026-02-25T17:13:46.295 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.291+0000 7ff87ffff640 1 -- 10.20.193.76:0/310599847 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff880097790 msgr2=0x7ff88012f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:46.295 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.291+0000 7ff87ffff640 1 --2- 10.20.193.76:0/310599847 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff880097790 0x7ff88012f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.296 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.291+0000 7ff87ffff640 1 -- 10.20.193.76:0/310599847 >> v1:10.20.193.76:6789/0 conn(0x7ff880096cb0 legacy=0x7ff880097080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.296 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.291+0000 7ff87ffff640 1 -- 10.20.193.76:0/310599847 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8800998c0 con 0x7ff88012f870 2026-02-25T17:13:46.296 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.292+0000 7ff87ffff640 1 --2- 10.20.193.76:0/310599847 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff88012f870 0x7ff880131c50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff878009e90 tx=0x7ff87802f2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59e0fb5e1bab679c server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.296 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.292+0000 7ff87e7fc640 1 -- 10.20.193.76:0/310599847 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87802fd80 con 0x7ff88012f870 2026-02-25T17:13:46.296 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.292+0000 7ff87e7fc640 1 -- 10.20.193.76:0/310599847 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff878037440 con 0x7ff88012f870 2026-02-25T17:13:46.296 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.292+0000 7ff87e7fc640 1 -- 10.20.193.76:0/310599847 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8780377e0 con 0x7ff88012f870 2026-02-25T17:13:46.296 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.292+0000 7ff885c31640 1 -- 10.20.193.76:0/310599847 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff88012f870 msgr2=0x7ff880131c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.296 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.292+0000 7ff885c31640 1 --2- 10.20.193.76:0/310599847 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff88012f870 0x7ff880131c50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff878009e90 tx=0x7ff87802f2b0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.296 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.292+0000 7ff885c31640 1 -- 10.20.193.76:0/310599847 shutdown_connections 2026-02-25T17:13:46.296 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.292+0000 7ff885c31640 1 --2- 10.20.193.76:0/310599847 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff88012f870 0x7ff880131c50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.296 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.292+0000 7ff885c31640 1 --2- 10.20.193.76:0/310599847 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff880097790 0x7ff88012f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.296 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.292+0000 7ff885c31640 1 -- 10.20.193.76:0/310599847 >> 10.20.193.76:0/310599847 conn(0x7ff88009dac0 msgr2=0x7ff88009dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.296 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.292+0000 7ff885c31640 1 -- 10.20.193.76:0/310599847 shutdown_connections 2026-02-25T17:13:46.296 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.292+0000 7ff885c31640 1 -- 10.20.193.76:0/310599847 wait complete. 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff885c31640 1 Processor -- start 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff885c31640 1 -- start start 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff885c31640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff880096cb0 0x7ff8801be750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff885c31640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff880097790 0x7ff8801bec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff885c31640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff88012f870 0x7ff880114bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff885c31640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff880127710 con 0x7ff880096cb0 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff885c31640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8801b70f0 con 0x7ff880097790 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff885c31640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff880117f20 con 0x7ff88012f870 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff87effd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff880097790 0x7ff8801bec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff87f7fe640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff880096cb0 0x7ff8801be750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff87effd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff880097790 0x7ff8801bec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:46968/0 (socket says 10.20.193.76:46968) 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff87effd640 1 -- 10.20.193.76:0/1954445929 learned_addr learned my addr 10.20.193.76:0/1954445929 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff87ffff640 1 --2- 10.20.193.76:0/1954445929 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff88012f870 0x7ff880114bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff87effd640 1 -- 10.20.193.76:0/1954445929 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff88012f870 msgr2=0x7ff880114bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff87effd640 1 --2- 10.20.193.76:0/1954445929 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff88012f870 0x7ff880114bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff87effd640 1 -- 10.20.193.76:0/1954445929 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff880096cb0 msgr2=0x7ff8801be750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff87effd640 1 --2- 10.20.193.76:0/1954445929 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff880096cb0 0x7ff8801be750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff87effd640 1 -- 10.20.193.76:0/1954445929 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff878009a20 con 0x7ff880097790 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff87ffff640 1 --2- 10.20.193.76:0/1954445929 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff88012f870 0x7ff880114bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff87effd640 1 --2- 10.20.193.76:0/1954445929 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff880097790 0x7ff8801bec90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff87400ea50 tx=0x7ff8740090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff867fff640 1 -- 10.20.193.76:0/1954445929 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87400ca70 con 0x7ff880097790 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff867fff640 1 -- 10.20.193.76:0/1954445929 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87400cbd0 con 0x7ff880097790 2026-02-25T17:13:46.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff885c31640 1 -- 10.20.193.76:0/1954445929 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff880116ee0 con 0x7ff880097790 2026-02-25T17:13:46.298 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff867fff640 1 -- 10.20.193.76:0/1954445929 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff874013470 con 0x7ff880097790 2026-02-25T17:13:46.298 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.293+0000 7ff885c31640 1 -- 10.20.193.76:0/1954445929 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff880115100 con 0x7ff880097790 2026-02-25T17:13:46.298 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.294+0000 7ff885c31640 1 -- 10.20.193.76:0/1954445929 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff880064c00 con 0x7ff880097790 2026-02-25T17:13:46.298 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.294+0000 7ff867fff640 1 -- 10.20.193.76:0/1954445929 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7ff874013820 con 0x7ff880097790 2026-02-25T17:13:46.298 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.294+0000 7ff867fff640 1 -- 10.20.193.76:0/1954445929 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7ff874063c90 con 0x7ff880097790 2026-02-25T17:13:46.300 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.296+0000 7ff867fff640 1 -- 10.20.193.76:0/1954445929 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7ff87403ea80 con 0x7ff880097790 2026-02-25T17:13:46.361 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.357+0000 7ff885c31640 1 -- 10.20.193.76:0/1954445929 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff880063e70 con 0x7ff880097790 2026-02-25T17:13:46.362 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.358+0000 7ff867fff640 1 -- 10.20.193.76:0/1954445929 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8078 (secure 0 0 0) 0x7ff874042290 con 0x7ff880097790 2026-02-25T17:13:46.362 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:46.362 INFO:teuthology.orchestra.run.trial076.stdout:{"epoch":13,"fsid":"0648ee30-4e19-4268-91ad-07b0e65a8518","created":"2026-02-25T17:13:33.780133+0000","modified":"2026-02-25T17:13:46.021895+0000","last_up_change":"2026-02-25T17:13:41.008215+0000","last_in_change":"2026-02-25T17:13:34.859194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-25T17:13:42.208987+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-25T17:13:42.832027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"85909bd3-2540-48a9-a649-33709fa74613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6806","nonce":43127}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6808","nonce":43127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6812","nonce":43127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6810","nonce":43127}]},"public_addr":"10.20.193.76:6806/43127","cluster_addr":"10.20.193.76:6808/43127","heartbeat_back_addr":"10.20.193.76:6812/43127","heartbeat_front_addr":"10.20.193.76:6810/43127","state":["exists","up"]},{"osd":1,"uuid":"f0a0a51c-d629-464e-bc04-dacbaaf78efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6805","nonce":43126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6807","nonce":43126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6811","nonce":43126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6809","nonce":43126}]},"public_addr":"10.20.193.76:6805/43126","cluster_addr":"10.20.193.76:6807/43126","heartbeat_back_addr":"10.20.193.76:6811/43126","heartbeat_front_addr":"10.20.193.76:6809/43126","state":["exists","up"]},{"osd":2,"uuid":"9633000b-764d-457a-b560-539dc5830e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6813","nonce":43128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6814","nonce":43128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6816","nonce":43128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6815","nonce":43128}]},"public_addr":"10.20.193.76:6813/43128","cluster_addr":"10.20.193.76:6814/43128","heartbeat_back_addr":"10.20.193.76:6816/43128","heartbeat_front_addr":"10.20.193.76:6815/43128","state":["exists","up"]},{"osd":3,"uuid":"fc098e34-48a8-4414-ad41-60abdf7388a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6801","nonce":43129}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6802","nonce":43129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6804","nonce":43129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6803","nonce":43129}]},"public_addr":"10.20.193.76:6801/43129","cluster_addr":"10.20.193.76:6802/43129","heartbeat_back_addr":"10.20.193.76:6804/43129","heartbeat_front_addr":"10.20.193.76:6803/43129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T17:13:46.362 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.358+0000 7ff885c31640 1 -- 10.20.193.76:0/1954445929 >> v1:10.20.193.76:6800/42442 conn(0x7ff86c04d0d0 legacy=0x7ff86c04f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.362 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.358+0000 7ff885c31640 1 -- 10.20.193.76:0/1954445929 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff880097790 msgr2=0x7ff8801bec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.362 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.358+0000 7ff885c31640 1 --2- 10.20.193.76:0/1954445929 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff880097790 0x7ff8801bec90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff87400ea50 tx=0x7ff8740090f0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.363 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.358+0000 7ff885c31640 1 -- 10.20.193.76:0/1954445929 shutdown_connections 2026-02-25T17:13:46.363 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.358+0000 7ff885c31640 1 --2- 10.20.193.76:0/1954445929 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff88012f870 0x7ff880114bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.363 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.358+0000 7ff885c31640 1 --2- 10.20.193.76:0/1954445929 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff880097790 0x7ff8801bec90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.363 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.358+0000 7ff885c31640 1 --2- 10.20.193.76:0/1954445929 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff880096cb0 0x7ff8801be750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.363 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.358+0000 7ff885c31640 1 -- 10.20.193.76:0/1954445929 >> 10.20.193.76:0/1954445929 conn(0x7ff88009dac0 msgr2=0x7ff880131170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.363 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.358+0000 7ff885c31640 1 -- 10.20.193.76:0/1954445929 shutdown_connections 2026-02-25T17:13:46.363 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.358+0000 7ff885c31640 1 -- 10.20.193.76:0/1954445929 wait complete. 2026-02-25T17:13:46.369 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-25T17:13:46.369 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T17:13:46.438 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.429+0000 7f17fc1cc640 1 Processor -- start 2026-02-25T17:13:46.438 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.429+0000 7f17fc1cc640 1 -- start start 2026-02-25T17:13:46.438 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.430+0000 7f17fc1cc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f17f4127f20 0x7f17f412d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.438 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.430+0000 7f17fc1cc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f17f412d5c0 0x7f17f412f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.438 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.430+0000 7f17fc1cc640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f410fd60 con 0x7f17f406c2e0 2026-02-25T17:13:46.438 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.430+0000 7f17fc1cc640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f411f0f0 con 0x7f17f412d5c0 2026-02-25T17:13:46.438 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.430+0000 7f17fc1cc640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17f4128bb0 con 0x7f17f4127f20 2026-02-25T17:13:46.438 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.430+0000 7f17f9f68640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f17f406c2e0 0x7f17f41284a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:44568/0 (socket says 10.20.193.76:44568) 2026-02-25T17:13:46.439 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.430+0000 7f17fa769640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f17f412d5c0 0x7f17f412f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.439 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.430+0000 7f17f9f68640 1 -- 10.20.193.76:0/749849472 learned_addr learned my addr 10.20.193.76:0/749849472 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:13:46.439 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.430+0000 7f17f9767640 1 --2- 10.20.193.76:0/749849472 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f17f4127f20 0x7f17f412d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.439 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.430+0000 7f17f8f66640 1 -- 10.20.193.76:0/749849472 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296397605 0 0) 0x7f17f410fd60 con 0x7f17f406c2e0 2026-02-25T17:13:46.439 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.430+0000 7f17fa769640 1 -- 10.20.193.76:0/749849472 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f17f4127f20 msgr2=0x7f17f412d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:46.439 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.430+0000 7f17fa769640 1 --2- 10.20.193.76:0/749849472 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f17f4127f20 0x7f17f412d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.439 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.430+0000 7f17fa769640 1 -- 10.20.193.76:0/749849472 >> v1:10.20.193.76:6789/0 conn(0x7f17f406c2e0 legacy=0x7f17f41284a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.439 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.430+0000 7f17fa769640 1 -- 10.20.193.76:0/749849472 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f4110870 con 0x7f17f412d5c0 2026-02-25T17:13:46.439 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.430+0000 7f17f9767640 1 --2- 10.20.193.76:0/749849472 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f17f4127f20 0x7f17f412d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:46.439 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.430+0000 7f17fa769640 1 --2- 10.20.193.76:0/749849472 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f17f412d5c0 0x7f17f412f9a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009e90 tx=0x7f17ec02f2b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb47d4b684a04142 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.439 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.430+0000 7f17f8f66640 1 -- 10.20.193.76:0/749849472 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec02fd80 con 0x7f17f412d5c0 2026-02-25T17:13:46.440 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.431+0000 7f17f8f66640 1 -- 10.20.193.76:0/749849472 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ec037440 con 0x7f17f412d5c0 2026-02-25T17:13:46.440 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.431+0000 7f17f8f66640 1 -- 10.20.193.76:0/749849472 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec0377e0 con 0x7f17f412d5c0 2026-02-25T17:13:46.440 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.431+0000 7f17fc1cc640 1 -- 10.20.193.76:0/749849472 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f17f412d5c0 msgr2=0x7f17f412f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.440 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.431+0000 7f17fc1cc640 1 --2- 10.20.193.76:0/749849472 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f17f412d5c0 0x7f17f412f9a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009e90 tx=0x7f17ec02f2b0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.440 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.431+0000 7f17fc1cc640 1 -- 10.20.193.76:0/749849472 shutdown_connections 2026-02-25T17:13:46.440 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.431+0000 7f17fc1cc640 1 --2- 10.20.193.76:0/749849472 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f17f412d5c0 0x7f17f412f9a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.440 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.431+0000 7f17fc1cc640 1 --2- 10.20.193.76:0/749849472 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f17f4127f20 0x7f17f412d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.440 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.431+0000 7f17fc1cc640 1 -- 10.20.193.76:0/749849472 >> 10.20.193.76:0/749849472 conn(0x7f17f4099700 msgr2=0x7f17f4099b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.440 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.431+0000 7f17fc1cc640 1 -- 10.20.193.76:0/749849472 shutdown_connections 2026-02-25T17:13:46.440 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.431+0000 7f17fc1cc640 1 -- 10.20.193.76:0/749849472 wait complete. 2026-02-25T17:13:46.440 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.431+0000 7f17fc1cc640 1 Processor -- start 2026-02-25T17:13:46.440 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.431+0000 7f17fc1cc640 1 -- start start 2026-02-25T17:13:46.441 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17fc1cc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f17f406c2e0 0x7f17f4120bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.441 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17fc1cc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f17f4127f20 0x7f17f4121100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.441 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17fc1cc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f17f412d5c0 0x7f17f4121640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.441 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17fc1cc640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f4124120 con 0x7f17f412d5c0 2026-02-25T17:13:46.441 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17fc1cc640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f412fa40 con 0x7f17f4127f20 2026-02-25T17:13:46.441 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17fc1cc640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17f4123580 con 0x7f17f406c2e0 2026-02-25T17:13:46.441 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17f9767640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f17f4127f20 0x7f17f4121100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.441 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17f9f68640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f17f406c2e0 0x7f17f4120bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.441 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17fa769640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f17f412d5c0 0x7f17f4121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.441 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17f9767640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f17f4127f20 0x7f17f4121100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:46986/0 (socket says 10.20.193.76:46986) 2026-02-25T17:13:46.441 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17f9767640 1 -- 10.20.193.76:0/140587942 learned_addr learned my addr 10.20.193.76:0/140587942 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:46.442 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17f9f68640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f17f406c2e0 0x7f17f4120bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:54100/0 (socket says 10.20.193.76:54100) 2026-02-25T17:13:46.442 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17f9767640 1 -- 10.20.193.76:0/140587942 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f17f406c2e0 msgr2=0x7f17f4120bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.442 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17f9767640 1 --2- 10.20.193.76:0/140587942 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f17f406c2e0 0x7f17f4120bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.442 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17f9767640 1 -- 10.20.193.76:0/140587942 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f17f412d5c0 msgr2=0x7f17f4121640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.442 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17f9767640 1 --2- 10.20.193.76:0/140587942 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f17f412d5c0 0x7f17f4121640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.442 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17f9767640 1 -- 10.20.193.76:0/140587942 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e4009390 con 0x7f17f4127f20 2026-02-25T17:13:46.442 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17f9767640 1 --2- 10.20.193.76:0/140587942 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f17f4127f20 0x7f17f4121100 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f17e400ec80 tx=0x7f17e40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.442 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17ea7fc640 1 -- 10.20.193.76:0/140587942 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e400cbd0 con 0x7f17f4127f20 2026-02-25T17:13:46.442 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17ea7fc640 1 -- 10.20.193.76:0/140587942 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e400cd30 con 0x7f17f4127f20 2026-02-25T17:13:46.442 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17fc1cc640 1 -- 10.20.193.76:0/140587942 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ec009a20 con 0x7f17f4127f20 2026-02-25T17:13:46.442 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17ea7fc640 1 -- 10.20.193.76:0/140587942 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4013680 con 0x7f17f4127f20 2026-02-25T17:13:46.442 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.432+0000 7f17fc1cc640 1 -- 10.20.193.76:0/140587942 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f4124510 con 0x7f17f4127f20 2026-02-25T17:13:46.442 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.433+0000 7f17fc1cc640 1 -- 10.20.193.76:0/140587942 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f4064c00 con 0x7f17f4127f20 2026-02-25T17:13:46.443 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.433+0000 7f17ea7fc640 1 -- 10.20.193.76:0/140587942 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f17e40139f0 con 0x7f17f4127f20 2026-02-25T17:13:46.443 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.433+0000 7f17ea7fc640 1 -- 10.20.193.76:0/140587942 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f17e4063d50 con 0x7f17f4127f20 2026-02-25T17:13:46.443 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.435+0000 7f17ea7fc640 1 -- 10.20.193.76:0/140587942 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f17e403ebe0 con 0x7f17f4127f20 2026-02-25T17:13:46.500 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.496+0000 7f17fc1cc640 1 -- 10.20.193.76:0/140587942 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17f4068160 con 0x7f17f4127f20 2026-02-25T17:13:46.500 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.496+0000 7f17ea7fc640 1 -- 10.20.193.76:0/140587942 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8078 (secure 0 0 0) 0x7f17e40423f0 con 0x7f17f4127f20 2026-02-25T17:13:46.501 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:46.501 INFO:teuthology.orchestra.run.trial076.stdout:{"epoch":13,"fsid":"0648ee30-4e19-4268-91ad-07b0e65a8518","created":"2026-02-25T17:13:33.780133+0000","modified":"2026-02-25T17:13:46.021895+0000","last_up_change":"2026-02-25T17:13:41.008215+0000","last_in_change":"2026-02-25T17:13:34.859194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-25T17:13:42.208987+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-25T17:13:42.832027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"85909bd3-2540-48a9-a649-33709fa74613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6806","nonce":43127}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6808","nonce":43127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6812","nonce":43127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6810","nonce":43127}]},"public_addr":"10.20.193.76:6806/43127","cluster_addr":"10.20.193.76:6808/43127","heartbeat_back_addr":"10.20.193.76:6812/43127","heartbeat_front_addr":"10.20.193.76:6810/43127","state":["exists","up"]},{"osd":1,"uuid":"f0a0a51c-d629-464e-bc04-dacbaaf78efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6805","nonce":43126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6807","nonce":43126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6811","nonce":43126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6809","nonce":43126}]},"public_addr":"10.20.193.76:6805/43126","cluster_addr":"10.20.193.76:6807/43126","heartbeat_back_addr":"10.20.193.76:6811/43126","heartbeat_front_addr":"10.20.193.76:6809/43126","state":["exists","up"]},{"osd":2,"uuid":"9633000b-764d-457a-b560-539dc5830e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6813","nonce":43128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6814","nonce":43128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6816","nonce":43128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6815","nonce":43128}]},"public_addr":"10.20.193.76:6813/43128","cluster_addr":"10.20.193.76:6814/43128","heartbeat_back_addr":"10.20.193.76:6816/43128","heartbeat_front_addr":"10.20.193.76:6815/43128","state":["exists","up"]},{"osd":3,"uuid":"fc098e34-48a8-4414-ad41-60abdf7388a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6801","nonce":43129}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6802","nonce":43129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6804","nonce":43129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6803","nonce":43129}]},"public_addr":"10.20.193.76:6801/43129","cluster_addr":"10.20.193.76:6802/43129","heartbeat_back_addr":"10.20.193.76:6804/43129","heartbeat_front_addr":"10.20.193.76:6803/43129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T17:13:46.502 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.497+0000 7f17fc1cc640 1 -- 10.20.193.76:0/140587942 >> v1:10.20.193.76:6800/42442 conn(0x7f17d804d100 legacy=0x7f17d804f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.502 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.497+0000 7f17fc1cc640 1 -- 10.20.193.76:0/140587942 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f17f4127f20 msgr2=0x7f17f4121100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.502 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.497+0000 7f17fc1cc640 1 --2- 10.20.193.76:0/140587942 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f17f4127f20 0x7f17f4121100 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f17e400ec80 tx=0x7f17e40090f0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.502 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.497+0000 7f17fc1cc640 1 -- 10.20.193.76:0/140587942 shutdown_connections 2026-02-25T17:13:46.502 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.497+0000 7f17fc1cc640 1 --2- 10.20.193.76:0/140587942 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f17f412d5c0 0x7f17f4121640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.502 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.497+0000 7f17fc1cc640 1 --2- 10.20.193.76:0/140587942 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f17f4127f20 0x7f17f4121100 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.502 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.497+0000 7f17fc1cc640 1 --2- 10.20.193.76:0/140587942 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f17f406c2e0 0x7f17f4120bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.503 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.497+0000 7f17fc1cc640 1 -- 10.20.193.76:0/140587942 >> 10.20.193.76:0/140587942 conn(0x7f17f4099700 msgr2=0x7f17f41262f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.503 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.497+0000 7f17fc1cc640 1 -- 10.20.193.76:0/140587942 shutdown_connections 2026-02-25T17:13:46.503 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.497+0000 7f17fc1cc640 1 -- 10.20.193.76:0/140587942 wait complete. 2026-02-25T17:13:46.509 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-25T17:13:46.510 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-25T17:13:46.510 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-25T17:13:46.511 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-25T17:13:46.576 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.571+0000 7f1985193640 1 Processor -- start 2026-02-25T17:13:46.576 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.571+0000 7f1985193640 1 -- start start 2026-02-25T17:13:46.576 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f1985193640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f1980096ed0 0x7f198008f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.576 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f1985193640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f198008f740 0x7f198008fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.577 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f1985193640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1980128310 0x7f1980128780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.577 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f1985193640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19800956d0 con 0x7f1980096ed0 2026-02-25T17:13:46.577 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f1985193640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1980092190 con 0x7f1980128310 2026-02-25T17:13:46.577 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f1985193640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1980090b20 con 0x7f198008f740 2026-02-25T17:13:46.577 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f197ed9d640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f1980096ed0 0x7f198008f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.577 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f197f59e640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1980128310 0x7f1980128780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.577 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f197e59c640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f198008f740 0x7f198008fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.577 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f197ed9d640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f1980096ed0 0x7f198008f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:58170/0 (socket says 10.20.193.76:58170) 2026-02-25T17:13:46.577 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f197e59c640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f198008f740 0x7f198008fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:54108/0 (socket says 10.20.193.76:54108) 2026-02-25T17:13:46.577 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f197ed9d640 1 -- 10.20.193.76:0/1597821112 learned_addr learned my addr 10.20.193.76:0/1597821112 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:46.577 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f197f59e640 1 --2- 10.20.193.76:0/1597821112 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1980128310 0x7f1980128780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:46990/0 (socket says 10.20.193.76:46990) 2026-02-25T17:13:46.578 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f9723c31640 1 Processor -- start 2026-02-25T17:13:46.578 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f9723c31640 1 -- start start 2026-02-25T17:13:46.579 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f197f59e640 1 -- 10.20.193.76:0/1597821112 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f198008f740 msgr2=0x7f198008fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:46.579 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f197f59e640 1 --2- 10.20.193.76:0/1597821112 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f198008f740 0x7f198008fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.579 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f197f59e640 1 -- 10.20.193.76:0/1597821112 >> v2:10.20.193.76:3300/0 conn(0x7f1980096ed0 msgr2=0x7f198008f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:46.579 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f197f59e640 1 --2- 10.20.193.76:0/1597821112 >> v2:10.20.193.76:3300/0 conn(0x7f1980096ed0 0x7f198008f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.579 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f197f59e640 1 -- 10.20.193.76:0/1597821112 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1980091070 con 0x7f1980128310 2026-02-25T17:13:46.579 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f197ed9d640 1 --2- 10.20.193.76:0/1597821112 >> v2:10.20.193.76:3300/0 conn(0x7f1980096ed0 0x7f198008f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:46.580 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f9723c31640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f971c0957c0 0x7f971c095b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.580 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f9723c31640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f971c128810 0x7f971c130080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.580 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f9723c31640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971c06d710 con 0x7f971c127cd0 2026-02-25T17:13:46.580 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f9723c31640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971c06aa70 con 0x7f971c128810 2026-02-25T17:13:46.580 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f9723c31640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c0955a0 con 0x7f971c0957c0 2026-02-25T17:13:46.581 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f97219cd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f971c0957c0 0x7f971c095b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.581 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f97219cd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f971c0957c0 0x7f971c095b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:46992/0 (socket says 10.20.193.76:46992) 2026-02-25T17:13:46.581 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f97219cd640 1 -- 10.20.193.76:0/3788079185 learned_addr learned my addr 10.20.193.76:0/3788079185 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:46.581 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f197f59e640 1 --2- 10.20.193.76:0/1597821112 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1980128310 0x7f1980128780 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1978009ec0 tx=0x7f197802f370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf42a2fb62aca093 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.581 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f97211cc640 1 --1- 10.20.193.76:0/3788079185 >> v1:10.20.193.76:6789/0 conn(0x7f971c127cd0 0x7f971c128100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:44580/0 (socket says 10.20.193.76:44580) 2026-02-25T17:13:46.582 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f97221ce640 1 --2- 10.20.193.76:0/3788079185 >> v2:10.20.193.76:3300/0 conn(0x7f971c128810 0x7f971c130080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.582 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.572+0000 7f197dd9b640 1 -- 10.20.193.76:0/1597821112 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197802fe40 con 0x7f1980128310 2026-02-25T17:13:46.582 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f197dd9b640 1 -- 10.20.193.76:0/1597821112 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1978037440 con 0x7f1980128310 2026-02-25T17:13:46.582 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f97219cd640 1 -- 10.20.193.76:0/3788079185 >> v2:10.20.193.76:3300/0 conn(0x7f971c128810 msgr2=0x7f971c130080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:46.583 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f97219cd640 1 --2- 10.20.193.76:0/3788079185 >> v2:10.20.193.76:3300/0 conn(0x7f971c128810 0x7f971c130080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.583 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f197dd9b640 1 -- 10.20.193.76:0/1597821112 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19780377e0 con 0x7f1980128310 2026-02-25T17:13:46.583 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f97219cd640 1 -- 10.20.193.76:0/3788079185 >> v1:10.20.193.76:6789/0 conn(0x7f971c127cd0 legacy=0x7f971c128100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.583 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f97219cd640 1 -- 10.20.193.76:0/3788079185 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c063260 con 0x7f971c0957c0 2026-02-25T17:13:46.584 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f1985193640 1 -- 10.20.193.76:0/1597821112 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1980128310 msgr2=0x7f1980128780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.584 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f1985193640 1 --2- 10.20.193.76:0/1597821112 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1980128310 0x7f1980128780 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1978009ec0 tx=0x7f197802f370 comp rx=0 tx=0).stop 2026-02-25T17:13:46.584 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f1985193640 1 -- 10.20.193.76:0/1597821112 shutdown_connections 2026-02-25T17:13:46.585 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f1985193640 1 --2- 10.20.193.76:0/1597821112 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1980128310 0x7f1980128780 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.585 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f1985193640 1 --2- 10.20.193.76:0/1597821112 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f198008f740 0x7f198008fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.585 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f1985193640 1 --2- 10.20.193.76:0/1597821112 >> v2:10.20.193.76:3300/0 conn(0x7f1980096ed0 0x7f198008f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.585 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f1985193640 1 -- 10.20.193.76:0/1597821112 >> 10.20.193.76:0/1597821112 conn(0x7f1980097e50 msgr2=0x7f1980098250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.585 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f1985193640 1 -- 10.20.193.76:0/1597821112 shutdown_connections 2026-02-25T17:13:46.585 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f1985193640 1 -- 10.20.193.76:0/1597821112 wait complete. 2026-02-25T17:13:46.586 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f97219cd640 1 --2- 10.20.193.76:0/3788079185 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f971c0957c0 0x7f971c095b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9718009940 tx=0x7f971802ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a0aa0a79748d557 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.586 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f97209cb640 1 -- 10.20.193.76:0/3788079185 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971802f9a0 con 0x7f971c0957c0 2026-02-25T17:13:46.586 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f97209cb640 1 -- 10.20.193.76:0/3788079185 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971802fb00 con 0x7f971c0957c0 2026-02-25T17:13:46.586 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f97209cb640 1 -- 10.20.193.76:0/3788079185 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971802fea0 con 0x7f971c0957c0 2026-02-25T17:13:46.587 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f9723c31640 1 -- 10.20.193.76:0/3788079185 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f971c0957c0 msgr2=0x7f971c095b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.587 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f9723c31640 1 --2- 10.20.193.76:0/3788079185 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f971c0957c0 0x7f971c095b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9718009940 tx=0x7f971802ee80 comp rx=0 tx=0).stop 2026-02-25T17:13:46.587 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f9723c31640 1 -- 10.20.193.76:0/3788079185 shutdown_connections 2026-02-25T17:13:46.587 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f9723c31640 1 --2- 10.20.193.76:0/3788079185 >> v2:10.20.193.76:3300/0 conn(0x7f971c128810 0x7f971c130080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.587 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f9723c31640 1 --2- 10.20.193.76:0/3788079185 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f971c0957c0 0x7f971c095b90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.587 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f9723c31640 1 -- 10.20.193.76:0/3788079185 >> 10.20.193.76:0/3788079185 conn(0x7f971c09a580 msgr2=0x7f971c096460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.587 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f9723c31640 1 -- 10.20.193.76:0/3788079185 shutdown_connections 2026-02-25T17:13:46.587 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.573+0000 7f9723c31640 1 -- 10.20.193.76:0/3788079185 wait complete. 2026-02-25T17:13:46.588 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f1985193640 1 Processor -- start 2026-02-25T17:13:46.588 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f1985193640 1 -- start start 2026-02-25T17:13:46.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f1985193640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f198008f740 0x7f19800885e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f1985193640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f1980096ed0 0x7f1980088b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f1985193640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1980128310 0x7f1980089060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f1985193640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198008a2d0 con 0x7f1980096ed0 2026-02-25T17:13:46.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f1985193640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1980089690 con 0x7f1980128310 2026-02-25T17:13:46.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f1985193640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f198008b790 con 0x7f198008f740 2026-02-25T17:13:46.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f197f59e640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1980128310 0x7f1980089060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f197e59c640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f1980096ed0 0x7f1980088b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f197ed9d640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f198008f740 0x7f19800885e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f197f59e640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1980128310 0x7f1980089060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:46996/0 (socket says 10.20.193.76:46996) 2026-02-25T17:13:46.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f197f59e640 1 -- 10.20.193.76:0/3850666125 learned_addr learned my addr 10.20.193.76:0/3850666125 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:46.590 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f9723c31640 1 Processor -- start 2026-02-25T17:13:46.590 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f197f59e640 1 -- 10.20.193.76:0/3850666125 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f198008f740 msgr2=0x7f19800885e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.590 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f197f59e640 1 --2- 10.20.193.76:0/3850666125 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f198008f740 0x7f19800885e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.590 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f197f59e640 1 -- 10.20.193.76:0/3850666125 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f1980096ed0 msgr2=0x7f1980088b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.591 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f9723c31640 1 -- start start 2026-02-25T17:13:46.591 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f197f59e640 1 --2- 10.20.193.76:0/3850666125 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f1980096ed0 0x7f1980088b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.591 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f197f59e640 1 -- 10.20.193.76:0/3850666125 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1970009450 con 0x7f1980128310 2026-02-25T17:13:46.591 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f197f59e640 1 --2- 10.20.193.76:0/3850666125 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1980128310 0x7f1980089060 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1978009de0 tx=0x7f197803a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.592 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f25c860c640 1 Processor -- start 2026-02-25T17:13:46.592 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f19677fe640 1 -- 10.20.193.76:0/3850666125 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19780369e0 con 0x7f1980128310 2026-02-25T17:13:46.592 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f25c860c640 1 -- start start 2026-02-25T17:13:46.592 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f9723c31640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f971c0957c0 0x7f971c1bcc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.593 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f19677fe640 1 -- 10.20.193.76:0/3850666125 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1978036b40 con 0x7f1980128310 2026-02-25T17:13:46.593 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f9723c31640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f971c127cd0 0x7f971c1bd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.593 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f1985193640 1 -- 10.20.193.76:0/3850666125 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1978009a20 con 0x7f1980128310 2026-02-25T17:13:46.594 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f9723c31640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f971c128810 0x7f971c1bd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.594 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f9723c31640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c08a930 con 0x7f971c128810 2026-02-25T17:13:46.594 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f9723c31640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971c08c290 con 0x7f971c0957c0 2026-02-25T17:13:46.594 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f9723c31640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f971c08c530 con 0x7f971c127cd0 2026-02-25T17:13:46.595 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f19677fe640 1 -- 10.20.193.76:0/3850666125 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978041410 con 0x7f1980128310 2026-02-25T17:13:46.595 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f1985193640 1 -- 10.20.193.76:0/3850666125 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198008b1c0 con 0x7f1980128310 2026-02-25T17:13:46.595 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f97219cd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f971c0957c0 0x7f971c1bcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.595 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f97219cd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f971c0957c0 0x7f971c1bcc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:47002/0 (socket says 10.20.193.76:47002) 2026-02-25T17:13:46.596 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f97219cd640 1 -- 10.20.193.76:0/2227759382 learned_addr learned my addr 10.20.193.76:0/2227759382 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:46.596 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f97221ce640 1 --2- 10.20.193.76:0/2227759382 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f971c128810 0x7f971c1bd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.596 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.574+0000 7f97211cc640 1 --2- 10.20.193.76:0/2227759382 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f971c127cd0 0x7f971c1bd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.596 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7fb2d4e31640 1 Processor -- start 2026-02-25T17:13:46.596 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f25c860c640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25c006eb50 0x7f25c006ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.597 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f97221ce640 1 -- 10.20.193.76:0/2227759382 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f971c127cd0 msgr2=0x7f971c1bd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.597 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7fb2d4e31640 1 -- start start 2026-02-25T17:13:46.597 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f25c860c640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f25c012a940 0x7f25c01326a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.598 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f97221ce640 1 --2- 10.20.193.76:0/2227759382 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f971c127cd0 0x7f971c1bd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.598 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f97221ce640 1 -- 10.20.193.76:0/2227759382 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f971c0957c0 msgr2=0x7f971c1bcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.598 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f97221ce640 1 --2- 10.20.193.76:0/2227759382 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f971c0957c0 0x7f971c1bcc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.598 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f97221ce640 1 -- 10.20.193.76:0/2227759382 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9718009450 con 0x7f971c128810 2026-02-25T17:13:46.599 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f25c860c640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c0097a20 con 0x7f25c006f460 2026-02-25T17:13:46.599 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f25c860c640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0090580 con 0x7f25c012a940 2026-02-25T17:13:46.599 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f25c860c640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0068310 con 0x7f25c006eb50 2026-02-25T17:13:46.599 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f25c63a8640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25c006eb50 0x7f25c006ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.599 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f25c5ba7640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f25c006f460 0x7f25c012a230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:44588/0 (socket says 10.20.193.76:44588) 2026-02-25T17:13:46.599 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f25c5ba7640 1 -- 10.20.193.76:0/478714921 learned_addr learned my addr 10.20.193.76:0/478714921 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:13:46.599 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f25c6ba9640 1 --2- 10.20.193.76:0/478714921 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f25c012a940 0x7f25c01326a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.600 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f97221ce640 1 --2- 10.20.193.76:0/2227759382 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f971c128810 0x7f971c1bd6b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9714009e20 tx=0x7f971400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.600 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f1985193640 1 -- 10.20.193.76:0/3850666125 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f19800915a0 con 0x7f1980128310 2026-02-25T17:13:46.600 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f25c63a8640 1 -- 10.20.193.76:0/478714921 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f25c012a940 msgr2=0x7f25c01326a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:46.600 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f25c63a8640 1 --2- 10.20.193.76:0/478714921 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f25c012a940 0x7f25c01326a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.601 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f25c53a6640 1 -- 10.20.193.76:0/478714921 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036865602 0 0) 0x7f25c0097a20 con 0x7f25c006f460 2026-02-25T17:13:46.601 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f25c63a8640 1 -- 10.20.193.76:0/478714921 >> v1:10.20.193.76:6789/0 conn(0x7f25c006f460 legacy=0x7f25c012a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.601 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f25c63a8640 1 -- 10.20.193.76:0/478714921 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c008e200 con 0x7f25c006eb50 2026-02-25T17:13:46.601 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f97127fc640 1 -- 10.20.193.76:0/2227759382 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971400ce20 con 0x7f971c128810 2026-02-25T17:13:46.601 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7fb2d4e31640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb2d0067380 0x7fb2d0067750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.602 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f97127fc640 1 -- 10.20.193.76:0/2227759382 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971400f040 con 0x7f971c128810 2026-02-25T17:13:46.602 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f9723c31640 1 -- 10.20.193.76:0/2227759382 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971c08b100 con 0x7f971c128810 2026-02-25T17:13:46.602 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7fb2d4e31640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb2d0128920 0x7fb2d0130470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.602 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7fb2d4e31640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d0091600 con 0x7fb2d0067c90 2026-02-25T17:13:46.602 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7fb2d4e31640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d0069970 con 0x7fb2d0067380 2026-02-25T17:13:46.603 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f97127fc640 1 -- 10.20.193.76:0/2227759382 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97140146d0 con 0x7f971c128810 2026-02-25T17:13:46.603 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7fb2d4e31640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d0094550 con 0x7fb2d0128920 2026-02-25T17:13:46.603 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f9723c31640 1 -- 10.20.193.76:0/2227759382 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971c0890a0 con 0x7f971c128810 2026-02-25T17:13:46.604 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7fb2cdd9b640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7fb2d0067c90 0x7fb2d0128210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:44592/0 (socket says 10.20.193.76:44592) 2026-02-25T17:13:46.604 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7fb2cdd9b640 1 -- 10.20.193.76:0/4060187452 learned_addr learned my addr 10.20.193.76:0/4060187452 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:13:46.605 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7fb2ced9d640 1 --2- 10.20.193.76:0/4060187452 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb2d0128920 0x7fb2d0130470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.605 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7fb2ce59c640 1 --2- 10.20.193.76:0/4060187452 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb2d0067380 0x7fb2d0067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.605 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7fb2ced9d640 1 -- 10.20.193.76:0/4060187452 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb2d0067380 msgr2=0x7fb2d0067750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:46.605 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7fb2ced9d640 1 --2- 10.20.193.76:0/4060187452 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb2d0067380 0x7fb2d0067750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.605 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7fb2ced9d640 1 -- 10.20.193.76:0/4060187452 >> v1:10.20.193.76:6789/0 conn(0x7fb2d0067c90 legacy=0x7fb2d0128210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.605 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7fb2ced9d640 1 -- 10.20.193.76:0/4060187452 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d00908c0 con 0x7fb2d0128920 2026-02-25T17:13:46.605 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7fb2ce59c640 1 --2- 10.20.193.76:0/4060187452 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb2d0067380 0x7fb2d0067750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-25T17:13:46.605 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f19677fe640 1 -- 10.20.193.76:0/3850666125 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f1978003020 con 0x7f1980128310 2026-02-25T17:13:46.606 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f25c63a8640 1 --2- 10.20.193.76:0/478714921 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25c006eb50 0x7f25c006ef20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009870 tx=0x7f25bc02ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b68e8639b41059 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.606 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f25c53a6640 1 -- 10.20.193.76:0/478714921 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc02f880 con 0x7f25c006eb50 2026-02-25T17:13:46.606 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f25c53a6640 1 -- 10.20.193.76:0/478714921 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25bc02f9e0 con 0x7f25c006eb50 2026-02-25T17:13:46.606 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f25c53a6640 1 -- 10.20.193.76:0/478714921 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc02fd80 con 0x7f25c006eb50 2026-02-25T17:13:46.607 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.575+0000 7f19677fe640 1 -- 10.20.193.76:0/3850666125 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f197802fe40 con 0x7f1980128310 2026-02-25T17:13:46.607 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f9723c31640 1 -- 10.20.193.76:0/2227759382 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f971c071ba0 con 0x7f971c128810 2026-02-25T17:13:46.607 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f19677fe640 1 -- 10.20.193.76:0/3850666125 --> v1:10.20.193.76:6806/43127 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f196c057430 con 0x7f196c053750 2026-02-25T17:13:46.607 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f19677fe640 1 -- 10.20.193.76:0/3850666125 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1978089d70 con 0x7f1980128310 2026-02-25T17:13:46.608 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f25c860c640 1 -- 10.20.193.76:0/478714921 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25c006eb50 msgr2=0x7f25c006ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.608 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f25c860c640 1 --2- 10.20.193.76:0/478714921 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25c006eb50 0x7f25c006ef20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009870 tx=0x7f25bc02ed70 comp rx=0 tx=0).stop 2026-02-25T17:13:46.608 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7fb2ced9d640 1 --2- 10.20.193.76:0/4060187452 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb2d0128920 0x7fb2d0130470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009e90 tx=0x7fb2c802f2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f07e830541a178ea server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.608 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f25c860c640 1 -- 10.20.193.76:0/478714921 shutdown_connections 2026-02-25T17:13:46.609 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f25c860c640 1 --2- 10.20.193.76:0/478714921 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f25c012a940 0x7f25c01326a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.609 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f25c860c640 1 --2- 10.20.193.76:0/478714921 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25c006eb50 0x7f25c006ef20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.609 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f25c860c640 1 -- 10.20.193.76:0/478714921 >> 10.20.193.76:0/478714921 conn(0x7f25c0096f10 msgr2=0x7f25c0097310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.609 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f25c860c640 1 -- 10.20.193.76:0/478714921 shutdown_connections 2026-02-25T17:13:46.609 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f25c860c640 1 -- 10.20.193.76:0/478714921 wait complete. 2026-02-25T17:13:46.609 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f97127fc640 1 -- 10.20.193.76:0/2227759382 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f9714014a40 con 0x7f971c128810 2026-02-25T17:13:46.610 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7fb2cd59a640 1 -- 10.20.193.76:0/4060187452 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c802fe00 con 0x7fb2d0128920 2026-02-25T17:13:46.610 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7fb2cd59a640 1 -- 10.20.193.76:0/4060187452 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c8037440 con 0x7fb2d0128920 2026-02-25T17:13:46.610 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7fb2cd59a640 1 -- 10.20.193.76:0/4060187452 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8037820 con 0x7fb2d0128920 2026-02-25T17:13:46.610 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7fb2d4e31640 1 -- 10.20.193.76:0/4060187452 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb2d0128920 msgr2=0x7fb2d0130470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.610 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7fb2d4e31640 1 --2- 10.20.193.76:0/4060187452 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb2d0128920 0x7fb2d0130470 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009e90 tx=0x7fb2c802f2e0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.610 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f97127fc640 1 -- 10.20.193.76:0/2227759382 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f9714064740 con 0x7f971c128810 2026-02-25T17:13:46.611 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7fb2d4e31640 1 -- 10.20.193.76:0/4060187452 shutdown_connections 2026-02-25T17:13:46.611 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7fb2d4e31640 1 --2- 10.20.193.76:0/4060187452 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb2d0128920 0x7fb2d0130470 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.611 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7fb2d4e31640 1 --2- 10.20.193.76:0/4060187452 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb2d0067380 0x7fb2d0067750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.611 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7fb2d4e31640 1 -- 10.20.193.76:0/4060187452 >> 10.20.193.76:0/4060187452 conn(0x7fb2d0096f10 msgr2=0x7fb2d0097310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.611 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7fb2d4e31640 1 -- 10.20.193.76:0/4060187452 shutdown_connections 2026-02-25T17:13:46.611 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7fb2d4e31640 1 -- 10.20.193.76:0/4060187452 wait complete. 2026-02-25T17:13:46.612 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f97127fc640 1 -- 10.20.193.76:0/2227759382 --> v1:10.20.193.76:6805/43126 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9700057430 con 0x7f9700053750 2026-02-25T17:13:46.612 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f97127fc640 1 -- 10.20.193.76:0/2227759382 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9714066d80 con 0x7f971c128810 2026-02-25T17:13:46.612 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f25c860c640 1 Processor -- start 2026-02-25T17:13:46.612 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f19677fe640 1 -- 10.20.193.76:0/3850666125 <== osd.0 v1:10.20.193.76:6806/43127 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25011 (unknown 0 0 1028417783) 0x7f196c057430 con 0x7f196c053750 2026-02-25T17:13:46.613 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f25c860c640 1 -- start start 2026-02-25T17:13:46.613 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f25c860c640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f25c006eb50 0x7f25c011f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.613 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f25c860c640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25c006f460 0x7f25c011f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.613 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f25c860c640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f25c012a940 0x7f25c011fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.613 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f25c860c640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c012a0b0 con 0x7f25c012a940 2026-02-25T17:13:46.613 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f25c860c640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0099ae0 con 0x7f25c006eb50 2026-02-25T17:13:46.613 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.576+0000 7f25c860c640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25c01219a0 con 0x7f25c006f460 2026-02-25T17:13:46.614 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7f25c5ba7640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25c006f460 0x7f25c011f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.614 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7f25c63a8640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f25c006eb50 0x7f25c011f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.614 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7f25c5ba7640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25c006f460 0x7f25c011f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:54140/0 (socket says 10.20.193.76:54140) 2026-02-25T17:13:46.614 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7f25c5ba7640 1 -- 10.20.193.76:0/3314212304 learned_addr learned my addr 10.20.193.76:0/3314212304 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:46.614 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7f25c6ba9640 1 --2- 10.20.193.76:0/3314212304 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f25c012a940 0x7f25c011fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.614 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2d4e31640 1 Processor -- start 2026-02-25T17:13:46.614 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7f25c5ba7640 1 -- 10.20.193.76:0/3314212304 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f25c006eb50 msgr2=0x7f25c011f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.614 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7f25c5ba7640 1 --2- 10.20.193.76:0/3314212304 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f25c006eb50 0x7f25c011f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.614 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7f25c5ba7640 1 -- 10.20.193.76:0/3314212304 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f25c012a940 msgr2=0x7f25c011fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.614 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7f25c5ba7640 1 --2- 10.20.193.76:0/3314212304 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f25c012a940 0x7f25c011fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.615 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2d4e31640 1 -- start start 2026-02-25T17:13:46.615 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7f25c5ba7640 1 -- 10.20.193.76:0/3314212304 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc009330 con 0x7f25c006f460 2026-02-25T17:13:46.615 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7f25c5ba7640 1 --2- 10.20.193.76:0/3314212304 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25c006f460 0x7f25c011f6c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f25b000c590 tx=0x7f25b0007ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.615 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7f25b6ffd640 1 -- 10.20.193.76:0/3314212304 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0005aa0 con 0x7f25c006f460 2026-02-25T17:13:46.616 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7f25b6ffd640 1 -- 10.20.193.76:0/3314212304 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b0005c20 con 0x7f25c006f460 2026-02-25T17:13:46.616 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7f25c860c640 1 -- 10.20.193.76:0/3314212304 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c0121f40 con 0x7f25c006f460 2026-02-25T17:13:46.616 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7f25b6ffd640 1 -- 10.20.193.76:0/3314212304 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b00070f0 con 0x7f25c006f460 2026-02-25T17:13:46.616 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7f97127fc640 1 -- 10.20.193.76:0/2227759382 <== osd.1 v1:10.20.193.76:6805/43126 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25011 (unknown 0 0 1028417783) 0x7f9700057430 con 0x7f9700053750 2026-02-25T17:13:46.616 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7f25c860c640 1 -- 10.20.193.76:0/3314212304 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c008da50 con 0x7f25c006f460 2026-02-25T17:13:46.617 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2d4e31640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb2d0067380 0x7fb2d011f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.617 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2d4e31640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb2d0067c90 0x7fb2d011fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.617 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2d4e31640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb2d0128920 0x7fb2d01201f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.617 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2d4e31640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d0098620 con 0x7fb2d0067380 2026-02-25T17:13:46.617 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2d4e31640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d0120f30 con 0x7fb2d0067c90 2026-02-25T17:13:46.617 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2d4e31640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d0122ba0 con 0x7fb2d0128920 2026-02-25T17:13:46.617 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2ce59c640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb2d0067380 0x7fb2d011f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.617 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2cdd9b640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb2d0067c90 0x7fb2d011fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.618 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2ce59c640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb2d0067380 0x7fb2d011f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:58214/0 (socket says 10.20.193.76:58214) 2026-02-25T17:13:46.618 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2ce59c640 1 -- 10.20.193.76:0/3331721568 learned_addr learned my addr 10.20.193.76:0/3331721568 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:46.618 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2ced9d640 1 --2- 10.20.193.76:0/3331721568 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb2d0128920 0x7fb2d01201f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.618 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2ce59c640 1 -- 10.20.193.76:0/3331721568 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb2d0128920 msgr2=0x7fb2d01201f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.618 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2ce59c640 1 --2- 10.20.193.76:0/3331721568 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb2d0128920 0x7fb2d01201f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.618 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2ce59c640 1 -- 10.20.193.76:0/3331721568 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb2d0067c90 msgr2=0x7fb2d011fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.618 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2ce59c640 1 --2- 10.20.193.76:0/3331721568 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb2d0067c90 0x7fb2d011fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.618 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2ce59c640 1 -- 10.20.193.76:0/3331721568 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c8009a20 con 0x7fb2d0067380 2026-02-25T17:13:46.618 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2cdd9b640 1 --2- 10.20.193.76:0/3331721568 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb2d0067c90 0x7fb2d011fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:46.618 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7f25c860c640 1 -- 10.20.193.76:0/3314212304 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f25c0071ba0 con 0x7f25c006f460 2026-02-25T17:13:46.619 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2ce59c640 1 --2- 10.20.193.76:0/3331721568 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb2d0067380 0x7fb2d011f770 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000d860 tx=0x7fb2c0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.619 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2beffd640 1 -- 10.20.193.76:0/3331721568 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0005970 con 0x7fb2d0067380 2026-02-25T17:13:46.619 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2beffd640 1 -- 10.20.193.76:0/3331721568 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c0005ad0 con 0x7fb2d0067380 2026-02-25T17:13:46.619 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2d4e31640 1 -- 10.20.193.76:0/3331721568 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d0120730 con 0x7fb2d0067380 2026-02-25T17:13:46.619 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2beffd640 1 -- 10.20.193.76:0/3331721568 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c000b870 con 0x7fb2d0067380 2026-02-25T17:13:46.619 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7fb2d4e31640 1 -- 10.20.193.76:0/3331721568 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d01c4b70 con 0x7fb2d0067380 2026-02-25T17:13:46.620 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.577+0000 7f25b6ffd640 1 -- 10.20.193.76:0/3314212304 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f25b0007520 con 0x7f25c006f460 2026-02-25T17:13:46.620 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.578+0000 7f25b6ffd640 1 -- 10.20.193.76:0/3314212304 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f25b00631b0 con 0x7f25c006f460 2026-02-25T17:13:46.620 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.578+0000 7f25b6ffd640 1 -- 10.20.193.76:0/3314212304 --> v1:10.20.193.76:6801/43129 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25a4057430 con 0x7f25a4053750 2026-02-25T17:13:46.620 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.578+0000 7f25b6ffd640 1 -- 10.20.193.76:0/3314212304 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25b00657f0 con 0x7f25c006f460 2026-02-25T17:13:46.620 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.578+0000 7fb2d4e31640 1 -- 10.20.193.76:0/3331721568 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb2d0071ba0 con 0x7fb2d0067380 2026-02-25T17:13:46.620 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.578+0000 7fb2beffd640 1 -- 10.20.193.76:0/3331721568 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7fb2c000bca0 con 0x7fb2d0067380 2026-02-25T17:13:46.620 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.578+0000 7f25b6ffd640 1 -- 10.20.193.76:0/3314212304 <== osd.3 v1:10.20.193.76:6801/43129 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25011 (unknown 0 0 1028417783) 0x7f25a4057430 con 0x7f25a4053750 2026-02-25T17:13:46.621 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.578+0000 7fb2beffd640 1 -- 10.20.193.76:0/3331721568 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7fb2c0063790 con 0x7fb2d0067380 2026-02-25T17:13:46.621 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.579+0000 7fb2beffd640 1 -- 10.20.193.76:0/3331721568 --> v1:10.20.193.76:6813/43128 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb2b0057430 con 0x7fb2b0053750 2026-02-25T17:13:46.621 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.579+0000 7fb2beffd640 1 -- 10.20.193.76:0/3331721568 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2c0065cf0 con 0x7fb2d0067380 2026-02-25T17:13:46.621 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.579+0000 7fb2beffd640 1 -- 10.20.193.76:0/3331721568 <== osd.2 v1:10.20.193.76:6813/43128 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25011 (unknown 0 0 1028417783) 0x7fb2b0057430 con 0x7fb2b0053750 2026-02-25T17:13:46.621 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.583+0000 7f1985193640 1 -- 10.20.193.76:0/3850666125 --> v1:10.20.193.76:6806/43127 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1980093ea0 con 0x7f196c053750 2026-02-25T17:13:46.621 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.583+0000 7f19677fe640 1 -- 10.20.193.76:0/3850666125 <== osd.0 v1:10.20.193.76:6806/43127 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2217796425) 0x7f1980093ea0 con 0x7f196c053750 2026-02-25T17:13:46.622 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.583+0000 7f1985193640 1 -- 10.20.193.76:0/3850666125 >> v1:10.20.193.76:6806/43127 conn(0x7f196c053750 legacy=0x7f196c055bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.622 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.583+0000 7f1985193640 1 -- 10.20.193.76:0/3850666125 >> v1:10.20.193.76:6800/42442 conn(0x7f196c04d0d0 legacy=0x7f196c04f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.622 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.583+0000 7f1985193640 1 -- 10.20.193.76:0/3850666125 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1980128310 msgr2=0x7f1980089060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.622 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.583+0000 7f1985193640 1 --2- 10.20.193.76:0/3850666125 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1980128310 0x7f1980089060 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1978009de0 tx=0x7f197803a000 comp rx=0 tx=0).stop 2026-02-25T17:13:46.622 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.583+0000 7f197f59e640 1 -- 10.20.193.76:0/3850666125 reap_dead start 2026-02-25T17:13:46.622 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.583+0000 7f1985193640 1 -- 10.20.193.76:0/3850666125 shutdown_connections 2026-02-25T17:13:46.622 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.583+0000 7f1985193640 1 -- 10.20.193.76:0/3850666125 >> 10.20.193.76:0/3850666125 conn(0x7f1980097e50 msgr2=0x7f1980093550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.622 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.583+0000 7f1985193640 1 -- 10.20.193.76:0/3850666125 shutdown_connections 2026-02-25T17:13:46.623 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.583+0000 7f1985193640 1 -- 10.20.193.76:0/3850666125 wait complete. 2026-02-25T17:13:46.623 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.583+0000 7f9723c31640 1 -- 10.20.193.76:0/2227759382 --> v1:10.20.193.76:6805/43126 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f971c064ba0 con 0x7f9700053750 2026-02-25T17:13:46.623 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.583+0000 7f97127fc640 1 -- 10.20.193.76:0/2227759382 <== osd.1 v1:10.20.193.76:6805/43126 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1985699914) 0x7f971c064ba0 con 0x7f9700053750 2026-02-25T17:13:46.624 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.584+0000 7f9723c31640 1 -- 10.20.193.76:0/2227759382 >> v1:10.20.193.76:6805/43126 conn(0x7f9700053750 legacy=0x7f9700055bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.624 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.584+0000 7f9723c31640 1 -- 10.20.193.76:0/2227759382 >> v1:10.20.193.76:6800/42442 conn(0x7f970004d0d0 legacy=0x7f970004f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.624 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.584+0000 7f9723c31640 1 -- 10.20.193.76:0/2227759382 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f971c128810 msgr2=0x7f971c1bd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.624 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.584+0000 7f9723c31640 1 --2- 10.20.193.76:0/2227759382 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f971c128810 0x7f971c1bd6b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9714009e20 tx=0x7f971400b040 comp rx=0 tx=0).stop 2026-02-25T17:13:46.624 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.584+0000 7f97221ce640 1 -- 10.20.193.76:0/2227759382 reap_dead start 2026-02-25T17:13:46.624 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.584+0000 7f9723c31640 1 -- 10.20.193.76:0/2227759382 shutdown_connections 2026-02-25T17:13:46.624 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.584+0000 7f9723c31640 1 -- 10.20.193.76:0/2227759382 >> 10.20.193.76:0/2227759382 conn(0x7f971c09a580 msgr2=0x7f971c120fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.624 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.584+0000 7f9723c31640 1 -- 10.20.193.76:0/2227759382 shutdown_connections 2026-02-25T17:13:46.624 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.584+0000 7f9723c31640 1 -- 10.20.193.76:0/2227759382 wait complete. 2026-02-25T17:13:46.624 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.584+0000 7f25c860c640 1 -- 10.20.193.76:0/3314212304 --> v1:10.20.193.76:6801/43129 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f25c005e030 con 0x7f25a4053750 2026-02-25T17:13:46.624 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.584+0000 7f25b6ffd640 1 -- 10.20.193.76:0/3314212304 <== osd.3 v1:10.20.193.76:6801/43129 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1985699914) 0x7f25c005e030 con 0x7f25a4053750 2026-02-25T17:13:46.625 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.585+0000 7f25c860c640 1 -- 10.20.193.76:0/3314212304 >> v1:10.20.193.76:6801/43129 conn(0x7f25a4053750 legacy=0x7f25a4055bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.625 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.585+0000 7f25c860c640 1 -- 10.20.193.76:0/3314212304 >> v1:10.20.193.76:6800/42442 conn(0x7f25a404d0d0 legacy=0x7f25a404f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.625 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.585+0000 7f25c860c640 1 -- 10.20.193.76:0/3314212304 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25c006f460 msgr2=0x7f25c011f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.625 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.585+0000 7f25c860c640 1 --2- 10.20.193.76:0/3314212304 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f25c006f460 0x7f25c011f6c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f25b000c590 tx=0x7f25b0007ca0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.625 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.585+0000 7f25c6ba9640 1 -- 10.20.193.76:0/3314212304 reap_dead start 2026-02-25T17:13:46.625 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.585+0000 7f25c860c640 1 -- 10.20.193.76:0/3314212304 shutdown_connections 2026-02-25T17:13:46.625 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.585+0000 7f25c860c640 1 -- 10.20.193.76:0/3314212304 >> 10.20.193.76:0/3314212304 conn(0x7f25c0096f10 msgr2=0x7f25c008f210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.625 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.585+0000 7f25c860c640 1 -- 10.20.193.76:0/3314212304 shutdown_connections 2026-02-25T17:13:46.626 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.585+0000 7f25c860c640 1 -- 10.20.193.76:0/3314212304 wait complete. 2026-02-25T17:13:46.626 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.585+0000 7fb2d4e31640 1 -- 10.20.193.76:0/3331721568 --> v1:10.20.193.76:6813/43128 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb2d006f520 con 0x7fb2b0053750 2026-02-25T17:13:46.626 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.585+0000 7fb2beffd640 1 -- 10.20.193.76:0/3331721568 <== osd.2 v1:10.20.193.76:6813/43128 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1985699914) 0x7fb2d006f520 con 0x7fb2b0053750 2026-02-25T17:13:46.626 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.585+0000 7fb2d4e31640 1 -- 10.20.193.76:0/3331721568 >> v1:10.20.193.76:6813/43128 conn(0x7fb2b0053750 legacy=0x7fb2b0055bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.627 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.586+0000 7fb2d4e31640 1 -- 10.20.193.76:0/3331721568 >> v1:10.20.193.76:6800/42442 conn(0x7fb2b004d0d0 legacy=0x7fb2b004f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.627 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.586+0000 7fb2d4e31640 1 -- 10.20.193.76:0/3331721568 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb2d0067380 msgr2=0x7fb2d011f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.627 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.586+0000 7fb2d4e31640 1 --2- 10.20.193.76:0/3331721568 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb2d0067380 0x7fb2d011f770 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000d860 tx=0x7fb2c0008040 comp rx=0 tx=0).stop 2026-02-25T17:13:46.627 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.586+0000 7fb2ced9d640 1 -- 10.20.193.76:0/3331721568 reap_dead start 2026-02-25T17:13:46.627 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.586+0000 7fb2d4e31640 1 -- 10.20.193.76:0/3331721568 shutdown_connections 2026-02-25T17:13:46.627 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.586+0000 7fb2d4e31640 1 -- 10.20.193.76:0/3331721568 >> 10.20.193.76:0/3331721568 conn(0x7fb2d0096f10 msgr2=0x7fb2d006eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.627 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.586+0000 7fb2d4e31640 1 -- 10.20.193.76:0/3331721568 shutdown_connections 2026-02-25T17:13:46.627 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.586+0000 7fb2d4e31640 1 -- 10.20.193.76:0/3331721568 wait complete. 2026-02-25T17:13:46.627 INFO:teuthology.orchestra.run.trial076.stdout:38654705667 2026-02-25T17:13:46.628 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-25T17:13:46.628 INFO:teuthology.orchestra.run.trial076.stdout:38654705666 2026-02-25T17:13:46.629 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-25T17:13:46.629 INFO:teuthology.orchestra.run.trial076.stdout:38654705666 2026-02-25T17:13:46.629 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-25T17:13:46.630 INFO:teuthology.orchestra.run.trial076.stdout:38654705666 2026-02-25T17:13:46.630 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-25T17:13:46.733 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.729+0000 7f9736cdb640 1 Processor -- start 2026-02-25T17:13:46.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.729+0000 7f9736cdb640 1 -- start start 2026-02-25T17:13:46.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.729+0000 7f9736cdb640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9730096cb0 0x7f9730097080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.729+0000 7f9736cdb640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f97300975c0 0x7f9730129ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.729+0000 7f9736cdb640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9730099350 con 0x7f9730097990 2026-02-25T17:13:46.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.729+0000 7f9736cdb640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973009a4a0 con 0x7f97300975c0 2026-02-25T17:13:46.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.729+0000 7f9736cdb640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973009a6a0 con 0x7f9730096cb0 2026-02-25T17:13:46.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.729+0000 7f9734a77640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9730096cb0 0x7f9730097080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.729+0000 7f972ffff640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f97300975c0 0x7f9730129ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.729+0000 7f9735278640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f9730097990 0x7f973012a430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:44608/0 (socket says 10.20.193.76:44608) 2026-02-25T17:13:46.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.729+0000 7f9734a77640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9730096cb0 0x7f9730097080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:47048/0 (socket says 10.20.193.76:47048) 2026-02-25T17:13:46.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.729+0000 7f972ffff640 1 --2- 10.20.193.76:0/1223212062 >> v2:10.20.193.76:3300/0 conn(0x7f97300975c0 0x7f9730129ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:58230/0 (socket says 10.20.193.76:58230) 2026-02-25T17:13:46.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.729+0000 7f9735278640 1 -- 10.20.193.76:0/1223212062 learned_addr learned my addr 10.20.193.76:0/1223212062 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:13:46.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.729+0000 7f972ffff640 1 -- 10.20.193.76:0/1223212062 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9730096cb0 msgr2=0x7f9730097080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:46.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.729+0000 7f972ffff640 1 --2- 10.20.193.76:0/1223212062 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9730096cb0 0x7f9730097080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.729+0000 7f972ffff640 1 -- 10.20.193.76:0/1223212062 >> v1:10.20.193.76:6789/0 conn(0x7f9730097990 legacy=0x7f973012a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.729+0000 7f972ffff640 1 -- 10.20.193.76:0/1223212062 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973009a010 con 0x7f97300975c0 2026-02-25T17:13:46.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f615409b640 1 Processor -- start 2026-02-25T17:13:46.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f615409b640 1 -- start start 2026-02-25T17:13:46.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f972ffff640 1 --2- 10.20.193.76:0/1223212062 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f97300975c0 0x7f9730129ef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f971c009850 tx=0x7f971c02ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64164152d1ddc841 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f972f7fe640 1 -- 10.20.193.76:0/1223212062 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971c02f8b0 con 0x7f97300975c0 2026-02-25T17:13:46.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f972f7fe640 1 -- 10.20.193.76:0/1223212062 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971c02fa10 con 0x7f97300975c0 2026-02-25T17:13:46.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f972f7fe640 1 -- 10.20.193.76:0/1223212062 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971c02fdf0 con 0x7f97300975c0 2026-02-25T17:13:46.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f615409b640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f614c098df0 0x7f614c06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f615409b640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f614c06dd10 0x7f614c06e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f615409b640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614c088c30 con 0x7f614c12c650 2026-02-25T17:13:46.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f615409b640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f614c06ac90 con 0x7f614c098df0 2026-02-25T17:13:46.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f615409b640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f614c088340 con 0x7f614c06dd10 2026-02-25T17:13:46.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f6151e37640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f614c098df0 0x7f614c06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.738 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f9736cdb640 1 -- 10.20.193.76:0/1223212062 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f97300975c0 msgr2=0x7f9730129ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.738 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f9736cdb640 1 --2- 10.20.193.76:0/1223212062 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f97300975c0 0x7f9730129ef0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f971c009850 tx=0x7f971c02ed50 comp rx=0 tx=0).stop 2026-02-25T17:13:46.738 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f6151e37640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f614c098df0 0x7f614c06d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:58244/0 (socket says 10.20.193.76:58244) 2026-02-25T17:13:46.739 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f6151e37640 1 -- 10.20.193.76:0/2006805286 learned_addr learned my addr 10.20.193.76:0/2006805286 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:46.739 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f6151636640 1 --2- 10.20.193.76:0/2006805286 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f614c06dd10 0x7f614c06e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.739 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f9736cdb640 1 -- 10.20.193.76:0/1223212062 shutdown_connections 2026-02-25T17:13:46.739 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f9736cdb640 1 --2- 10.20.193.76:0/1223212062 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f97300975c0 0x7f9730129ef0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.740 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f9736cdb640 1 --2- 10.20.193.76:0/1223212062 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9730096cb0 0x7f9730097080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.740 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f9736cdb640 1 -- 10.20.193.76:0/1223212062 >> 10.20.193.76:0/1223212062 conn(0x7f973009dac0 msgr2=0x7f973009dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.740 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f9736cdb640 1 -- 10.20.193.76:0/1223212062 shutdown_connections 2026-02-25T17:13:46.740 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f9736cdb640 1 -- 10.20.193.76:0/1223212062 wait complete. 2026-02-25T17:13:46.740 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f6151e37640 1 -- 10.20.193.76:0/2006805286 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f614c06dd10 msgr2=0x7f614c06e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:46.740 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f6151e37640 1 --2- 10.20.193.76:0/2006805286 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f614c06dd10 0x7f614c06e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.740 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f6151e37640 1 -- 10.20.193.76:0/2006805286 >> v1:10.20.193.76:6789/0 conn(0x7f614c12c650 legacy=0x7f614c12ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.741 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f6151e37640 1 -- 10.20.193.76:0/2006805286 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c06e880 con 0x7f614c098df0 2026-02-25T17:13:46.741 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f984b231640 1 Processor -- start 2026-02-25T17:13:46.741 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.730+0000 7f984b231640 1 -- start start 2026-02-25T17:13:46.741 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f6151e37640 1 --2- 10.20.193.76:0/2006805286 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f614c098df0 0x7f614c06d7d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6148009910 tx=0x7f614802eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c731082fab82a7a server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.742 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f984b231640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f984406dee0 0x7f984412d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.742 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f6150e35640 1 -- 10.20.193.76:0/2006805286 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614802fa10 con 0x7f614c098df0 2026-02-25T17:13:46.742 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f984b231640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f984406e350 0x7f984412fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.743 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f6150e35640 1 -- 10.20.193.76:0/2006805286 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614802fb70 con 0x7f614c098df0 2026-02-25T17:13:46.743 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f984b231640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9844088c30 con 0x7f9844098df0 2026-02-25T17:13:46.743 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f984b231640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984406ac90 con 0x7f984406dee0 2026-02-25T17:13:46.743 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f6150e35640 1 -- 10.20.193.76:0/2006805286 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6148037440 con 0x7f614c098df0 2026-02-25T17:13:46.744 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f984b231640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9844088340 con 0x7f984406e350 2026-02-25T17:13:46.744 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9736cdb640 1 Processor -- start 2026-02-25T17:13:46.744 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9848fcd640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f9844098df0 0x7f984406d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:44620/0 (socket says 10.20.193.76:44620) 2026-02-25T17:13:46.744 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9848fcd640 1 -- 10.20.193.76:0/3343359109 learned_addr learned my addr 10.20.193.76:0/3343359109 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:13:46.745 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9843fff640 1 --2- 10.20.193.76:0/3343359109 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f984406dee0 0x7f984412d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.745 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f98497ce640 1 --2- 10.20.193.76:0/3343359109 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f984406e350 0x7f984412fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.745 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9736cdb640 1 -- start start 2026-02-25T17:13:46.745 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f98437fe640 1 -- 10.20.193.76:0/3343359109 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672075389 0 0) 0x7f9844088c30 con 0x7f9844098df0 2026-02-25T17:13:46.746 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f615409b640 1 -- 10.20.193.76:0/2006805286 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f614c098df0 msgr2=0x7f614c06d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.746 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f615409b640 1 --2- 10.20.193.76:0/2006805286 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f614c098df0 0x7f614c06d7d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6148009910 tx=0x7f614802eeb0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.747 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f98437fe640 1 -- 10.20.193.76:0/3343359109 --> v1:10.20.193.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98340034e0 con 0x7f9844098df0 2026-02-25T17:13:46.747 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9843fff640 1 -- 10.20.193.76:0/3343359109 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f984406e350 msgr2=0x7f984412fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:46.747 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9843fff640 1 --2- 10.20.193.76:0/3343359109 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f984406e350 0x7f984412fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.747 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9843fff640 1 -- 10.20.193.76:0/3343359109 >> v1:10.20.193.76:6789/0 conn(0x7f9844098df0 legacy=0x7f984406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.747 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9843fff640 1 -- 10.20.193.76:0/3343359109 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984406e880 con 0x7f984406dee0 2026-02-25T17:13:46.748 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f98497ce640 1 --2- 10.20.193.76:0/3343359109 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f984406e350 0x7f984412fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:46.748 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f615409b640 1 -- 10.20.193.76:0/2006805286 shutdown_connections 2026-02-25T17:13:46.748 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f615409b640 1 --2- 10.20.193.76:0/2006805286 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f614c06dd10 0x7f614c06e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.748 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f615409b640 1 --2- 10.20.193.76:0/2006805286 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f614c098df0 0x7f614c06d7d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.748 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f615409b640 1 -- 10.20.193.76:0/2006805286 >> 10.20.193.76:0/2006805286 conn(0x7f614c09a130 msgr2=0x7f614c06b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.749 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f615409b640 1 -- 10.20.193.76:0/2006805286 shutdown_connections 2026-02-25T17:13:46.749 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f615409b640 1 -- 10.20.193.76:0/2006805286 wait complete. 2026-02-25T17:13:46.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9736cdb640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9730096cb0 0x7f973012d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9736cdb640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f97300975c0 0x7f973012fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9736cdb640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f9730097990 0x7f97301301f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9736cdb640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973012dcf0 con 0x7f9730097990 2026-02-25T17:13:46.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9736cdb640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973012f9f0 con 0x7f97300975c0 2026-02-25T17:13:46.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9736cdb640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f973012f620 con 0x7f9730096cb0 2026-02-25T17:13:46.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9734a77640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9730096cb0 0x7f973012d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9735278640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f9730097990 0x7f97301301f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f972ffff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f97300975c0 0x7f973012fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9734a77640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9730096cb0 0x7f973012d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:54184/0 (socket says 10.20.193.76:54184) 2026-02-25T17:13:46.751 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f972ffff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f97300975c0 0x7f973012fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:47056/0 (socket says 10.20.193.76:47056) 2026-02-25T17:13:46.751 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9735278640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f9730097990 0x7f97301301f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:58254/0 (socket says 10.20.193.76:58254) 2026-02-25T17:13:46.751 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9734a77640 1 -- 10.20.193.76:0/3238868814 learned_addr learned my addr 10.20.193.76:0/3238868814 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:46.751 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9734a77640 1 -- 10.20.193.76:0/3238868814 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f97300975c0 msgr2=0x7f973012fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.751 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9734a77640 1 --2- 10.20.193.76:0/3238868814 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f97300975c0 0x7f973012fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.751 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9734a77640 1 -- 10.20.193.76:0/3238868814 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f9730097990 msgr2=0x7f97301301f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.751 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9843fff640 1 --2- 10.20.193.76:0/3343359109 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f984406dee0 0x7f984412d660 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9830009880 tx=0x7f983002ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b27d0406913541a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.752 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9734a77640 1 --2- 10.20.193.76:0/3238868814 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f9730097990 0x7f97301301f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.752 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9734a77640 1 -- 10.20.193.76:0/3238868814 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971c009390 con 0x7f9730096cb0 2026-02-25T17:13:46.752 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9735278640 1 --2- 10.20.193.76:0/3238868814 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f9730097990 0x7f97301301f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:46.752 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f98437fe640 1 -- 10.20.193.76:0/3343359109 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983002f920 con 0x7f984406dee0 2026-02-25T17:13:46.753 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f98437fe640 1 -- 10.20.193.76:0/3343359109 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983002fa80 con 0x7f984406dee0 2026-02-25T17:13:46.753 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f98437fe640 1 -- 10.20.193.76:0/3343359109 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983002fe20 con 0x7f984406dee0 2026-02-25T17:13:46.753 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.731+0000 7f9734a77640 1 --2- 10.20.193.76:0/3238868814 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9730096cb0 0x7f973012d220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f972400e930 tx=0x7f97240090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.754 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f972d7fa640 1 -- 10.20.193.76:0/3238868814 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972400c8e0 con 0x7f9730096cb0 2026-02-25T17:13:46.754 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f972d7fa640 1 -- 10.20.193.76:0/3238868814 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972400ca40 con 0x7f9730096cb0 2026-02-25T17:13:46.754 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f9736cdb640 1 -- 10.20.193.76:0/3238868814 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9730131860 con 0x7f9730096cb0 2026-02-25T17:13:46.754 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f972d7fa640 1 -- 10.20.193.76:0/3238868814 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972400cdc0 con 0x7f9730096cb0 2026-02-25T17:13:46.754 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f9736cdb640 1 -- 10.20.193.76:0/3238868814 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9730130730 con 0x7f9730096cb0 2026-02-25T17:13:46.754 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f984b231640 1 -- 10.20.193.76:0/3343359109 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f984406dee0 msgr2=0x7f984412d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.754 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f984b231640 1 --2- 10.20.193.76:0/3343359109 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f984406dee0 0x7f984412d660 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9830009880 tx=0x7f983002ee10 comp rx=0 tx=0).stop 2026-02-25T17:13:46.755 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f615409b640 1 Processor -- start 2026-02-25T17:13:46.755 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f984b231640 1 -- 10.20.193.76:0/3343359109 shutdown_connections 2026-02-25T17:13:46.755 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7fce38c9b640 1 Processor -- start 2026-02-25T17:13:46.756 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f984b231640 1 --2- 10.20.193.76:0/3343359109 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f984406e350 0x7f984412fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.756 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f984b231640 1 --2- 10.20.193.76:0/3343359109 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f984406dee0 0x7f984412d660 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.756 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f984b231640 1 -- 10.20.193.76:0/3343359109 >> 10.20.193.76:0/3343359109 conn(0x7f984409a130 msgr2=0x7f984406b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.756 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7fce38c9b640 1 -- start start 2026-02-25T17:13:46.756 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f984b231640 1 -- 10.20.193.76:0/3343359109 shutdown_connections 2026-02-25T17:13:46.757 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f615409b640 1 -- start start 2026-02-25T17:13:46.757 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f984b231640 1 -- 10.20.193.76:0/3343359109 wait complete. 2026-02-25T17:13:46.758 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7fce38c9b640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce34096730 0x7fce3412d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.758 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7fce38c9b640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce3412d920 0x7fce3412fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.758 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7fce38c9b640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce340918f0 con 0x7fce34095c50 2026-02-25T17:13:46.758 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7fce38c9b640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce34096b20 con 0x7fce3412d920 2026-02-25T17:13:46.758 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7fce38c9b640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce340678b0 con 0x7fce34096730 2026-02-25T17:13:46.758 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f615409b640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f614c06dd10 0x7f614c08c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.759 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f615409b640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f614c098df0 0x7f614c08c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.759 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7fce3259c640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7fce34095c50 0x7fce34096020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:44630/0 (socket says 10.20.193.76:44630) 2026-02-25T17:13:46.759 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7fce31d9b640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce34096730 0x7fce3412d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.759 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7fce3259c640 1 -- 10.20.193.76:0/389403178 learned_addr learned my addr 10.20.193.76:0/389403178 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:13:46.759 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7fce32d9d640 1 --2- 10.20.193.76:0/389403178 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce3412d920 0x7fce3412fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.760 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f615409b640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f614c12c650 0x7f614c08cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.760 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f615409b640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c069fe0 con 0x7f614c12c650 2026-02-25T17:13:46.760 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f615409b640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c06a2a0 con 0x7f614c06dd10 2026-02-25T17:13:46.760 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f615409b640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f614c069c10 con 0x7f614c098df0 2026-02-25T17:13:46.760 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f6151636640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f614c098df0 0x7f614c08c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.760 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f6152638640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f614c12c650 0x7f614c08cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.760 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f6151e37640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f614c06dd10 0x7f614c08c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.760 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f6151636640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f614c098df0 0x7f614c08c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:54200/0 (socket says 10.20.193.76:54200) 2026-02-25T17:13:46.760 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f6151636640 1 -- 10.20.193.76:0/2431491149 learned_addr learned my addr 10.20.193.76:0/2431491149 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:46.761 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f6152638640 1 --2- 10.20.193.76:0/2431491149 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f614c12c650 0x7f614c08cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:58260/0 (socket says 10.20.193.76:58260) 2026-02-25T17:13:46.761 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f9736cdb640 1 -- 10.20.193.76:0/3238868814 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9730064c00 con 0x7f9730096cb0 2026-02-25T17:13:46.761 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7fce31d9b640 1 -- 10.20.193.76:0/389403178 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce3412d920 msgr2=0x7fce3412fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:46.761 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7fce31d9b640 1 --2- 10.20.193.76:0/389403178 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce3412d920 0x7fce3412fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.762 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7fce31d9b640 1 -- 10.20.193.76:0/389403178 >> v1:10.20.193.76:6789/0 conn(0x7fce34095c50 legacy=0x7fce34096020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.762 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7fce3159a640 1 -- 10.20.193.76:0/389403178 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468650067 0 0) 0x7fce340918f0 con 0x7fce34095c50 2026-02-25T17:13:46.762 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7fce31d9b640 1 -- 10.20.193.76:0/389403178 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce34090ed0 con 0x7fce34096730 2026-02-25T17:13:46.762 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f6152638640 1 -- 10.20.193.76:0/2431491149 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f614c098df0 msgr2=0x7f614c08c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.762 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f6152638640 1 --2- 10.20.193.76:0/2431491149 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f614c098df0 0x7f614c08c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.763 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f6152638640 1 -- 10.20.193.76:0/2431491149 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f614c06dd10 msgr2=0x7f614c08c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.763 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f6152638640 1 --2- 10.20.193.76:0/2431491149 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f614c06dd10 0x7f614c08c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.763 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f6152638640 1 -- 10.20.193.76:0/2431491149 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6148009450 con 0x7f614c12c650 2026-02-25T17:13:46.763 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f984b231640 1 Processor -- start 2026-02-25T17:13:46.763 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f6152638640 1 --2- 10.20.193.76:0/2431491149 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f614c12c650 0x7f614c08cca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6144007fd0 tx=0x7f6144001660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.764 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f984b231640 1 -- start start 2026-02-25T17:13:46.764 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.732+0000 7f61427fc640 1 -- 10.20.193.76:0/2431491149 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614400a820 con 0x7f614c12c650 2026-02-25T17:13:46.764 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f61427fc640 1 -- 10.20.193.76:0/2431491149 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614400a9a0 con 0x7f614c12c650 2026-02-25T17:13:46.764 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f615409b640 1 -- 10.20.193.76:0/2431491149 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614c128160 con 0x7f614c12c650 2026-02-25T17:13:46.765 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f61427fc640 1 -- 10.20.193.76:0/2431491149 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614400ada0 con 0x7f614c12c650 2026-02-25T17:13:46.765 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f972d7fa640 1 -- 10.20.193.76:0/3238868814 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f9724013680 con 0x7f9730096cb0 2026-02-25T17:13:46.765 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f615409b640 1 -- 10.20.193.76:0/2431491149 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614c08d380 con 0x7f614c12c650 2026-02-25T17:13:46.765 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7fce31d9b640 1 --2- 10.20.193.76:0/389403178 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce34096730 0x7fce3412d3e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fce28009880 tx=0x7fce2802ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9ce2ebd1787fb98 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.766 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f984b231640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f984406dee0 0x7f98440694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.766 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f984b231640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f984406e350 0x7f9844096750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.766 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f984b231640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f9844098df0 0x7f9844096c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.766 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f984b231640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9844095c30 con 0x7f9844098df0 2026-02-25T17:13:46.766 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f984b231640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984406a040 con 0x7f984406e350 2026-02-25T17:13:46.766 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f984b231640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9844096490 con 0x7f984406dee0 2026-02-25T17:13:46.767 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f9848fcd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f984406dee0 0x7f98440694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.767 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f9843fff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f984406e350 0x7f9844096750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.767 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f9848fcd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f984406dee0 0x7f98440694a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:54212/0 (socket says 10.20.193.76:54212) 2026-02-25T17:13:46.767 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f9843fff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f984406e350 0x7f9844096750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:47082/0 (socket says 10.20.193.76:47082) 2026-02-25T17:13:46.767 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f9848fcd640 1 -- 10.20.193.76:0/3752132672 learned_addr learned my addr 10.20.193.76:0/3752132672 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:46.767 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f972d7fa640 1 -- 10.20.193.76:0/3238868814 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f9724063a70 con 0x7f9730096cb0 2026-02-25T17:13:46.768 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f9848fcd640 1 -- 10.20.193.76:0/3752132672 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f984406e350 msgr2=0x7f9844096750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.768 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f9848fcd640 1 --2- 10.20.193.76:0/3752132672 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f984406e350 0x7f9844096750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.768 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f9848fcd640 1 -- 10.20.193.76:0/3752132672 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f9844098df0 msgr2=0x7f9844096c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.768 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f9848fcd640 1 --2- 10.20.193.76:0/3752132672 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f9844098df0 0x7f9844096c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.768 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f9848fcd640 1 -- 10.20.193.76:0/3752132672 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c009a20 con 0x7f984406dee0 2026-02-25T17:13:46.768 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f9848fcd640 1 --2- 10.20.193.76:0/3752132672 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f984406dee0 0x7f98440694a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f983800c560 tx=0x7f9838007d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.768 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.733+0000 7f61427fc640 1 -- 10.20.193.76:0/2431491149 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f6144003030 con 0x7f614c12c650 2026-02-25T17:13:46.768 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.734+0000 7f61427fc640 1 -- 10.20.193.76:0/2431491149 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f6144063860 con 0x7f614c12c650 2026-02-25T17:13:46.768 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.735+0000 7fce3159a640 1 -- 10.20.193.76:0/389403178 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2802f890 con 0x7fce34096730 2026-02-25T17:13:46.769 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.735+0000 7f98417fa640 1 -- 10.20.193.76:0/3752132672 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838005aa0 con 0x7f984406dee0 2026-02-25T17:13:46.769 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.735+0000 7fce3159a640 1 -- 10.20.193.76:0/389403178 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2802f9f0 con 0x7fce34096730 2026-02-25T17:13:46.769 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.735+0000 7fce3159a640 1 -- 10.20.193.76:0/389403178 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2802fd90 con 0x7fce34096730 2026-02-25T17:13:46.769 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.735+0000 7f984b231640 1 -- 10.20.193.76:0/3752132672 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9830009390 con 0x7f984406dee0 2026-02-25T17:13:46.769 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.735+0000 7f972d7fa640 1 -- 10.20.193.76:0/3238868814 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f972403e900 con 0x7f9730096cb0 2026-02-25T17:13:46.770 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.735+0000 7f984b231640 1 -- 10.20.193.76:0/3752132672 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98440971d0 con 0x7f984406dee0 2026-02-25T17:13:46.770 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.735+0000 7f98417fa640 1 -- 10.20.193.76:0/3752132672 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9838005e10 con 0x7f984406dee0 2026-02-25T17:13:46.770 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.735+0000 7f98417fa640 1 -- 10.20.193.76:0/3752132672 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98380070f0 con 0x7f984406dee0 2026-02-25T17:13:46.771 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.735+0000 7fce38c9b640 1 -- 10.20.193.76:0/389403178 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce34096730 msgr2=0x7fce3412d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.771 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.735+0000 7fce38c9b640 1 --2- 10.20.193.76:0/389403178 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce34096730 0x7fce3412d3e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fce28009880 tx=0x7fce2802ed80 comp rx=0 tx=0).stop 2026-02-25T17:13:46.771 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.735+0000 7fce38c9b640 1 -- 10.20.193.76:0/389403178 shutdown_connections 2026-02-25T17:13:46.771 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.735+0000 7fce38c9b640 1 --2- 10.20.193.76:0/389403178 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce3412d920 0x7fce3412fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.771 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.735+0000 7fce38c9b640 1 --2- 10.20.193.76:0/389403178 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce34096730 0x7fce3412d3e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.771 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.735+0000 7fce38c9b640 1 -- 10.20.193.76:0/389403178 >> 10.20.193.76:0/389403178 conn(0x7fce34096d40 msgr2=0x7fce34097140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.771 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.735+0000 7fce38c9b640 1 -- 10.20.193.76:0/389403178 shutdown_connections 2026-02-25T17:13:46.771 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.735+0000 7fce38c9b640 1 -- 10.20.193.76:0/389403178 wait complete. 2026-02-25T17:13:46.771 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.735+0000 7f615409b640 1 -- 10.20.193.76:0/2431491149 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614c08d600 con 0x7f614c12c650 2026-02-25T17:13:46.772 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.735+0000 7f984b231640 1 -- 10.20.193.76:0/3752132672 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9824005210 con 0x7f984406dee0 2026-02-25T17:13:46.772 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.735+0000 7f98417fa640 1 -- 10.20.193.76:0/3752132672 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f98380074e0 con 0x7f984406dee0 2026-02-25T17:13:46.772 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce38c9b640 1 Processor -- start 2026-02-25T17:13:46.772 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce38c9b640 1 -- start start 2026-02-25T17:13:46.772 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7f98417fa640 1 -- 10.20.193.76:0/3752132672 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f9838062c50 con 0x7f984406dee0 2026-02-25T17:13:46.774 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce38c9b640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce34095c50 0x7fce3408bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.774 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce38c9b640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fce34096730 0x7fce3408c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.774 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce38c9b640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce3412d920 0x7fce3408c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:46.774 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce38c9b640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3411fe50 con 0x7fce34096730 2026-02-25T17:13:46.774 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce38c9b640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce34120420 con 0x7fce3412d920 2026-02-25T17:13:46.774 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce38c9b640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce34093320 con 0x7fce34095c50 2026-02-25T17:13:46.774 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce3259c640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce34095c50 0x7fce3408bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.774 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce32d9d640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce3412d920 0x7fce3408c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.774 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce31d9b640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fce34096730 0x7fce3408c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:46.774 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce32d9d640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce3412d920 0x7fce3408c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:47090/0 (socket says 10.20.193.76:47090) 2026-02-25T17:13:46.774 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce32d9d640 1 -- 10.20.193.76:0/2192268463 learned_addr learned my addr 10.20.193.76:0/2192268463 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:46.774 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce31d9b640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fce34096730 0x7fce3408c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:58274/0 (socket says 10.20.193.76:58274) 2026-02-25T17:13:46.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce32d9d640 1 -- 10.20.193.76:0/2192268463 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce34095c50 msgr2=0x7fce3408bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce32d9d640 1 --2- 10.20.193.76:0/2192268463 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce34095c50 0x7fce3408bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce32d9d640 1 -- 10.20.193.76:0/2192268463 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fce34096730 msgr2=0x7fce3408c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce32d9d640 1 --2- 10.20.193.76:0/2192268463 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fce34096730 0x7fce3408c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce32d9d640 1 -- 10.20.193.76:0/2192268463 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce28009390 con 0x7fce3412d920 2026-02-25T17:13:46.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce31d9b640 1 --2- 10.20.193.76:0/2192268463 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fce34096730 0x7fce3408c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:46.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce3259c640 1 --2- 10.20.193.76:0/2192268463 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce34095c50 0x7fce3408bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:46.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce32d9d640 1 --2- 10.20.193.76:0/2192268463 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce3412d920 0x7fce3408c600 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fce2c009ef0 tx=0x7fce2c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:46.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce22ffd640 1 -- 10.20.193.76:0/2192268463 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c00ce80 con 0x7fce3412d920 2026-02-25T17:13:46.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce22ffd640 1 -- 10.20.193.76:0/2192268463 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c00f040 con 0x7fce3412d920 2026-02-25T17:13:46.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce38c9b640 1 -- 10.20.193.76:0/2192268463 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3408d660 con 0x7fce3412d920 2026-02-25T17:13:46.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce22ffd640 1 -- 10.20.193.76:0/2192268463 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c0146d0 con 0x7fce3412d920 2026-02-25T17:13:46.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.736+0000 7fce38c9b640 1 -- 10.20.193.76:0/2192268463 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3408cb40 con 0x7fce3412d920 2026-02-25T17:13:46.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.737+0000 7fce22ffd640 1 -- 10.20.193.76:0/2192268463 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7fce2c014a80 con 0x7fce3412d920 2026-02-25T17:13:46.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.737+0000 7fce38c9b640 1 -- 10.20.193.76:0/2192268463 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce340647c0 con 0x7fce3412d920 2026-02-25T17:13:46.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.737+0000 7fce22ffd640 1 -- 10.20.193.76:0/2192268463 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7fce2c0647e0 con 0x7fce3412d920 2026-02-25T17:13:46.776 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.737+0000 7f98417fa640 1 -- 10.20.193.76:0/3752132672 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f983803dac0 con 0x7f984406dee0 2026-02-25T17:13:46.776 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.738+0000 7f61427fc640 1 -- 10.20.193.76:0/2431491149 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f614403e650 con 0x7f614c12c650 2026-02-25T17:13:46.776 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.739+0000 7fce22ffd640 1 -- 10.20.193.76:0/2192268463 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7fce2c03f670 con 0x7fce3412d920 2026-02-25T17:13:46.801 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.797+0000 7f9736cdb640 1 -- 10.20.193.76:0/3238868814 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9730063e70 con 0x7f9730096cb0 2026-02-25T17:13:46.801 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.797+0000 7f972d7fa640 1 -- 10.20.193.76:0/3238868814 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9724042110 con 0x7f9730096cb0 2026-02-25T17:13:46.801 INFO:teuthology.orchestra.run.trial076.stdout:38654705666 2026-02-25T17:13:46.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.798+0000 7f9736cdb640 1 -- 10.20.193.76:0/3238868814 >> v1:10.20.193.76:6800/42442 conn(0x7f971404d0d0 legacy=0x7f971404f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.798+0000 7f9736cdb640 1 -- 10.20.193.76:0/3238868814 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9730096cb0 msgr2=0x7f973012d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.798+0000 7f9736cdb640 1 --2- 10.20.193.76:0/3238868814 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9730096cb0 0x7f973012d220 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f972400e930 tx=0x7f97240090f0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.798+0000 7f9736cdb640 1 -- 10.20.193.76:0/3238868814 shutdown_connections 2026-02-25T17:13:46.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.798+0000 7f9736cdb640 1 --2- 10.20.193.76:0/3238868814 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f9730097990 0x7f97301301f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.798+0000 7f9736cdb640 1 --2- 10.20.193.76:0/3238868814 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f97300975c0 0x7f973012fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.798+0000 7f9736cdb640 1 --2- 10.20.193.76:0/3238868814 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9730096cb0 0x7f973012d220 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.798+0000 7f9736cdb640 1 -- 10.20.193.76:0/3238868814 >> 10.20.193.76:0/3238868814 conn(0x7f973009dac0 msgr2=0x7f9730124ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.798+0000 7f9736cdb640 1 -- 10.20.193.76:0/3238868814 shutdown_connections 2026-02-25T17:13:46.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.798+0000 7f9736cdb640 1 -- 10.20.193.76:0/3238868814 wait complete. 2026-02-25T17:13:46.804 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.800+0000 7f984b231640 1 -- 10.20.193.76:0/3752132672 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f98240054c0 con 0x7f984406dee0 2026-02-25T17:13:46.804 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.800+0000 7f98417fa640 1 -- 10.20.193.76:0/3752132672 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9838017020 con 0x7f984406dee0 2026-02-25T17:13:46.804 INFO:teuthology.orchestra.run.trial076.stdout:38654705665 2026-02-25T17:13:46.805 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.801+0000 7f615409b640 1 -- 10.20.193.76:0/2431491149 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f614c0647c0 con 0x7f614c12c650 2026-02-25T17:13:46.805 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.801+0000 7f61427fc640 1 -- 10.20.193.76:0/2431491149 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6144041e60 con 0x7f614c12c650 2026-02-25T17:13:46.805 INFO:teuthology.orchestra.run.trial076.stdout:38654705665 2026-02-25T17:13:46.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.802+0000 7f984b231640 1 -- 10.20.193.76:0/3752132672 >> v1:10.20.193.76:6800/42442 conn(0x7f982804d0d0 legacy=0x7f982804f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.802+0000 7f984b231640 1 -- 10.20.193.76:0/3752132672 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f984406dee0 msgr2=0x7f98440694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.802+0000 7f984b231640 1 --2- 10.20.193.76:0/3752132672 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f984406dee0 0x7f98440694a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f983800c560 tx=0x7f9838007d00 comp rx=0 tx=0).stop 2026-02-25T17:13:46.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.802+0000 7f984b231640 1 -- 10.20.193.76:0/3752132672 shutdown_connections 2026-02-25T17:13:46.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.802+0000 7f984b231640 1 --2- 10.20.193.76:0/3752132672 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f9844098df0 0x7f9844096c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.802+0000 7f984b231640 1 --2- 10.20.193.76:0/3752132672 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f984406e350 0x7f9844096750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.802+0000 7f984b231640 1 --2- 10.20.193.76:0/3752132672 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f984406dee0 0x7f98440694a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.802+0000 7f984b231640 1 -- 10.20.193.76:0/3752132672 >> 10.20.193.76:0/3752132672 conn(0x7f984409a130 msgr2=0x7f984408c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.802+0000 7f984b231640 1 -- 10.20.193.76:0/3752132672 shutdown_connections 2026-02-25T17:13:46.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.802+0000 7f984b231640 1 -- 10.20.193.76:0/3752132672 wait complete. 2026-02-25T17:13:46.807 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.803+0000 7f615409b640 1 -- 10.20.193.76:0/2431491149 >> v1:10.20.193.76:6800/42442 conn(0x7f613004d0d0 legacy=0x7f613004f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.807 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.803+0000 7f615409b640 1 -- 10.20.193.76:0/2431491149 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f614c12c650 msgr2=0x7f614c08cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.807 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.803+0000 7f615409b640 1 --2- 10.20.193.76:0/2431491149 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f614c12c650 0x7f614c08cca0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6144007fd0 tx=0x7f6144001660 comp rx=0 tx=0).stop 2026-02-25T17:13:46.807 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.803+0000 7f615409b640 1 -- 10.20.193.76:0/2431491149 shutdown_connections 2026-02-25T17:13:46.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.803+0000 7f615409b640 1 --2- 10.20.193.76:0/2431491149 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f614c12c650 0x7f614c08cca0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.803+0000 7f615409b640 1 --2- 10.20.193.76:0/2431491149 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f614c098df0 0x7f614c08c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.803+0000 7f615409b640 1 --2- 10.20.193.76:0/2431491149 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f614c06dd10 0x7f614c08c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.803+0000 7f615409b640 1 -- 10.20.193.76:0/2431491149 >> 10.20.193.76:0/2431491149 conn(0x7f614c09a130 msgr2=0x7f614c128840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.803+0000 7f615409b640 1 -- 10.20.193.76:0/2431491149 shutdown_connections 2026-02-25T17:13:46.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.803+0000 7fce38c9b640 1 -- 10.20.193.76:0/2192268463 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fce34068e50 con 0x7fce3412d920 2026-02-25T17:13:46.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.803+0000 7f615409b640 1 -- 10.20.193.76:0/2431491149 wait complete. 2026-02-25T17:13:46.809 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.803+0000 7fce22ffd640 1 -- 10.20.193.76:0/2192268463 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fce2c018030 con 0x7fce3412d920 2026-02-25T17:13:46.809 INFO:teuthology.orchestra.run.trial076.stdout:38654705665 2026-02-25T17:13:46.810 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.805+0000 7fce38c9b640 1 -- 10.20.193.76:0/2192268463 >> v1:10.20.193.76:6800/42442 conn(0x7fce1404d0d0 legacy=0x7fce1404f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.810 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.805+0000 7fce38c9b640 1 -- 10.20.193.76:0/2192268463 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce3412d920 msgr2=0x7fce3408c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:46.810 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.805+0000 7fce38c9b640 1 --2- 10.20.193.76:0/2192268463 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce3412d920 0x7fce3408c600 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fce2c009ef0 tx=0x7fce2c00b040 comp rx=0 tx=0).stop 2026-02-25T17:13:46.811 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.805+0000 7fce38c9b640 1 -- 10.20.193.76:0/2192268463 shutdown_connections 2026-02-25T17:13:46.811 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.805+0000 7fce38c9b640 1 --2- 10.20.193.76:0/2192268463 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce3412d920 0x7fce3408c600 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.811 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.805+0000 7fce38c9b640 1 --2- 10.20.193.76:0/2192268463 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fce34096730 0x7fce3408c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.811 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.805+0000 7fce38c9b640 1 --2- 10.20.193.76:0/2192268463 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce34095c50 0x7fce3408bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:46.811 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.805+0000 7fce38c9b640 1 -- 10.20.193.76:0/2192268463 >> 10.20.193.76:0/2192268463 conn(0x7fce34096d40 msgr2=0x7fce3406c920 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:46.811 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.805+0000 7fce38c9b640 1 -- 10.20.193.76:0/2192268463 shutdown_connections 2026-02-25T17:13:46.811 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:46.805+0000 7fce38c9b640 1 -- 10.20.193.76:0/2192268463 wait complete. 2026-02-25T17:13:46.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.0 2026-02-25T17:13:46.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705665 for osd.3 2026-02-25T17:13:46.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705665 for osd.1 2026-02-25T17:13:46.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705665 for osd.2 2026-02-25T17:13:47.814 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-25T17:13:47.815 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-25T17:13:47.816 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-25T17:13:47.818 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-25T17:13:47.882 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f0351cc7640 1 Processor -- start 2026-02-25T17:13:47.882 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f0351cc7640 1 -- start start 2026-02-25T17:13:47.882 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f80726db640 1 Processor -- start 2026-02-25T17:13:47.882 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f80726db640 1 -- start start 2026-02-25T17:13:47.883 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f0351cc7640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f034c096cb0 0x7f034c097080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.883 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f0351cc7640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f034c0975c0 0x7f034c129ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.883 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f0351cc7640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f034c097990 0x7f034c12a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.883 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f0351cc7640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034c09a4a0 con 0x7f034c097990 2026-02-25T17:13:47.884 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f0351cc7640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034c099350 con 0x7f034c0975c0 2026-02-25T17:13:47.884 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f0351cc7640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f034c09a6a0 con 0x7f034c096cb0 2026-02-25T17:13:47.884 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f80726db640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f806c090750 0x7f806c12d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.884 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f80726db640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f806c08fdf0 0x7f806c12f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.884 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f80726db640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f806c091550 con 0x7f806c08f310 2026-02-25T17:13:47.884 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f80726db640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f806c091800 con 0x7f806c08fdf0 2026-02-25T17:13:47.885 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f80726db640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f806c090ec0 con 0x7f806c090750 2026-02-25T17:13:47.885 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f034bfff640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f034c097990 0x7f034c12a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.885 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f0342dff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f034c0975c0 0x7f034c129ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.885 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f034b7fe640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f034c096cb0 0x7f034c097080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.885 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f806bfff640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f806c08f310 0x7f806c08f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:50932/0 (socket says 10.20.193.76:50932) 2026-02-25T17:13:47.885 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f806bfff640 1 -- 10.20.193.76:0/10217768 learned_addr learned my addr 10.20.193.76:0/10217768 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:13:47.886 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f0342dff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f034c0975c0 0x7f034c129ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:47692/0 (socket says 10.20.193.76:47692) 2026-02-25T17:13:47.886 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f034bfff640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f034c097990 0x7f034c12a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:40128/0 (socket says 10.20.193.76:40128) 2026-02-25T17:13:47.886 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f0342dff640 1 -- 10.20.193.76:0/4289184206 learned_addr learned my addr 10.20.193.76:0/4289184206 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:47.887 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f80635ff640 1 --2- 10.20.193.76:0/10217768 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f806c090750 0x7f806c12d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.887 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f8070c78640 1 --2- 10.20.193.76:0/10217768 >> v2:10.20.193.76:3300/0 conn(0x7f806c08fdf0 0x7f806c12f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.887 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f0342dff640 1 -- 10.20.193.76:0/4289184206 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f034c096cb0 msgr2=0x7f034c097080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:47.888 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f0342dff640 1 --2- 10.20.193.76:0/4289184206 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f034c096cb0 0x7f034c097080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.888 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f0342dff640 1 -- 10.20.193.76:0/4289184206 >> v2:10.20.193.76:3300/0 conn(0x7f034c097990 msgr2=0x7f034c12a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:47.888 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f0342dff640 1 --2- 10.20.193.76:0/4289184206 >> v2:10.20.193.76:3300/0 conn(0x7f034c097990 0x7f034c12a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.888 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f0342dff640 1 -- 10.20.193.76:0/4289184206 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034c09a010 con 0x7f034c0975c0 2026-02-25T17:13:47.888 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f034bfff640 1 --2- 10.20.193.76:0/4289184206 >> v2:10.20.193.76:3300/0 conn(0x7f034c097990 0x7f034c12a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:47.888 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f806b7fe640 1 -- 10.20.193.76:0/10217768 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764528737 0 0) 0x7f806c091550 con 0x7f806c08f310 2026-02-25T17:13:47.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f80635ff640 1 -- 10.20.193.76:0/10217768 >> v2:10.20.193.76:3300/0 conn(0x7f806c08fdf0 msgr2=0x7f806c12f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:47.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f80635ff640 1 --2- 10.20.193.76:0/10217768 >> v2:10.20.193.76:3300/0 conn(0x7f806c08fdf0 0x7f806c12f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f80635ff640 1 -- 10.20.193.76:0/10217768 >> v1:10.20.193.76:6789/0 conn(0x7f806c08f310 legacy=0x7f806c08f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.878+0000 7f80635ff640 1 -- 10.20.193.76:0/10217768 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806c096f00 con 0x7f806c090750 2026-02-25T17:13:47.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f1cf13ae640 1 Processor -- start 2026-02-25T17:13:47.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f1cf13ae640 1 -- start start 2026-02-25T17:13:47.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f80635ff640 1 --2- 10.20.193.76:0/10217768 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f806c090750 0x7f806c12d450 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8054009880 tx=0x7f805402ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2ad7f17ee33d000 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:47.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f806b7fe640 1 -- 10.20.193.76:0/10217768 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805402f8a0 con 0x7f806c090750 2026-02-25T17:13:47.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f1cf13ae640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1cec096360 0x7f1cec12f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f0342dff640 1 --2- 10.20.193.76:0/4289184206 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f034c0975c0 0x7f034c129ef0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0334009940 tx=0x7f033402ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3687535f82c8b356 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:47.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f1cf13ae640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f1cec096750 0x7f1cec131b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f1cf13ae640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cec067580 con 0x7f1cec06ed20 2026-02-25T17:13:47.892 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f1cf13ae640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cec067820 con 0x7f1cec096750 2026-02-25T17:13:47.892 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f1cf13ae640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec067db0 con 0x7f1cec096360 2026-02-25T17:13:47.892 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f806b7fe640 1 -- 10.20.193.76:0/10217768 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805402fa00 con 0x7f806c090750 2026-02-25T17:13:47.892 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f806b7fe640 1 -- 10.20.193.76:0/10217768 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805402fda0 con 0x7f806c090750 2026-02-25T17:13:47.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f1ceaffd640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f1cec06ed20 0x7f1cec095c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:50936/0 (socket says 10.20.193.76:50936) 2026-02-25T17:13:47.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f1ce3fff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1cec096360 0x7f1cec12f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f1ceaffd640 1 -- 10.20.193.76:0/1667475214 learned_addr learned my addr 10.20.193.76:0/1667475214 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:13:47.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f1ceb7fe640 1 --2- 10.20.193.76:0/1667475214 >> v2:10.20.193.76:3300/0 conn(0x7f1cec096750 0x7f1cec131b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f034affd640 1 -- 10.20.193.76:0/4289184206 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033402f950 con 0x7f034c0975c0 2026-02-25T17:13:47.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f034affd640 1 -- 10.20.193.76:0/4289184206 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033402fab0 con 0x7f034c0975c0 2026-02-25T17:13:47.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f034affd640 1 -- 10.20.193.76:0/4289184206 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033402fe50 con 0x7f034c0975c0 2026-02-25T17:13:47.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f1cea7fc640 1 -- 10.20.193.76:0/1667475214 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096483147 0 0) 0x7f1cec067580 con 0x7f1cec06ed20 2026-02-25T17:13:47.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f1cea7fc640 1 -- 10.20.193.76:0/1667475214 --> v1:10.20.193.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cd80034e0 con 0x7f1cec06ed20 2026-02-25T17:13:47.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f80726db640 1 -- 10.20.193.76:0/10217768 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f806c090750 msgr2=0x7f806c12d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.895 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f80726db640 1 --2- 10.20.193.76:0/10217768 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f806c090750 0x7f806c12d450 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8054009880 tx=0x7f805402ed80 comp rx=0 tx=0).stop 2026-02-25T17:13:47.895 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f1ce3fff640 1 -- 10.20.193.76:0/1667475214 >> v2:10.20.193.76:3300/0 conn(0x7f1cec096750 msgr2=0x7f1cec131b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:47.895 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f1ce3fff640 1 --2- 10.20.193.76:0/1667475214 >> v2:10.20.193.76:3300/0 conn(0x7f1cec096750 0x7f1cec131b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.895 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f1ce3fff640 1 -- 10.20.193.76:0/1667475214 >> v1:10.20.193.76:6789/0 conn(0x7f1cec06ed20 legacy=0x7f1cec095c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.895 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f1ce3fff640 1 -- 10.20.193.76:0/1667475214 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec08e3a0 con 0x7f1cec096360 2026-02-25T17:13:47.896 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f80726db640 1 -- 10.20.193.76:0/10217768 shutdown_connections 2026-02-25T17:13:47.896 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f80726db640 1 --2- 10.20.193.76:0/10217768 >> v2:10.20.193.76:3300/0 conn(0x7f806c08fdf0 0x7f806c12f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.896 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f80726db640 1 --2- 10.20.193.76:0/10217768 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f806c090750 0x7f806c12d450 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.896 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f80726db640 1 -- 10.20.193.76:0/10217768 >> 10.20.193.76:0/10217768 conn(0x7f806c09bf00 msgr2=0x7f806c097dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:47.897 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f80726db640 1 -- 10.20.193.76:0/10217768 shutdown_connections 2026-02-25T17:13:47.897 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f80726db640 1 -- 10.20.193.76:0/10217768 wait complete. 2026-02-25T17:13:47.897 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f0351cc7640 1 -- 10.20.193.76:0/4289184206 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f034c0975c0 msgr2=0x7f034c129ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.898 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f0351cc7640 1 --2- 10.20.193.76:0/4289184206 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f034c0975c0 0x7f034c129ef0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0334009940 tx=0x7f033402ee80 comp rx=0 tx=0).stop 2026-02-25T17:13:47.898 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f0351cc7640 1 -- 10.20.193.76:0/4289184206 shutdown_connections 2026-02-25T17:13:47.898 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f0351cc7640 1 --2- 10.20.193.76:0/4289184206 >> v2:10.20.193.76:3300/0 conn(0x7f034c097990 0x7f034c12a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.898 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f0351cc7640 1 --2- 10.20.193.76:0/4289184206 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f034c0975c0 0x7f034c129ef0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.898 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f0351cc7640 1 --2- 10.20.193.76:0/4289184206 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f034c096cb0 0x7f034c097080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.898 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f0351cc7640 1 -- 10.20.193.76:0/4289184206 >> 10.20.193.76:0/4289184206 conn(0x7f034c09dac0 msgr2=0x7f034c09dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:47.898 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f0351cc7640 1 -- 10.20.193.76:0/4289184206 shutdown_connections 2026-02-25T17:13:47.898 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.879+0000 7f0351cc7640 1 -- 10.20.193.76:0/4289184206 wait complete. 2026-02-25T17:13:47.899 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f1ce3fff640 1 --2- 10.20.193.76:0/1667475214 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1cec096360 0x7f1cec12f610 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009850 tx=0x7f1cd402ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8887b5ab69339daa server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:47.899 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f1cea7fc640 1 -- 10.20.193.76:0/1667475214 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd402f8b0 con 0x7f1cec096360 2026-02-25T17:13:47.899 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f1cea7fc640 1 -- 10.20.193.76:0/1667475214 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd402fa10 con 0x7f1cec096360 2026-02-25T17:13:47.899 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f1cea7fc640 1 -- 10.20.193.76:0/1667475214 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd402fdb0 con 0x7f1cec096360 2026-02-25T17:13:47.899 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f80726db640 1 Processor -- start 2026-02-25T17:13:47.900 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f0351cc7640 1 Processor -- start 2026-02-25T17:13:47.900 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f80726db640 1 -- start start 2026-02-25T17:13:47.901 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f0351cc7640 1 -- start start 2026-02-25T17:13:47.902 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f1cf13ae640 1 -- 10.20.193.76:0/1667475214 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1cec096360 msgr2=0x7f1cec12f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.902 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f1cf13ae640 1 --2- 10.20.193.76:0/1667475214 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1cec096360 0x7f1cec12f610 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009850 tx=0x7f1cd402ed50 comp rx=0 tx=0).stop 2026-02-25T17:13:47.902 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f1cf13ae640 1 -- 10.20.193.76:0/1667475214 shutdown_connections 2026-02-25T17:13:47.902 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f1cf13ae640 1 --2- 10.20.193.76:0/1667475214 >> v2:10.20.193.76:3300/0 conn(0x7f1cec096750 0x7f1cec131b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.903 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f1cf13ae640 1 --2- 10.20.193.76:0/1667475214 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1cec096360 0x7f1cec12f610 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.903 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f1cf13ae640 1 -- 10.20.193.76:0/1667475214 >> 10.20.193.76:0/1667475214 conn(0x7f1cec096d40 msgr2=0x7f1cec097140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:47.904 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f80726db640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f806c08f310 0x7f806c1203a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.904 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f80726db640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f806c08fdf0 0x7f806c1208e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.904 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f80726db640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f806c090750 0x7f806c120e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.905 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f80726db640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806c122130 con 0x7f806c090750 2026-02-25T17:13:47.905 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f80726db640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806c0951b0 con 0x7f806c08f310 2026-02-25T17:13:47.905 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f80726db640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f806c1229b0 con 0x7f806c08fdf0 2026-02-25T17:13:47.906 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f1cf13ae640 1 -- 10.20.193.76:0/1667475214 shutdown_connections 2026-02-25T17:13:47.906 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f1cf13ae640 1 -- 10.20.193.76:0/1667475214 wait complete. 2026-02-25T17:13:47.907 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f806bfff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f806c08f310 0x7f806c1203a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.907 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f8070c78640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f806c090750 0x7f806c120e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.907 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f80635ff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f806c08fdf0 0x7f806c1208e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.907 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f806bfff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f806c08f310 0x7f806c1203a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:47700/0 (socket says 10.20.193.76:47700) 2026-02-25T17:13:47.908 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f8070c78640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f806c090750 0x7f806c120e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:40156/0 (socket says 10.20.193.76:40156) 2026-02-25T17:13:47.908 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f806bfff640 1 -- 10.20.193.76:0/795736021 learned_addr learned my addr 10.20.193.76:0/795736021 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:47.909 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f0351cc7640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f034c096cb0 0x7f034c11a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.909 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f0351cc7640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f034c0975c0 0x7f034c11a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.909 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f0351cc7640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f034c097990 0x7f034c1be3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.910 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f0351cc7640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034c11ce30 con 0x7f034c097990 2026-02-25T17:13:47.910 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f0351cc7640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034c11b0d0 con 0x7f034c096cb0 2026-02-25T17:13:47.910 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f0351cc7640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f034c11cac0 con 0x7f034c0975c0 2026-02-25T17:13:47.911 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f8070c78640 1 -- 10.20.193.76:0/795736021 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f806c08fdf0 msgr2=0x7f806c1208e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.911 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f8070c78640 1 --2- 10.20.193.76:0/795736021 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f806c08fdf0 0x7f806c1208e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.911 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f8070c78640 1 -- 10.20.193.76:0/795736021 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f806c08f310 msgr2=0x7f806c1203a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.912 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f8070c78640 1 --2- 10.20.193.76:0/795736021 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f806c08f310 0x7f806c1203a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.912 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f8070c78640 1 -- 10.20.193.76:0/795736021 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8054009390 con 0x7f806c090750 2026-02-25T17:13:47.912 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f80635ff640 1 --2- 10.20.193.76:0/795736021 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f806c08fdf0 0x7f806c1208e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:47.913 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f034bfff640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f034c097990 0x7f034c1be3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.913 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f0342dff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f034c0975c0 0x7f034c11a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.913 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f034bfff640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f034c097990 0x7f034c1be3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:40162/0 (socket says 10.20.193.76:40162) 2026-02-25T17:13:47.914 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f034bfff640 1 -- 10.20.193.76:0/1801293426 learned_addr learned my addr 10.20.193.76:0/1801293426 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:47.914 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f034b7fe640 1 --2- 10.20.193.76:0/1801293426 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f034c096cb0 0x7f034c11a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.914 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.880+0000 7f8070c78640 1 --2- 10.20.193.76:0/795736021 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f806c090750 0x7f806c120e20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8064009e50 tx=0x7f806400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:47.915 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f80697fa640 1 -- 10.20.193.76:0/795736021 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806400ce20 con 0x7f806c090750 2026-02-25T17:13:47.915 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f034bfff640 1 -- 10.20.193.76:0/1801293426 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f034c0975c0 msgr2=0x7f034c11a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.916 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f034bfff640 1 --2- 10.20.193.76:0/1801293426 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f034c0975c0 0x7f034c11a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.916 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f034bfff640 1 -- 10.20.193.76:0/1801293426 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f034c096cb0 msgr2=0x7f034c11a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.916 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f034bfff640 1 --2- 10.20.193.76:0/1801293426 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f034c096cb0 0x7f034c11a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.917 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f80697fa640 1 -- 10.20.193.76:0/795736021 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806400f040 con 0x7f806c090750 2026-02-25T17:13:47.917 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f034bfff640 1 -- 10.20.193.76:0/1801293426 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0344009a20 con 0x7f034c097990 2026-02-25T17:13:47.917 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f0342dff640 1 --2- 10.20.193.76:0/1801293426 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f034c0975c0 0x7f034c11a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:47.918 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f80726db640 1 -- 10.20.193.76:0/795736021 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f806c06f580 con 0x7f806c090750 2026-02-25T17:13:47.918 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f80697fa640 1 -- 10.20.193.76:0/795736021 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80640146d0 con 0x7f806c090750 2026-02-25T17:13:47.919 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f80726db640 1 -- 10.20.193.76:0/795736021 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f806c06ec00 con 0x7f806c090750 2026-02-25T17:13:47.919 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f034bfff640 1 --2- 10.20.193.76:0/1801293426 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f034c097990 0x7f034c1be3a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0344009fc0 tx=0x7f034400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:47.920 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1cf13ae640 1 Processor -- start 2026-02-25T17:13:47.920 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1cf13ae640 1 -- start start 2026-02-25T17:13:47.921 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f0348ff9640 1 -- 10.20.193.76:0/1801293426 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0344009d20 con 0x7f034c097990 2026-02-25T17:13:47.921 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f0348ff9640 1 -- 10.20.193.76:0/1801293426 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034400f040 con 0x7f034c097990 2026-02-25T17:13:47.921 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1cf13ae640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1cec06ed20 0x7f1cec11f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.922 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f0351cc7640 1 -- 10.20.193.76:0/1801293426 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0334009450 con 0x7f034c097990 2026-02-25T17:13:47.922 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1cf13ae640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f1cec096360 0x7f1cec11f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.923 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f0348ff9640 1 -- 10.20.193.76:0/1801293426 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03440146d0 con 0x7f034c097990 2026-02-25T17:13:47.923 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1cf13ae640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1cec096750 0x7f1cec11fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.923 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f0351cc7640 1 -- 10.20.193.76:0/1801293426 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034c11ab40 con 0x7f034c097990 2026-02-25T17:13:47.924 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1cf13ae640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec122810 con 0x7f1cec096360 2026-02-25T17:13:47.925 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1cf13ae640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec122030 con 0x7f1cec096750 2026-02-25T17:13:47.925 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1cf13ae640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec131020 con 0x7f1cec06ed20 2026-02-25T17:13:47.925 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1ceaffd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1cec06ed20 0x7f1cec11f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.925 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1ceb7fe640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1cec096750 0x7f1cec11fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.925 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1ceaffd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1cec06ed20 0x7f1cec11f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:56372/0 (socket says 10.20.193.76:56372) 2026-02-25T17:13:47.925 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1ceb7fe640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1cec096750 0x7f1cec11fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:47714/0 (socket says 10.20.193.76:47714) 2026-02-25T17:13:47.925 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1ceaffd640 1 -- 10.20.193.76:0/1654955612 learned_addr learned my addr 10.20.193.76:0/1654955612 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:47.925 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1ce3fff640 1 --2- 10.20.193.76:0/1654955612 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f1cec096360 0x7f1cec11f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.926 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f80726db640 1 -- 10.20.193.76:0/795736021 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f806c064c00 con 0x7f806c090750 2026-02-25T17:13:47.926 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1ceaffd640 1 -- 10.20.193.76:0/1654955612 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1cec096750 msgr2=0x7f1cec11fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.926 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1ceaffd640 1 --2- 10.20.193.76:0/1654955612 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1cec096750 0x7f1cec11fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.927 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1ceaffd640 1 -- 10.20.193.76:0/1654955612 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f1cec096360 msgr2=0x7f1cec11f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.927 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f80697fa640 1 -- 10.20.193.76:0/795736021 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f8064014a40 con 0x7f806c090750 2026-02-25T17:13:47.928 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1ceaffd640 1 --2- 10.20.193.76:0/1654955612 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f1cec096360 0x7f1cec11f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.928 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1ceaffd640 1 -- 10.20.193.76:0/1654955612 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd4009390 con 0x7f1cec06ed20 2026-02-25T17:13:47.928 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1ceb7fe640 1 --2- 10.20.193.76:0/1654955612 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1cec096750 0x7f1cec11fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:47.928 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1ceaffd640 1 --2- 10.20.193.76:0/1654955612 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1cec06ed20 0x7f1cec11f3b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00c560 tx=0x7f1cdc007d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:47.928 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1ce37fe640 1 -- 10.20.193.76:0/1654955612 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc005aa0 con 0x7f1cec06ed20 2026-02-25T17:13:47.928 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1ce37fe640 1 -- 10.20.193.76:0/1654955612 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc005c00 con 0x7f1cec06ed20 2026-02-25T17:13:47.928 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1ce37fe640 1 -- 10.20.193.76:0/1654955612 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc0070f0 con 0x7f1cec06ed20 2026-02-25T17:13:47.928 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.881+0000 7f1cf13ae640 1 -- 10.20.193.76:0/1654955612 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cec122be0 con 0x7f1cec06ed20 2026-02-25T17:13:47.928 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.882+0000 7f1cf13ae640 1 -- 10.20.193.76:0/1654955612 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cec131b20 con 0x7f1cec06ed20 2026-02-25T17:13:47.929 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.882+0000 7f0351cc7640 1 -- 10.20.193.76:0/1801293426 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034c11b970 con 0x7f034c097990 2026-02-25T17:13:47.929 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.882+0000 7f0348ff9640 1 -- 10.20.193.76:0/1801293426 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f0344003020 con 0x7f034c097990 2026-02-25T17:13:47.929 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.882+0000 7f80697fa640 1 -- 10.20.193.76:0/795736021 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f8064064870 con 0x7f806c090750 2026-02-25T17:13:47.929 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.882+0000 7f0348ff9640 1 -- 10.20.193.76:0/1801293426 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f03440644f0 con 0x7f034c097990 2026-02-25T17:13:47.930 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.882+0000 7f1cf13ae640 1 -- 10.20.193.76:0/1654955612 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cec0647c0 con 0x7f1cec06ed20 2026-02-25T17:13:47.930 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.882+0000 7f1ce37fe640 1 -- 10.20.193.76:0/1654955612 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f1cdc007520 con 0x7f1cec06ed20 2026-02-25T17:13:47.930 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.883+0000 7f1ce37fe640 1 -- 10.20.193.76:0/1654955612 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f1cdc062c30 con 0x7f1cec06ed20 2026-02-25T17:13:47.930 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.884+0000 7f80697fa640 1 -- 10.20.193.76:0/795736021 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f806403f490 con 0x7f806c090750 2026-02-25T17:13:47.930 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.884+0000 7f1ce37fe640 1 -- 10.20.193.76:0/1654955612 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f1cdc03dae0 con 0x7f1cec06ed20 2026-02-25T17:13:47.930 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.885+0000 7f0348ff9640 1 -- 10.20.193.76:0/1801293426 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f034403f2e0 con 0x7f034c097990 2026-02-25T17:13:47.933 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.923+0000 7f4f2016e640 1 Processor -- start 2026-02-25T17:13:47.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.923+0000 7f4f2016e640 1 -- start start 2026-02-25T17:13:47.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f2016e640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f4f18096cb0 0x7f4f18097080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f2016e640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f4f180975c0 0x7f4f18129ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f2016e640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f4f18097990 0x7f4f1812a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f2016e640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1809a4a0 con 0x7f4f18096cb0 2026-02-25T17:13:47.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f2016e640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f18099350 con 0x7f4f180975c0 2026-02-25T17:13:47.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f2016e640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1809a6a0 con 0x7f4f18097990 2026-02-25T17:13:47.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f1df0a640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f4f18096cb0 0x7f4f18097080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f1df0a640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f4f18096cb0 0x7f4f18097080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:40190/0 (socket says 10.20.193.76:40190) 2026-02-25T17:13:47.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f1df0a640 1 -- 10.20.193.76:0/1411149855 learned_addr learned my addr 10.20.193.76:0/1411149855 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:47.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f1e70b640 1 --2- 10.20.193.76:0/1411149855 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f4f18097990 0x7f4f1812a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f1d709640 1 --2- 10.20.193.76:0/1411149855 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f4f180975c0 0x7f4f18129ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f1df0a640 1 -- 10.20.193.76:0/1411149855 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f4f18097990 msgr2=0x7f4f1812a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:47.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f1df0a640 1 --2- 10.20.193.76:0/1411149855 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f4f18097990 0x7f4f1812a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f1df0a640 1 -- 10.20.193.76:0/1411149855 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f4f180975c0 msgr2=0x7f4f18129ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:47.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f1df0a640 1 --2- 10.20.193.76:0/1411149855 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f4f180975c0 0x7f4f18129ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f1df0a640 1 -- 10.20.193.76:0/1411149855 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1809a010 con 0x7f4f18096cb0 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f1e70b640 1 --2- 10.20.193.76:0/1411149855 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f4f18097990 0x7f4f1812a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f1df0a640 1 --2- 10.20.193.76:0/1411149855 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4f18096cb0 0x7f4f18097080 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009910 tx=0x7f4f1402ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a19c5869b9345e server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f1cf08640 1 -- 10.20.193.76:0/1411149855 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1402f920 con 0x7f4f18096cb0 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f1cf08640 1 -- 10.20.193.76:0/1411149855 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1402fa80 con 0x7f4f18096cb0 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.924+0000 7f4f1cf08640 1 -- 10.20.193.76:0/1411149855 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1402fe20 con 0x7f4f18096cb0 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.925+0000 7f4f2016e640 1 -- 10.20.193.76:0/1411149855 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4f18096cb0 msgr2=0x7f4f18097080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.925+0000 7f4f2016e640 1 --2- 10.20.193.76:0/1411149855 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4f18096cb0 0x7f4f18097080 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009910 tx=0x7f4f1402ee10 comp rx=0 tx=0).stop 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.925+0000 7f4f2016e640 1 -- 10.20.193.76:0/1411149855 shutdown_connections 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.925+0000 7f4f2016e640 1 --2- 10.20.193.76:0/1411149855 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f4f18097990 0x7f4f1812a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.925+0000 7f4f2016e640 1 --2- 10.20.193.76:0/1411149855 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f4f180975c0 0x7f4f18129ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.925+0000 7f4f2016e640 1 --2- 10.20.193.76:0/1411149855 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4f18096cb0 0x7f4f18097080 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.925+0000 7f4f2016e640 1 -- 10.20.193.76:0/1411149855 >> 10.20.193.76:0/1411149855 conn(0x7f4f1809dac0 msgr2=0x7f4f1809dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.925+0000 7f4f2016e640 1 -- 10.20.193.76:0/1411149855 shutdown_connections 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.925+0000 7f4f2016e640 1 -- 10.20.193.76:0/1411149855 wait complete. 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.925+0000 7f4f2016e640 1 Processor -- start 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.925+0000 7f4f2016e640 1 -- start start 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.925+0000 7f4f2016e640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4f18096cb0 0x7f4f1811aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.925+0000 7f4f2016e640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f4f180975c0 0x7f4f1811b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.925+0000 7f4f2016e640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f4f18097990 0x7f4f1811b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.925+0000 7f4f2016e640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1811e2d0 con 0x7f4f18096cb0 2026-02-25T17:13:47.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.925+0000 7f4f2016e640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1811d950 con 0x7f4f18097990 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.925+0000 7f4f2016e640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1811d670 con 0x7f4f180975c0 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.925+0000 7f4f1df0a640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4f18096cb0 0x7f4f1811aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.925+0000 7f4f1df0a640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4f18096cb0 0x7f4f1811aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:40204/0 (socket says 10.20.193.76:40204) 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.926+0000 7f4f1df0a640 1 -- 10.20.193.76:0/2356099020 learned_addr learned my addr 10.20.193.76:0/2356099020 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.926+0000 7f4f1d709640 1 --2- 10.20.193.76:0/2356099020 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f4f180975c0 0x7f4f1811b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.926+0000 7f4f1e70b640 1 --2- 10.20.193.76:0/2356099020 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f4f18097990 0x7f4f1811b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.926+0000 7f4f1df0a640 1 -- 10.20.193.76:0/2356099020 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f4f180975c0 msgr2=0x7f4f1811b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.926+0000 7f4f1df0a640 1 --2- 10.20.193.76:0/2356099020 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f4f180975c0 0x7f4f1811b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.926+0000 7f4f1df0a640 1 -- 10.20.193.76:0/2356099020 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f4f18097990 msgr2=0x7f4f1811b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.926+0000 7f4f1df0a640 1 --2- 10.20.193.76:0/2356099020 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f4f18097990 0x7f4f1811b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.926+0000 7f4f1df0a640 1 -- 10.20.193.76:0/2356099020 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f14009450 con 0x7f4f18096cb0 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.926+0000 7f4f1df0a640 1 --2- 10.20.193.76:0/2356099020 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4f18096cb0 0x7f4f1811aae0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f1402ee50 tx=0x7f4f14037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.926+0000 7f4f0e7fc640 1 -- 10.20.193.76:0/2356099020 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f14042630 con 0x7f4f18096cb0 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.926+0000 7f4f0e7fc640 1 -- 10.20.193.76:0/2356099020 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f140427b0 con 0x7f4f18096cb0 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.926+0000 7f4f0e7fc640 1 -- 10.20.193.76:0/2356099020 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f14042b70 con 0x7f4f18096cb0 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.926+0000 7f4f2016e640 1 -- 10.20.193.76:0/2356099020 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f1811bc00 con 0x7f4f18096cb0 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.926+0000 7f4f2016e640 1 -- 10.20.193.76:0/2356099020 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f181be320 con 0x7f4f18096cb0 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.926+0000 7f4f2016e640 1 -- 10.20.193.76:0/2356099020 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f18064c00 con 0x7f4f18096cb0 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.927+0000 7f4f0e7fc640 1 -- 10.20.193.76:0/2356099020 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f4f1403e040 con 0x7f4f18096cb0 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.927+0000 7f4f0e7fc640 1 -- 10.20.193.76:0/2356099020 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f4f140880a0 con 0x7f4f18096cb0 2026-02-25T17:13:47.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.928+0000 7f4f0e7fc640 1 -- 10.20.193.76:0/2356099020 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f4f14063040 con 0x7f4f18096cb0 2026-02-25T17:13:47.950 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.946+0000 7f80726db640 1 -- 10.20.193.76:0/795736021 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f806c06ee50 con 0x7f806c090750 2026-02-25T17:13:47.950 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.946+0000 7f80697fa640 1 -- 10.20.193.76:0/795736021 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8064018070 con 0x7f806c090750 2026-02-25T17:13:47.950 INFO:teuthology.orchestra.run.trial076.stdout:38654705666 2026-02-25T17:13:47.950 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.946+0000 7f1cf13ae640 1 -- 10.20.193.76:0/1654955612 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1cec098f90 con 0x7f1cec06ed20 2026-02-25T17:13:47.950 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.947+0000 7f1ce37fe640 1 -- 10.20.193.76:0/1654955612 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1cdc017030 con 0x7f1cec06ed20 2026-02-25T17:13:47.950 INFO:teuthology.orchestra.run.trial076.stdout:38654705667 2026-02-25T17:13:47.951 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.947+0000 7f80726db640 1 -- 10.20.193.76:0/795736021 >> v1:10.20.193.76:6800/42442 conn(0x7f804c04d0d0 legacy=0x7f804c04f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.951 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.947+0000 7f80726db640 1 -- 10.20.193.76:0/795736021 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f806c090750 msgr2=0x7f806c120e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.951 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.947+0000 7f80726db640 1 --2- 10.20.193.76:0/795736021 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f806c090750 0x7f806c120e20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8064009e50 tx=0x7f806400b040 comp rx=0 tx=0).stop 2026-02-25T17:13:47.951 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.947+0000 7f80726db640 1 -- 10.20.193.76:0/795736021 shutdown_connections 2026-02-25T17:13:47.951 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.947+0000 7f80726db640 1 --2- 10.20.193.76:0/795736021 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f806c090750 0x7f806c120e20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.951 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.947+0000 7f80726db640 1 --2- 10.20.193.76:0/795736021 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f806c08fdf0 0x7f806c1208e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.951 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.947+0000 7f80726db640 1 --2- 10.20.193.76:0/795736021 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f806c08f310 0x7f806c1203a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.951 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.947+0000 7f80726db640 1 -- 10.20.193.76:0/795736021 >> 10.20.193.76:0/795736021 conn(0x7f806c09bf00 msgr2=0x7f806c099300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:47.951 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.947+0000 7f80726db640 1 -- 10.20.193.76:0/795736021 shutdown_connections 2026-02-25T17:13:47.951 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.947+0000 7f80726db640 1 -- 10.20.193.76:0/795736021 wait complete. 2026-02-25T17:13:47.952 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.948+0000 7f1cf13ae640 1 -- 10.20.193.76:0/1654955612 >> v1:10.20.193.76:6800/42442 conn(0x7f1ccc04d0d0 legacy=0x7f1ccc04f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.952 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.948+0000 7f1cf13ae640 1 -- 10.20.193.76:0/1654955612 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1cec06ed20 msgr2=0x7f1cec11f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.952 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.948+0000 7f1cf13ae640 1 --2- 10.20.193.76:0/1654955612 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1cec06ed20 0x7f1cec11f3b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00c560 tx=0x7f1cdc007d60 comp rx=0 tx=0).stop 2026-02-25T17:13:47.952 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.948+0000 7f1cf13ae640 1 -- 10.20.193.76:0/1654955612 shutdown_connections 2026-02-25T17:13:47.952 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.948+0000 7f1cf13ae640 1 --2- 10.20.193.76:0/1654955612 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1cec096750 0x7f1cec11fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.952 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.948+0000 7f1cf13ae640 1 --2- 10.20.193.76:0/1654955612 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f1cec096360 0x7f1cec11f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.952 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.948+0000 7f1cf13ae640 1 --2- 10.20.193.76:0/1654955612 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1cec06ed20 0x7f1cec11f3b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.952 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.948+0000 7f1cf13ae640 1 -- 10.20.193.76:0/1654955612 >> 10.20.193.76:0/1654955612 conn(0x7f1cec096d40 msgr2=0x7f1cec093740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:47.952 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.948+0000 7f1cf13ae640 1 -- 10.20.193.76:0/1654955612 shutdown_connections 2026-02-25T17:13:47.952 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.948+0000 7f1cf13ae640 1 -- 10.20.193.76:0/1654955612 wait complete. 2026-02-25T17:13:47.954 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.950+0000 7f0351cc7640 1 -- 10.20.193.76:0/1801293426 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f034c064c00 con 0x7f034c097990 2026-02-25T17:13:47.954 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.950+0000 7f0348ff9640 1 -- 10.20.193.76:0/1801293426 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0344018070 con 0x7f034c097990 2026-02-25T17:13:47.954 INFO:teuthology.orchestra.run.trial076.stdout:38654705666 2026-02-25T17:13:47.955 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.951+0000 7f0351cc7640 1 -- 10.20.193.76:0/1801293426 >> v1:10.20.193.76:6800/42442 conn(0x7f032c04d0d0 legacy=0x7f032c04f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.955 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.951+0000 7f0351cc7640 1 -- 10.20.193.76:0/1801293426 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f034c097990 msgr2=0x7f034c1be3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.955 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.951+0000 7f0351cc7640 1 --2- 10.20.193.76:0/1801293426 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f034c097990 0x7f034c1be3a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0344009fc0 tx=0x7f034400b040 comp rx=0 tx=0).stop 2026-02-25T17:13:47.956 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.952+0000 7f0351cc7640 1 -- 10.20.193.76:0/1801293426 shutdown_connections 2026-02-25T17:13:47.956 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.952+0000 7f0351cc7640 1 --2- 10.20.193.76:0/1801293426 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f034c097990 0x7f034c1be3a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.956 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.952+0000 7f0351cc7640 1 --2- 10.20.193.76:0/1801293426 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f034c0975c0 0x7f034c11a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.956 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.952+0000 7f0351cc7640 1 --2- 10.20.193.76:0/1801293426 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f034c096cb0 0x7f034c11a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.956 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.952+0000 7f0351cc7640 1 -- 10.20.193.76:0/1801293426 >> 10.20.193.76:0/1801293426 conn(0x7f034c09dac0 msgr2=0x7f034c09b400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:47.956 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.952+0000 7f0351cc7640 1 -- 10.20.193.76:0/1801293426 shutdown_connections 2026-02-25T17:13:47.956 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.952+0000 7f0351cc7640 1 -- 10.20.193.76:0/1801293426 wait complete. 2026-02-25T17:13:47.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705666 for osd.1 2026-02-25T17:13:47.960 DEBUG:teuthology.parallel:result is None 2026-02-25T17:13:47.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.0 2026-02-25T17:13:47.962 DEBUG:teuthology.parallel:result is None 2026-02-25T17:13:47.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705666 for osd.3 2026-02-25T17:13:47.963 DEBUG:teuthology.parallel:result is None 2026-02-25T17:13:47.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.990+0000 7f4f2016e640 1 -- 10.20.193.76:0/2356099020 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4f18063e70 con 0x7f4f18096cb0 2026-02-25T17:13:47.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.990+0000 7f4f0e7fc640 1 -- 10.20.193.76:0/2356099020 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4f14047090 con 0x7f4f18096cb0 2026-02-25T17:13:47.993 INFO:teuthology.orchestra.run.trial076.stdout:38654705666 2026-02-25T17:13:47.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.990+0000 7f4f2016e640 1 -- 10.20.193.76:0/2356099020 >> v1:10.20.193.76:6800/42442 conn(0x7f4efc04d0d0 legacy=0x7f4efc04f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.990+0000 7f4f2016e640 1 -- 10.20.193.76:0/2356099020 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4f18096cb0 msgr2=0x7f4f1811aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:47.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.990+0000 7f4f2016e640 1 --2- 10.20.193.76:0/2356099020 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4f18096cb0 0x7f4f1811aae0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f1402ee50 tx=0x7f4f14037000 comp rx=0 tx=0).stop 2026-02-25T17:13:47.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.990+0000 7f4f2016e640 1 -- 10.20.193.76:0/2356099020 shutdown_connections 2026-02-25T17:13:47.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.990+0000 7f4f2016e640 1 --2- 10.20.193.76:0/2356099020 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f4f18097990 0x7f4f1811b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.990+0000 7f4f2016e640 1 --2- 10.20.193.76:0/2356099020 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f4f180975c0 0x7f4f1811b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.990+0000 7f4f2016e640 1 --2- 10.20.193.76:0/2356099020 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4f18096cb0 0x7f4f1811aae0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:47.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.990+0000 7f4f2016e640 1 -- 10.20.193.76:0/2356099020 >> 10.20.193.76:0/2356099020 conn(0x7f4f1809dac0 msgr2=0x7f4f181b1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:47.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.990+0000 7f4f2016e640 1 -- 10.20.193.76:0/2356099020 shutdown_connections 2026-02-25T17:13:47.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:47.990+0000 7f4f2016e640 1 -- 10.20.193.76:0/2356099020 wait complete. 2026-02-25T17:13:48.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705666 got 38654705666 for osd.2 2026-02-25T17:13:48.001 DEBUG:teuthology.parallel:result is None 2026-02-25T17:13:48.001 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-25T17:13:48.001 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T17:13:48.107 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.103+0000 7f896b06d640 1 Processor -- start 2026-02-25T17:13:48.107 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.103+0000 7f896b06d640 1 -- start start 2026-02-25T17:13:48.108 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f896b06d640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8964096cb0 0x7f8964097080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.108 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f896b06d640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f89640975c0 0x7f8964129ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.108 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f896b06d640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8964099350 con 0x7f8964097990 2026-02-25T17:13:48.108 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f896b06d640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896409a4a0 con 0x7f89640975c0 2026-02-25T17:13:48.108 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f896b06d640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f896409a6a0 con 0x7f8964096cb0 2026-02-25T17:13:48.108 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f8963fff640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f89640975c0 0x7f8964129ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.108 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f8968e09640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8964096cb0 0x7f8964097080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.108 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f8963fff640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f89640975c0 0x7f8964129ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:40210/0 (socket says 10.20.193.76:40210) 2026-02-25T17:13:48.108 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f896960a640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f8964097990 0x7f896412a430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:50948/0 (socket says 10.20.193.76:50948) 2026-02-25T17:13:48.109 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f8963fff640 1 -- 10.20.193.76:0/262747164 learned_addr learned my addr 10.20.193.76:0/262747164 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:48.109 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f8963fff640 1 -- 10.20.193.76:0/262747164 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8964096cb0 msgr2=0x7f8964097080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:48.109 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f8963fff640 1 --2- 10.20.193.76:0/262747164 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8964096cb0 0x7f8964097080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.109 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f8963fff640 1 -- 10.20.193.76:0/262747164 >> v1:10.20.193.76:6789/0 conn(0x7f8964097990 legacy=0x7f896412a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.109 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f8963fff640 1 -- 10.20.193.76:0/262747164 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896409a010 con 0x7f89640975c0 2026-02-25T17:13:48.109 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f89637fe640 1 -- 10.20.193.76:0/262747164 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236437810 0 0) 0x7f8964099350 con 0x7f8964097990 2026-02-25T17:13:48.109 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f8963fff640 1 --2- 10.20.193.76:0/262747164 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f89640975c0 0x7f8964129ef0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8950009910 tx=0x7f895002ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656b1a4f9f6df9c1 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:48.109 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f89637fe640 1 -- 10.20.193.76:0/262747164 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895002f970 con 0x7f89640975c0 2026-02-25T17:13:48.109 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f89637fe640 1 -- 10.20.193.76:0/262747164 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895002fad0 con 0x7f89640975c0 2026-02-25T17:13:48.109 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f89637fe640 1 -- 10.20.193.76:0/262747164 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895002fe70 con 0x7f89640975c0 2026-02-25T17:13:48.109 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f896b06d640 1 -- 10.20.193.76:0/262747164 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f89640975c0 msgr2=0x7f8964129ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.109 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.104+0000 7f896b06d640 1 --2- 10.20.193.76:0/262747164 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f89640975c0 0x7f8964129ef0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8950009910 tx=0x7f895002ee10 comp rx=0 tx=0).stop 2026-02-25T17:13:48.109 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.105+0000 7f896b06d640 1 -- 10.20.193.76:0/262747164 shutdown_connections 2026-02-25T17:13:48.109 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.105+0000 7f896b06d640 1 --2- 10.20.193.76:0/262747164 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f89640975c0 0x7f8964129ef0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.109 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.105+0000 7f896b06d640 1 --2- 10.20.193.76:0/262747164 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8964096cb0 0x7f8964097080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.109 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.105+0000 7f896b06d640 1 -- 10.20.193.76:0/262747164 >> 10.20.193.76:0/262747164 conn(0x7f896409dac0 msgr2=0x7f896409dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:48.109 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.105+0000 7f896b06d640 1 -- 10.20.193.76:0/262747164 shutdown_connections 2026-02-25T17:13:48.109 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.105+0000 7f896b06d640 1 -- 10.20.193.76:0/262747164 wait complete. 2026-02-25T17:13:48.110 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.105+0000 7f896b06d640 1 Processor -- start 2026-02-25T17:13:48.110 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.105+0000 7f896b06d640 1 -- start start 2026-02-25T17:13:48.110 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.105+0000 7f896b06d640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8964096cb0 0x7f896412e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.110 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.105+0000 7f896b06d640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f89640975c0 0x7f896412ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.110 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.105+0000 7f896b06d640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f8964097990 0x7f896412f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.110 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.105+0000 7f896b06d640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8964130210 con 0x7f8964097990 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.105+0000 7f896b06d640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8964131e90 con 0x7f89640975c0 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.105+0000 7f896b06d640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8964131ac0 con 0x7f8964096cb0 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.105+0000 7f8968e09640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8964096cb0 0x7f896412e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.105+0000 7f8968e09640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8964096cb0 0x7f896412e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:56412/0 (socket says 10.20.193.76:56412) 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.105+0000 7f8968e09640 1 -- 10.20.193.76:0/3767643920 learned_addr learned my addr 10.20.193.76:0/3767643920 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.105+0000 7f896960a640 1 --2- 10.20.193.76:0/3767643920 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f8964097990 0x7f896412f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.105+0000 7f8963fff640 1 --2- 10.20.193.76:0/3767643920 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f89640975c0 0x7f896412ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.105+0000 7f8968e09640 1 -- 10.20.193.76:0/3767643920 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f89640975c0 msgr2=0x7f896412ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.106+0000 7f8968e09640 1 --2- 10.20.193.76:0/3767643920 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f89640975c0 0x7f896412ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.106+0000 7f8968e09640 1 -- 10.20.193.76:0/3767643920 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f8964097990 msgr2=0x7f896412f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.106+0000 7f8968e09640 1 --2- 10.20.193.76:0/3767643920 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f8964097990 0x7f896412f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.106+0000 7f8968e09640 1 -- 10.20.193.76:0/3767643920 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8950009450 con 0x7f8964096cb0 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.106+0000 7f8968e09640 1 --2- 10.20.193.76:0/3767643920 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8964096cb0 0x7f896412e830 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f895800e930 tx=0x7f89580090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.106+0000 7f89617fa640 1 -- 10.20.193.76:0/3767643920 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895800c8e0 con 0x7f8964096cb0 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.106+0000 7f896b06d640 1 -- 10.20.193.76:0/3767643920 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8964131340 con 0x7f8964096cb0 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.106+0000 7f89617fa640 1 -- 10.20.193.76:0/3767643920 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895800ca40 con 0x7f8964096cb0 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.106+0000 7f89617fa640 1 -- 10.20.193.76:0/3767643920 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895800cdc0 con 0x7f8964096cb0 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.106+0000 7f896b06d640 1 -- 10.20.193.76:0/3767643920 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8964122a40 con 0x7f8964096cb0 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.106+0000 7f896b06d640 1 -- 10.20.193.76:0/3767643920 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8964064c00 con 0x7f8964096cb0 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.106+0000 7f89617fa640 1 -- 10.20.193.76:0/3767643920 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f8958013680 con 0x7f8964096cb0 2026-02-25T17:13:48.111 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.107+0000 7f89617fa640 1 -- 10.20.193.76:0/3767643920 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f8958063ac0 con 0x7f8964096cb0 2026-02-25T17:13:48.112 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.108+0000 7f89617fa640 1 -- 10.20.193.76:0/3767643920 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f895803e8f0 con 0x7f8964096cb0 2026-02-25T17:13:48.172 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.168+0000 7f896b06d640 1 -- 10.20.193.76:0/3767643920 --> v1:10.20.193.76:6800/42442 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f896412b700 con 0x7f894804d0d0 2026-02-25T17:13:48.173 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.169+0000 7f89617fa640 1 -- 10.20.193.76:0/3767643920 <== mgr.4104 v1:10.20.193.76:6800/42442 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34951 (unknown 2965378022 0 1458658246) 0x7f896412b700 con 0x7f894804d0d0 2026-02-25T17:13:48.174 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:48.175 INFO:teuthology.orchestra.run.trial076.stderr:dumped all 2026-02-25T17:13:48.176 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.169+0000 7f896b06d640 1 -- 10.20.193.76:0/3767643920 >> v1:10.20.193.76:6800/42442 conn(0x7f894804d0d0 legacy=0x7f894804f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.176 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.169+0000 7f896b06d640 1 -- 10.20.193.76:0/3767643920 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8964096cb0 msgr2=0x7f896412e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.176 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.169+0000 7f896b06d640 1 --2- 10.20.193.76:0/3767643920 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8964096cb0 0x7f896412e830 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f895800e930 tx=0x7f89580090f0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.176 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.170+0000 7f896b06d640 1 -- 10.20.193.76:0/3767643920 shutdown_connections 2026-02-25T17:13:48.176 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.170+0000 7f896b06d640 1 --2- 10.20.193.76:0/3767643920 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f8964097990 0x7f896412f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.176 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.170+0000 7f896b06d640 1 --2- 10.20.193.76:0/3767643920 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f89640975c0 0x7f896412ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.177 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.170+0000 7f896b06d640 1 --2- 10.20.193.76:0/3767643920 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8964096cb0 0x7f896412e830 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.177 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.170+0000 7f896b06d640 1 -- 10.20.193.76:0/3767643920 >> 10.20.193.76:0/3767643920 conn(0x7f896409dac0 msgr2=0x7f8964124ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:48.177 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.170+0000 7f896b06d640 1 -- 10.20.193.76:0/3767643920 shutdown_connections 2026-02-25T17:13:48.177 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.170+0000 7f896b06d640 1 -- 10.20.193.76:0/3767643920 wait complete. 2026-02-25T17:13:48.180 INFO:teuthology.orchestra.run.trial076.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2026-02-25T17:13:46.803853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1191512,"kb_used_data":1588,"kb_used_omap":6,"kb_used_meta":1189369,"kb_avail":376295848,"statfs":{"total":386547056640,"available":385326948352,"internally_reserved":0,"allocated":1626112,"data_stored":1292010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6812,"internal_metadata":1217914212},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-25T17:13:46.024400+0000","last_change":"2026-02-25T17:13:46.024572+0000","last_active":"2026-02-25T17:13:46.024400+0000","last_peered":"2026-02-25T17:13:46.024400+0000","last_clean":"2026-02-25T17:13:46.024400+0000","last_became_active":"2026-02-25T17:13:44.018312+0000","last_became_peered":"2026-02-25T17:13:44.018312+0000","last_unstale":"2026-02-25T17:13:46.024400+0000","last_undegraded":"2026-02-25T17:13:46.024400+0000","last_fullsized":"2026-02-25T17:13:46.024400+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:41:46.767654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031831399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-25T17:13:46.024220+0000","last_change":"2026-02-25T17:13:46.024490+0000","last_active":"2026-02-25T17:13:46.024220+0000","last_peered":"2026-02-25T17:13:46.024220+0000","last_clean":"2026-02-25T17:13:46.024220+0000","last_became_active":"2026-02-25T17:13:44.019254+0000","last_became_peered":"2026-02-25T17:13:44.019254+0000","last_unstale":"2026-02-25T17:13:46.024220+0000","last_undegraded":"2026-02-25T17:13:46.024220+0000","last_fullsized":"2026-02-25T17:13:46.024220+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:48:23.306312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000395898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-25T17:13:46.576289+0000","last_change":"2026-02-25T17:13:46.576458+0000","last_active":"2026-02-25T17:13:46.576289+0000","last_peered":"2026-02-25T17:13:46.576289+0000","last_clean":"2026-02-25T17:13:46.576289+0000","last_became_active":"2026-02-25T17:13:44.018968+0000","last_became_peered":"2026-02-25T17:13:44.018968+0000","last_unstale":"2026-02-25T17:13:46.576289+0000","last_undegraded":"2026-02-25T17:13:46.576289+0000","last_fullsized":"2026-02-25T17:13:46.576289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:15:44.166699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026897200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-25T17:13:46.024194+0000","last_change":"2026-02-25T17:13:46.024416+0000","last_active":"2026-02-25T17:13:46.024194+0000","last_peered":"2026-02-25T17:13:46.024194+0000","last_clean":"2026-02-25T17:13:46.024194+0000","last_became_active":"2026-02-25T17:13:44.019416+0000","last_became_peered":"2026-02-25T17:13:44.019416+0000","last_unstale":"2026-02-25T17:13:46.024194+0000","last_undegraded":"2026-02-25T17:13:46.024194+0000","last_fullsized":"2026-02-25T17:13:46.024194+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:16:00.062278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038440700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"11'72","reported_seq":100,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-25T17:13:45.023107+0000","last_change":"2026-02-25T17:13:44.018232+0000","last_active":"2026-02-25T17:13:45.023107+0000","last_peered":"2026-02-25T17:13:45.023107+0000","last_clean":"2026-02-25T17:13:45.023107+0000","last_became_active":"2026-02-25T17:13:44.018033+0000","last_became_peered":"2026-02-25T17:13:44.018033+0000","last_unstale":"2026-02-25T17:13:45.023107+0000","last_undegraded":"2026-02-25T17:13:45.023107+0000","last_fullsized":"2026-02-25T17:13:45.023107+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:10:56.453439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-25T17:13:46.024361+0000","last_change":"2026-02-25T17:13:46.024573+0000","last_active":"2026-02-25T17:13:46.024361+0000","last_peered":"2026-02-25T17:13:46.024361+0000","last_clean":"2026-02-25T17:13:46.024361+0000","last_became_active":"2026-02-25T17:13:44.018918+0000","last_became_peered":"2026-02-25T17:13:44.018918+0000","last_unstale":"2026-02-25T17:13:46.024361+0000","last_undegraded":"2026-02-25T17:13:46.024361+0000","last_fullsized":"2026-02-25T17:13:46.024361+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:19:18.292757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033429400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"13'2","reported_seq":16,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-25T17:13:46.028392+0000","last_change":"2026-02-25T17:13:46.028392+0000","last_active":"2026-02-25T17:13:46.028392+0000","last_peered":"2026-02-25T17:13:46.028392+0000","last_clean":"2026-02-25T17:13:46.028392+0000","last_became_active":"2026-02-25T17:13:44.019411+0000","last_became_peered":"2026-02-25T17:13:44.019411+0000","last_unstale":"2026-02-25T17:13:46.028392+0000","last_undegraded":"2026-02-25T17:13:46.028392+0000","last_fullsized":"2026-02-25T17:13:46.028392+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:09:30.409157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083336499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-25T17:13:46.024458+0000","last_change":"2026-02-25T17:13:46.024608+0000","last_active":"2026-02-25T17:13:46.024458+0000","last_peered":"2026-02-25T17:13:46.024458+0000","last_clean":"2026-02-25T17:13:46.024458+0000","last_became_active":"2026-02-25T17:13:44.019272+0000","last_became_peered":"2026-02-25T17:13:44.019272+0000","last_unstale":"2026-02-25T17:13:46.024458+0000","last_undegraded":"2026-02-25T17:13:46.024458+0000","last_fullsized":"2026-02-25T17:13:46.024458+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:15:11.987772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054556799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-25T17:13:46.024631+0000","last_change":"2026-02-25T17:13:46.024834+0000","last_active":"2026-02-25T17:13:46.024631+0000","last_peered":"2026-02-25T17:13:46.024631+0000","last_clean":"2026-02-25T17:13:46.024631+0000","last_became_active":"2026-02-25T17:13:44.019210+0000","last_became_peered":"2026-02-25T17:13:44.019210+0000","last_unstale":"2026-02-25T17:13:46.024631+0000","last_undegraded":"2026-02-25T17:13:46.024631+0000","last_fullsized":"2026-02-25T17:13:46.024631+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:39:00.658143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056038500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298288,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073552,"statfs":{"total":96636764160,"available":96331317248,"internally_reserved":0,"allocated":700416,"data_stored":617563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":304478553},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.124}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.11899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.151}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":106496,"data_stored":27195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":304478553},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]}]},{"osd":1,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298292,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073548,"statfs":{"total":96636764160,"available":96331313152,"internally_reserved":0,"allocated":704512,"data_stored":617571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":304478553},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":114688,"data_stored":29681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":304478553},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.13900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T17:13:48.183 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T17:13:48.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.242+0000 7f5f032db640 1 Processor -- start 2026-02-25T17:13:48.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.242+0000 7f5f032db640 1 -- start start 2026-02-25T17:13:48.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5f032db640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5efc06c2e0 0x7f5efc1284a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5f032db640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f5efc1289e0 0x7f5efc1247e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5f032db640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5efc127f20 0x7f5efc124d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5f032db640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5efc11f0f0 con 0x7f5efc1289e0 2026-02-25T17:13:48.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5f032db640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc10fd60 con 0x7f5efc127f20 2026-02-25T17:13:48.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5f032db640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc110870 con 0x7f5efc06c2e0 2026-02-25T17:13:48.252 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5f01878640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5efc127f20 0x7f5efc124d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.252 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5f01077640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5efc06c2e0 0x7f5efc1284a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.252 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5f00876640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f5efc1289e0 0x7f5efc1247e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.252 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5f00876640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f5efc1289e0 0x7f5efc1247e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:40230/0 (socket says 10.20.193.76:40230) 2026-02-25T17:13:48.252 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5f01878640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5efc127f20 0x7f5efc124d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:47764/0 (socket says 10.20.193.76:47764) 2026-02-25T17:13:48.252 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5f00876640 1 -- 10.20.193.76:0/1197500608 learned_addr learned my addr 10.20.193.76:0/1197500608 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:48.252 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5f00876640 1 -- 10.20.193.76:0/1197500608 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5efc06c2e0 msgr2=0x7f5efc1284a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:48.252 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5f00876640 1 --2- 10.20.193.76:0/1197500608 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5efc06c2e0 0x7f5efc1284a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.252 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5f00876640 1 -- 10.20.193.76:0/1197500608 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5efc127f20 msgr2=0x7f5efc124d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:48.252 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5f00876640 1 --2- 10.20.193.76:0/1197500608 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5efc127f20 0x7f5efc124d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.252 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5f00876640 1 -- 10.20.193.76:0/1197500608 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc110100 con 0x7f5efc1289e0 2026-02-25T17:13:48.252 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5f00876640 1 --2- 10.20.193.76:0/1197500608 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5efc1289e0 0x7f5efc1247e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009910 tx=0x7f5eec02ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b49f7cc9d629bf server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:48.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5ef3fff640 1 -- 10.20.193.76:0/1197500608 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec02f920 con 0x7f5efc1289e0 2026-02-25T17:13:48.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5ef3fff640 1 -- 10.20.193.76:0/1197500608 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec02fa80 con 0x7f5efc1289e0 2026-02-25T17:13:48.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.243+0000 7f5ef3fff640 1 -- 10.20.193.76:0/1197500608 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec02fe20 con 0x7f5efc1289e0 2026-02-25T17:13:48.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.244+0000 7f5f032db640 1 -- 10.20.193.76:0/1197500608 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5efc1289e0 msgr2=0x7f5efc1247e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.244+0000 7f5f032db640 1 --2- 10.20.193.76:0/1197500608 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5efc1289e0 0x7f5efc1247e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009910 tx=0x7f5eec02ee10 comp rx=0 tx=0).stop 2026-02-25T17:13:48.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.244+0000 7f5f032db640 1 -- 10.20.193.76:0/1197500608 shutdown_connections 2026-02-25T17:13:48.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.244+0000 7f5f032db640 1 --2- 10.20.193.76:0/1197500608 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5efc127f20 0x7f5efc124d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.244+0000 7f5f032db640 1 --2- 10.20.193.76:0/1197500608 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5efc1289e0 0x7f5efc1247e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.244+0000 7f5f032db640 1 --2- 10.20.193.76:0/1197500608 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5efc06c2e0 0x7f5efc1284a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.244+0000 7f5f032db640 1 -- 10.20.193.76:0/1197500608 >> 10.20.193.76:0/1197500608 conn(0x7f5efc099700 msgr2=0x7f5efc099b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:48.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.244+0000 7f5f032db640 1 -- 10.20.193.76:0/1197500608 shutdown_connections 2026-02-25T17:13:48.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.244+0000 7f5f032db640 1 -- 10.20.193.76:0/1197500608 wait complete. 2026-02-25T17:13:48.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.244+0000 7f5f032db640 1 Processor -- start 2026-02-25T17:13:48.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f032db640 1 -- start start 2026-02-25T17:13:48.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f032db640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5efc06c2e0 0x7f5efc1136e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f032db640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5efc127f20 0x7f5efc113c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f032db640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5efc1289e0 0x7f5efc114160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f032db640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc115160 con 0x7f5efc127f20 2026-02-25T17:13:48.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f032db640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc116df0 con 0x7f5efc1289e0 2026-02-25T17:13:48.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f032db640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc116ae0 con 0x7f5efc06c2e0 2026-02-25T17:13:48.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f01077640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5efc06c2e0 0x7f5efc1136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f00876640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5efc127f20 0x7f5efc113c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f01878640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5efc1289e0 0x7f5efc114160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f00876640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5efc127f20 0x7f5efc113c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:40244/0 (socket says 10.20.193.76:40244) 2026-02-25T17:13:48.255 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f00876640 1 -- 10.20.193.76:0/1008828158 learned_addr learned my addr 10.20.193.76:0/1008828158 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:48.255 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f01077640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5efc06c2e0 0x7f5efc1136e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:56436/0 (socket says 10.20.193.76:56436) 2026-02-25T17:13:48.255 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f00876640 1 -- 10.20.193.76:0/1008828158 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5efc06c2e0 msgr2=0x7f5efc1136e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.255 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f00876640 1 --2- 10.20.193.76:0/1008828158 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5efc06c2e0 0x7f5efc1136e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.255 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f00876640 1 -- 10.20.193.76:0/1008828158 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5efc1289e0 msgr2=0x7f5efc114160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.255 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f00876640 1 --2- 10.20.193.76:0/1008828158 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5efc1289e0 0x7f5efc114160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.255 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f00876640 1 -- 10.20.193.76:0/1008828158 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec009450 con 0x7f5efc127f20 2026-02-25T17:13:48.255 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f01077640 1 --2- 10.20.193.76:0/1008828158 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5efc06c2e0 0x7f5efc1136e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:48.255 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f01878640 1 --2- 10.20.193.76:0/1008828158 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5efc1289e0 0x7f5efc114160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:48.255 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f00876640 1 --2- 10.20.193.76:0/1008828158 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5efc127f20 0x7f5efc113c20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5eec03a040 tx=0x7f5eec037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:48.255 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5ef1ffb640 1 -- 10.20.193.76:0/1008828158 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec006b30 con 0x7f5efc127f20 2026-02-25T17:13:48.255 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5ef1ffb640 1 -- 10.20.193.76:0/1008828158 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec042650 con 0x7f5efc127f20 2026-02-25T17:13:48.255 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f032db640 1 -- 10.20.193.76:0/1008828158 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5efc11ecc0 con 0x7f5efc127f20 2026-02-25T17:13:48.256 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5ef1ffb640 1 -- 10.20.193.76:0/1008828158 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec042a10 con 0x7f5efc127f20 2026-02-25T17:13:48.256 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.245+0000 7f5f032db640 1 -- 10.20.193.76:0/1008828158 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5efc1146a0 con 0x7f5efc127f20 2026-02-25T17:13:48.256 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.246+0000 7f5f032db640 1 -- 10.20.193.76:0/1008828158 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5efc064c00 con 0x7f5efc127f20 2026-02-25T17:13:48.256 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.246+0000 7f5ef1ffb640 1 -- 10.20.193.76:0/1008828158 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f5eec03e040 con 0x7f5efc127f20 2026-02-25T17:13:48.256 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.246+0000 7f5ef1ffb640 1 -- 10.20.193.76:0/1008828158 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f5eec088200 con 0x7f5efc127f20 2026-02-25T17:13:48.256 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.248+0000 7f5ef1ffb640 1 -- 10.20.193.76:0/1008828158 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f5eec0631a0 con 0x7f5efc127f20 2026-02-25T17:13:48.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.308+0000 7f5f032db640 1 -- 10.20.193.76:0/1008828158 --> v1:10.20.193.76:6800/42442 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5efc068160 con 0x7f5ee004d0d0 2026-02-25T17:13:48.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.309+0000 7f5ef1ffb640 1 -- 10.20.193.76:0/1008828158 <== mgr.4104 v1:10.20.193.76:6800/42442 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34951 (unknown 2965378022 0 1458658246) 0x7f5efc068160 con 0x7f5ee004d0d0 2026-02-25T17:13:48.314 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:48.315 INFO:teuthology.orchestra.run.trial076.stderr:dumped all 2026-02-25T17:13:48.316 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.309+0000 7f5f032db640 1 -- 10.20.193.76:0/1008828158 >> v1:10.20.193.76:6800/42442 conn(0x7f5ee004d0d0 legacy=0x7f5ee004f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.316 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.309+0000 7f5f032db640 1 -- 10.20.193.76:0/1008828158 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5efc127f20 msgr2=0x7f5efc113c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.316 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.309+0000 7f5f032db640 1 --2- 10.20.193.76:0/1008828158 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5efc127f20 0x7f5efc113c20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5eec03a040 tx=0x7f5eec037000 comp rx=0 tx=0).stop 2026-02-25T17:13:48.316 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.309+0000 7f5f032db640 1 -- 10.20.193.76:0/1008828158 shutdown_connections 2026-02-25T17:13:48.316 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.309+0000 7f5f032db640 1 --2- 10.20.193.76:0/1008828158 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5efc1289e0 0x7f5efc114160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.316 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.309+0000 7f5f032db640 1 --2- 10.20.193.76:0/1008828158 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5efc127f20 0x7f5efc113c20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.316 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.309+0000 7f5f032db640 1 --2- 10.20.193.76:0/1008828158 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5efc06c2e0 0x7f5efc1136e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.317 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.309+0000 7f5f032db640 1 -- 10.20.193.76:0/1008828158 >> 10.20.193.76:0/1008828158 conn(0x7f5efc099700 msgr2=0x7f5efc097290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:48.317 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.309+0000 7f5f032db640 1 -- 10.20.193.76:0/1008828158 shutdown_connections 2026-02-25T17:13:48.317 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.309+0000 7f5f032db640 1 -- 10.20.193.76:0/1008828158 wait complete. 2026-02-25T17:13:48.320 INFO:teuthology.orchestra.run.trial076.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2026-02-25T17:13:46.803853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1191512,"kb_used_data":1588,"kb_used_omap":6,"kb_used_meta":1189369,"kb_avail":376295848,"statfs":{"total":386547056640,"available":385326948352,"internally_reserved":0,"allocated":1626112,"data_stored":1292010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6812,"internal_metadata":1217914212},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-25T17:13:46.024400+0000","last_change":"2026-02-25T17:13:46.024572+0000","last_active":"2026-02-25T17:13:46.024400+0000","last_peered":"2026-02-25T17:13:46.024400+0000","last_clean":"2026-02-25T17:13:46.024400+0000","last_became_active":"2026-02-25T17:13:44.018312+0000","last_became_peered":"2026-02-25T17:13:44.018312+0000","last_unstale":"2026-02-25T17:13:46.024400+0000","last_undegraded":"2026-02-25T17:13:46.024400+0000","last_fullsized":"2026-02-25T17:13:46.024400+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:41:46.767654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031831399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-25T17:13:46.024220+0000","last_change":"2026-02-25T17:13:46.024490+0000","last_active":"2026-02-25T17:13:46.024220+0000","last_peered":"2026-02-25T17:13:46.024220+0000","last_clean":"2026-02-25T17:13:46.024220+0000","last_became_active":"2026-02-25T17:13:44.019254+0000","last_became_peered":"2026-02-25T17:13:44.019254+0000","last_unstale":"2026-02-25T17:13:46.024220+0000","last_undegraded":"2026-02-25T17:13:46.024220+0000","last_fullsized":"2026-02-25T17:13:46.024220+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:48:23.306312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000395898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-25T17:13:46.576289+0000","last_change":"2026-02-25T17:13:46.576458+0000","last_active":"2026-02-25T17:13:46.576289+0000","last_peered":"2026-02-25T17:13:46.576289+0000","last_clean":"2026-02-25T17:13:46.576289+0000","last_became_active":"2026-02-25T17:13:44.018968+0000","last_became_peered":"2026-02-25T17:13:44.018968+0000","last_unstale":"2026-02-25T17:13:46.576289+0000","last_undegraded":"2026-02-25T17:13:46.576289+0000","last_fullsized":"2026-02-25T17:13:46.576289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:15:44.166699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026897200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-25T17:13:46.024194+0000","last_change":"2026-02-25T17:13:46.024416+0000","last_active":"2026-02-25T17:13:46.024194+0000","last_peered":"2026-02-25T17:13:46.024194+0000","last_clean":"2026-02-25T17:13:46.024194+0000","last_became_active":"2026-02-25T17:13:44.019416+0000","last_became_peered":"2026-02-25T17:13:44.019416+0000","last_unstale":"2026-02-25T17:13:46.024194+0000","last_undegraded":"2026-02-25T17:13:46.024194+0000","last_fullsized":"2026-02-25T17:13:46.024194+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:16:00.062278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038440700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"11'72","reported_seq":100,"reported_epoch":12,"state":"active+clean","last_fresh":"2026-02-25T17:13:45.023107+0000","last_change":"2026-02-25T17:13:44.018232+0000","last_active":"2026-02-25T17:13:45.023107+0000","last_peered":"2026-02-25T17:13:45.023107+0000","last_clean":"2026-02-25T17:13:45.023107+0000","last_became_active":"2026-02-25T17:13:44.018033+0000","last_became_peered":"2026-02-25T17:13:44.018033+0000","last_unstale":"2026-02-25T17:13:45.023107+0000","last_undegraded":"2026-02-25T17:13:45.023107+0000","last_fullsized":"2026-02-25T17:13:45.023107+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:10:56.453439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-25T17:13:46.024361+0000","last_change":"2026-02-25T17:13:46.024573+0000","last_active":"2026-02-25T17:13:46.024361+0000","last_peered":"2026-02-25T17:13:46.024361+0000","last_clean":"2026-02-25T17:13:46.024361+0000","last_became_active":"2026-02-25T17:13:44.018918+0000","last_became_peered":"2026-02-25T17:13:44.018918+0000","last_unstale":"2026-02-25T17:13:46.024361+0000","last_undegraded":"2026-02-25T17:13:46.024361+0000","last_fullsized":"2026-02-25T17:13:46.024361+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:19:18.292757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033429400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.2","version":"13'2","reported_seq":16,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-25T17:13:46.028392+0000","last_change":"2026-02-25T17:13:46.028392+0000","last_active":"2026-02-25T17:13:46.028392+0000","last_peered":"2026-02-25T17:13:46.028392+0000","last_clean":"2026-02-25T17:13:46.028392+0000","last_became_active":"2026-02-25T17:13:44.019411+0000","last_became_peered":"2026-02-25T17:13:44.019411+0000","last_unstale":"2026-02-25T17:13:46.028392+0000","last_undegraded":"2026-02-25T17:13:46.028392+0000","last_fullsized":"2026-02-25T17:13:46.028392+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:09:30.409157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083336499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.1","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-25T17:13:46.024458+0000","last_change":"2026-02-25T17:13:46.024608+0000","last_active":"2026-02-25T17:13:46.024458+0000","last_peered":"2026-02-25T17:13:46.024458+0000","last_clean":"2026-02-25T17:13:46.024458+0000","last_became_active":"2026-02-25T17:13:44.019272+0000","last_became_peered":"2026-02-25T17:13:44.019272+0000","last_unstale":"2026-02-25T17:13:46.024458+0000","last_undegraded":"2026-02-25T17:13:46.024458+0000","last_fullsized":"2026-02-25T17:13:46.024458+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:15:11.987772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054556799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":13,"state":"active+clean","last_fresh":"2026-02-25T17:13:46.024631+0000","last_change":"2026-02-25T17:13:46.024834+0000","last_active":"2026-02-25T17:13:46.024631+0000","last_peered":"2026-02-25T17:13:46.024631+0000","last_clean":"2026-02-25T17:13:46.024631+0000","last_became_active":"2026-02-25T17:13:44.019210+0000","last_became_peered":"2026-02-25T17:13:44.019210+0000","last_unstale":"2026-02-25T17:13:46.024631+0000","last_undegraded":"2026-02-25T17:13:46.024631+0000","last_fullsized":"2026-02-25T17:13:46.024631+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:39:00.658143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056038500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298288,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073552,"statfs":{"total":96636764160,"available":96331317248,"internally_reserved":0,"allocated":700416,"data_stored":617563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":304478553},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.124}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.11899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.151}]}]},{"osd":2,"up_from":9,"seq":38654705666,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":106496,"data_stored":27195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":304478553},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]}]},{"osd":1,"up_from":9,"seq":38654705666,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298292,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073548,"statfs":{"total":96636764160,"available":96331313152,"internally_reserved":0,"allocated":704512,"data_stored":617571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":304478553},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":114688,"data_stored":29681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":304478553},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.13900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T17:13:48.322 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-25T17:13:48.322 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-25T17:13:48.322 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-25T17:13:48.322 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-25T17:13:48.390 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.383+0000 7f5941da1640 1 Processor -- start 2026-02-25T17:13:48.390 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.383+0000 7f5941da1640 1 -- start start 2026-02-25T17:13:48.390 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.383+0000 7f5941da1640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f593c0904f0 0x7f593c0908c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.390 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.383+0000 7f5941da1640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f593c12d8c0 0x7f593c12fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.391 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.383+0000 7f5941da1640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593c092020 con 0x7f593c090e00 2026-02-25T17:13:48.391 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.383+0000 7f5941da1640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593c092330 con 0x7f593c0904f0 2026-02-25T17:13:48.391 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.383+0000 7f5941da1640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c0925f0 con 0x7f593c12d8c0 2026-02-25T17:13:48.391 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.383+0000 7f5940d9f640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f593c0904f0 0x7f593c0908c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.391 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.383+0000 7f593bfff640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f593c090e00 0x7f593c12c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:50964/0 (socket says 10.20.193.76:50964) 2026-02-25T17:13:48.391 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.383+0000 7f593bfff640 1 -- 10.20.193.76:0/1316004082 learned_addr learned my addr 10.20.193.76:0/1316004082 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:13:48.391 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.383+0000 7f59415a0640 1 --2- 10.20.193.76:0/1316004082 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f593c12d8c0 0x7f593c12fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.391 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.383+0000 7f5940d9f640 1 -- 10.20.193.76:0/1316004082 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f593c12d8c0 msgr2=0x7f593c12fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:48.391 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.383+0000 7f5940d9f640 1 --2- 10.20.193.76:0/1316004082 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f593c12d8c0 0x7f593c12fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.391 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.383+0000 7f5940d9f640 1 -- 10.20.193.76:0/1316004082 >> v1:10.20.193.76:6789/0 conn(0x7f593c090e00 legacy=0x7f593c12c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.391 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.383+0000 7f593b7fe640 1 -- 10.20.193.76:0/1316004082 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834264050 0 0) 0x7f593c092020 con 0x7f593c090e00 2026-02-25T17:13:48.392 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.383+0000 7f5940d9f640 1 -- 10.20.193.76:0/1316004082 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c094c40 con 0x7f593c0904f0 2026-02-25T17:13:48.392 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.384+0000 7f5940d9f640 1 --2- 10.20.193.76:0/1316004082 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f593c0904f0 0x7f593c0908c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5930009850 tx=0x7f593002ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6a621cf2f68650 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:48.392 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.384+0000 7f593b7fe640 1 -- 10.20.193.76:0/1316004082 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593002f8b0 con 0x7f593c0904f0 2026-02-25T17:13:48.392 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.384+0000 7f593b7fe640 1 -- 10.20.193.76:0/1316004082 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593002fa10 con 0x7f593c0904f0 2026-02-25T17:13:48.392 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.384+0000 7f593b7fe640 1 -- 10.20.193.76:0/1316004082 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593002fdb0 con 0x7f593c0904f0 2026-02-25T17:13:48.392 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.384+0000 7f5941da1640 1 -- 10.20.193.76:0/1316004082 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f593c0904f0 msgr2=0x7f593c0908c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.392 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.384+0000 7f5941da1640 1 --2- 10.20.193.76:0/1316004082 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f593c0904f0 0x7f593c0908c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5930009850 tx=0x7f593002ed50 comp rx=0 tx=0).stop 2026-02-25T17:13:48.392 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.384+0000 7f5941da1640 1 -- 10.20.193.76:0/1316004082 shutdown_connections 2026-02-25T17:13:48.392 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.384+0000 7f5941da1640 1 --2- 10.20.193.76:0/1316004082 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f593c12d8c0 0x7f593c12fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.392 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.384+0000 7f5941da1640 1 --2- 10.20.193.76:0/1316004082 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f593c0904f0 0x7f593c0908c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.392 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.384+0000 7f5941da1640 1 -- 10.20.193.76:0/1316004082 >> 10.20.193.76:0/1316004082 conn(0x7f593c099c50 msgr2=0x7f593c095b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:48.392 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.384+0000 7f5941da1640 1 -- 10.20.193.76:0/1316004082 shutdown_connections 2026-02-25T17:13:48.393 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.384+0000 7f5941da1640 1 -- 10.20.193.76:0/1316004082 wait complete. 2026-02-25T17:13:48.393 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f5941da1640 1 Processor -- start 2026-02-25T17:13:48.393 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f5941da1640 1 -- start start 2026-02-25T17:13:48.393 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f5941da1640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f593c0904f0 0x7f593c1c29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.393 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f5941da1640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f593c090e00 0x7f593c1c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.393 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f5941da1640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f593c12d8c0 0x7f593c1c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.393 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f5941da1640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c12f540 con 0x7f593c0904f0 2026-02-25T17:13:48.393 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f5941da1640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c06af20 con 0x7f593c090e00 2026-02-25T17:13:48.393 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f5941da1640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f593c12c020 con 0x7f593c12d8c0 2026-02-25T17:13:48.393 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f5940d9f640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f593c0904f0 0x7f593c1c29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.393 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f593bfff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f593c090e00 0x7f593c1c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.393 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f5940d9f640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f593c0904f0 0x7f593c1c29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:40264/0 (socket says 10.20.193.76:40264) 2026-02-25T17:13:48.394 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f5940d9f640 1 -- 10.20.193.76:0/3889338603 learned_addr learned my addr 10.20.193.76:0/3889338603 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:48.394 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f59415a0640 1 --2- 10.20.193.76:0/3889338603 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f593c12d8c0 0x7f593c1c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.394 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f593bfff640 1 -- 10.20.193.76:0/3889338603 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f593c12d8c0 msgr2=0x7f593c1c3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.394 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f593bfff640 1 --2- 10.20.193.76:0/3889338603 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f593c12d8c0 0x7f593c1c3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.394 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f593bfff640 1 -- 10.20.193.76:0/3889338603 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f593c0904f0 msgr2=0x7f593c1c29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.394 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f593bfff640 1 --2- 10.20.193.76:0/3889338603 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f593c0904f0 0x7f593c1c29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.394 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f593bfff640 1 -- 10.20.193.76:0/3889338603 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5930009390 con 0x7f593c090e00 2026-02-25T17:13:48.394 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f593bfff640 1 --2- 10.20.193.76:0/3889338603 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f593c090e00 0x7f593c1c2f00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5928000c00 tx=0x7f5928007c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:48.394 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f59397fa640 1 -- 10.20.193.76:0/3889338603 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5928005aa0 con 0x7f593c090e00 2026-02-25T17:13:48.394 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f59397fa640 1 -- 10.20.193.76:0/3889338603 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5928005c20 con 0x7f593c090e00 2026-02-25T17:13:48.394 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f5941da1640 1 -- 10.20.193.76:0/3889338603 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593c12c580 con 0x7f593c090e00 2026-02-25T17:13:48.394 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f59397fa640 1 -- 10.20.193.76:0/3889338603 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59280070d0 con 0x7f593c090e00 2026-02-25T17:13:48.395 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.385+0000 7f5941da1640 1 -- 10.20.193.76:0/3889338603 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593c12caa0 con 0x7f593c090e00 2026-02-25T17:13:48.395 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.386+0000 7f59397fa640 1 -- 10.20.193.76:0/3889338603 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f5928007500 con 0x7f593c090e00 2026-02-25T17:13:48.395 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.386+0000 7f5941da1640 1 -- 10.20.193.76:0/3889338603 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593c071ba0 con 0x7f593c090e00 2026-02-25T17:13:48.395 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.386+0000 7f59397fa640 1 -- 10.20.193.76:0/3889338603 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f5928062dc0 con 0x7f593c090e00 2026-02-25T17:13:48.395 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.388+0000 7f59397fa640 1 -- 10.20.193.76:0/3889338603 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f592803dc50 con 0x7f593c090e00 2026-02-25T17:13:48.465 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.461+0000 7f5941da1640 1 -- 10.20.193.76:0/3889338603 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f593c095830 con 0x7f593c090e00 2026-02-25T17:13:48.465 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.461+0000 7f59397fa640 1 -- 10.20.193.76:0/3889338603 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f5928017070 con 0x7f593c090e00 2026-02-25T17:13:48.466 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:48.466 INFO:teuthology.orchestra.run.trial076.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-25T17:13:48.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.462+0000 7f5941da1640 1 -- 10.20.193.76:0/3889338603 >> v1:10.20.193.76:6800/42442 conn(0x7f592004d100 legacy=0x7f592004f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.462+0000 7f5941da1640 1 -- 10.20.193.76:0/3889338603 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f593c090e00 msgr2=0x7f593c1c2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.462+0000 7f5941da1640 1 --2- 10.20.193.76:0/3889338603 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f593c090e00 0x7f593c1c2f00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5928000c00 tx=0x7f5928007c40 comp rx=0 tx=0).stop 2026-02-25T17:13:48.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.462+0000 7f5941da1640 1 -- 10.20.193.76:0/3889338603 shutdown_connections 2026-02-25T17:13:48.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.462+0000 7f5941da1640 1 --2- 10.20.193.76:0/3889338603 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f593c12d8c0 0x7f593c1c3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.462+0000 7f5941da1640 1 --2- 10.20.193.76:0/3889338603 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f593c090e00 0x7f593c1c2f00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.462+0000 7f5941da1640 1 --2- 10.20.193.76:0/3889338603 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f593c0904f0 0x7f593c1c29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.462+0000 7f5941da1640 1 -- 10.20.193.76:0/3889338603 >> 10.20.193.76:0/3889338603 conn(0x7f593c099c50 msgr2=0x7f593c128420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:48.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.462+0000 7f5941da1640 1 -- 10.20.193.76:0/3889338603 shutdown_connections 2026-02-25T17:13:48.468 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.462+0000 7f5941da1640 1 -- 10.20.193.76:0/3889338603 wait complete. 2026-02-25T17:13:48.473 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-25T17:13:48.473 INFO:teuthology.run_tasks:Running task exec... 2026-02-25T17:13:48.490 INFO:teuthology.task.exec:Executing custom commands... 2026-02-25T17:13:48.491 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@trial076.front.sepia.ceph.com 2026-02-25T17:13:48.491 DEBUG:teuthology.orchestra.run.trial076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client quincy' 2026-02-25T17:13:48.558 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.548+0000 7f271986d640 1 Processor -- start 2026-02-25T17:13:48.558 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.548+0000 7f271986d640 1 -- start start 2026-02-25T17:13:48.558 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.548+0000 7f271986d640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f2714097520 0x7f271412f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.558 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.548+0000 7f271986d640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f271412f940 0x7f2714131d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.559 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.548+0000 7f271986d640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271409c9a0 con 0x7f2714096a40 2026-02-25T17:13:48.559 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.548+0000 7f271986d640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271409b780 con 0x7f2714097520 2026-02-25T17:13:48.559 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.548+0000 7f271986d640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f271406a070 con 0x7f271412f940 2026-02-25T17:13:48.559 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.548+0000 7f2712ffd640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f2714096a40 0x7f2714096e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:50970/0 (socket says 10.20.193.76:50970) 2026-02-25T17:13:48.559 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.548+0000 7f270bfff640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f2714097520 0x7f271412f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.559 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.548+0000 7f2712ffd640 1 -- 10.20.193.76:0/193803093 learned_addr learned my addr 10.20.193.76:0/193803093 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:13:48.559 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.548+0000 7f27137fe640 1 --2- 10.20.193.76:0/193803093 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f271412f940 0x7f2714131d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.559 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.548+0000 7f270bfff640 1 -- 10.20.193.76:0/193803093 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f271412f940 msgr2=0x7f2714131d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:48.560 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.548+0000 7f270bfff640 1 --2- 10.20.193.76:0/193803093 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f271412f940 0x7f2714131d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.560 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.548+0000 7f270bfff640 1 -- 10.20.193.76:0/193803093 >> v1:10.20.193.76:6789/0 conn(0x7f2714096a40 legacy=0x7f2714096e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.560 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.548+0000 7f270bfff640 1 -- 10.20.193.76:0/193803093 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271409afa0 con 0x7f2714097520 2026-02-25T17:13:48.560 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.548+0000 7f27127fc640 1 -- 10.20.193.76:0/193803093 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219652129 0 0) 0x7f271409c9a0 con 0x7f2714096a40 2026-02-25T17:13:48.560 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.549+0000 7f270bfff640 1 --2- 10.20.193.76:0/193803093 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2714097520 0x7f271412f400 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009850 tx=0x7f26fc02ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed0775295546571 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:48.560 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.549+0000 7f27127fc640 1 -- 10.20.193.76:0/193803093 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc02f8b0 con 0x7f2714097520 2026-02-25T17:13:48.560 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.549+0000 7f27127fc640 1 -- 10.20.193.76:0/193803093 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc02fa10 con 0x7f2714097520 2026-02-25T17:13:48.560 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.549+0000 7f27127fc640 1 -- 10.20.193.76:0/193803093 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc02fdb0 con 0x7f2714097520 2026-02-25T17:13:48.561 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.549+0000 7f271986d640 1 -- 10.20.193.76:0/193803093 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2714097520 msgr2=0x7f271412f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.561 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.549+0000 7f271986d640 1 --2- 10.20.193.76:0/193803093 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2714097520 0x7f271412f400 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009850 tx=0x7f26fc02ed50 comp rx=0 tx=0).stop 2026-02-25T17:13:48.561 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.549+0000 7f271986d640 1 -- 10.20.193.76:0/193803093 shutdown_connections 2026-02-25T17:13:48.561 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.549+0000 7f271986d640 1 --2- 10.20.193.76:0/193803093 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f271412f940 0x7f2714131d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.561 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.549+0000 7f271986d640 1 --2- 10.20.193.76:0/193803093 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2714097520 0x7f271412f400 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.561 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.549+0000 7f271986d640 1 -- 10.20.193.76:0/193803093 >> 10.20.193.76:0/193803093 conn(0x7f271409e400 msgr2=0x7f271409a470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:48.561 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.549+0000 7f271986d640 1 -- 10.20.193.76:0/193803093 shutdown_connections 2026-02-25T17:13:48.561 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.549+0000 7f271986d640 1 -- 10.20.193.76:0/193803093 wait complete. 2026-02-25T17:13:48.562 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f271986d640 1 Processor -- start 2026-02-25T17:13:48.562 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f271986d640 1 -- start start 2026-02-25T17:13:48.562 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f271986d640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2714096a40 0x7f271411d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.562 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f271986d640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2714097520 0x7f271411d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.562 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f271986d640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f271412f940 0x7f271411dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.562 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f271986d640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271412f7e0 con 0x7f2714097520 2026-02-25T17:13:48.562 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f271986d640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271409a780 con 0x7f271412f940 2026-02-25T17:13:48.562 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f271986d640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2714120060 con 0x7f2714096a40 2026-02-25T17:13:48.563 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f270bfff640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2714097520 0x7f271411d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.563 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f270bfff640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2714097520 0x7f271411d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:40280/0 (socket says 10.20.193.76:40280) 2026-02-25T17:13:48.563 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f270bfff640 1 -- 10.20.193.76:0/1708768901 learned_addr learned my addr 10.20.193.76:0/1708768901 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:48.563 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f2712ffd640 1 --2- 10.20.193.76:0/1708768901 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2714096a40 0x7f271411d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.563 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f27137fe640 1 --2- 10.20.193.76:0/1708768901 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f271412f940 0x7f271411dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.563 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f270bfff640 1 -- 10.20.193.76:0/1708768901 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2714096a40 msgr2=0x7f271411d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.563 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f270bfff640 1 --2- 10.20.193.76:0/1708768901 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2714096a40 0x7f271411d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.563 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f270bfff640 1 -- 10.20.193.76:0/1708768901 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f271412f940 msgr2=0x7f271411dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.564 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f270bfff640 1 --2- 10.20.193.76:0/1708768901 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f271412f940 0x7f271411dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.564 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f270bfff640 1 -- 10.20.193.76:0/1708768901 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc009390 con 0x7f2714097520 2026-02-25T17:13:48.564 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f270bfff640 1 --2- 10.20.193.76:0/1708768901 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2714097520 0x7f271411d7e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009360 tx=0x7f26fc037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:48.564 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f2710ff9640 1 -- 10.20.193.76:0/1708768901 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc037e60 con 0x7f2714097520 2026-02-25T17:13:48.564 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f2710ff9640 1 -- 10.20.193.76:0/1708768901 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc042440 con 0x7f2714097520 2026-02-25T17:13:48.564 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f271986d640 1 -- 10.20.193.76:0/1708768901 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2714120600 con 0x7f2714097520 2026-02-25T17:13:48.564 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f2710ff9640 1 -- 10.20.193.76:0/1708768901 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc0427e0 con 0x7f2714097520 2026-02-25T17:13:48.564 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.550+0000 7f271986d640 1 -- 10.20.193.76:0/1708768901 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271411e260 con 0x7f2714097520 2026-02-25T17:13:48.565 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.551+0000 7f271986d640 1 -- 10.20.193.76:0/1708768901 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27141209a0 con 0x7f2714097520 2026-02-25T17:13:48.565 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.551+0000 7f2710ff9640 1 -- 10.20.193.76:0/1708768901 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f26fc03e040 con 0x7f2714097520 2026-02-25T17:13:48.565 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.551+0000 7f2710ff9640 1 -- 10.20.193.76:0/1708768901 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f26fc087e90 con 0x7f2714097520 2026-02-25T17:13:48.565 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.553+0000 7f2710ff9640 1 -- 10.20.193.76:0/1708768901 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f26fc062d30 con 0x7f2714097520 2026-02-25T17:13:48.622 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.619+0000 7f271986d640 1 -- 10.20.193.76:0/1708768901 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "quincy"} v 0) v1 -- 0x7f271405f010 con 0x7f2714097520 2026-02-25T17:13:48.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.771+0000 7f2710ff9640 1 -- 10.20.193.76:0/1708768901 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "quincy"}]=0 set require_min_compat_client to quincy v14) v1 ==== 141+0+0 (secure 0 0 0) 0x7f26fc0890a0 con 0x7f2714097520 2026-02-25T17:13:48.775 INFO:teuthology.orchestra.run.trial076.stderr:set require_min_compat_client to quincy 2026-02-25T17:13:48.776 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.771+0000 7f271986d640 1 -- 10.20.193.76:0/1708768901 >> v1:10.20.193.76:6800/42442 conn(0x7f26f404d0d0 legacy=0x7f26f404f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.776 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.771+0000 7f271986d640 1 -- 10.20.193.76:0/1708768901 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2714097520 msgr2=0x7f271411d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.777 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.771+0000 7f271986d640 1 --2- 10.20.193.76:0/1708768901 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2714097520 0x7f271411d7e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009360 tx=0x7f26fc037000 comp rx=0 tx=0).stop 2026-02-25T17:13:48.777 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.772+0000 7f271986d640 1 -- 10.20.193.76:0/1708768901 shutdown_connections 2026-02-25T17:13:48.777 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.772+0000 7f271986d640 1 --2- 10.20.193.76:0/1708768901 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f271412f940 0x7f271411dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.777 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.772+0000 7f271986d640 1 --2- 10.20.193.76:0/1708768901 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2714097520 0x7f271411d7e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.777 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.772+0000 7f271986d640 1 --2- 10.20.193.76:0/1708768901 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2714096a40 0x7f271411d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.777 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.772+0000 7f271986d640 1 -- 10.20.193.76:0/1708768901 >> 10.20.193.76:0/1708768901 conn(0x7f271409e400 msgr2=0x7f2714115ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:48.777 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.772+0000 7f271986d640 1 -- 10.20.193.76:0/1708768901 shutdown_connections 2026-02-25T17:13:48.777 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.772+0000 7f271986d640 1 -- 10.20.193.76:0/1708768901 wait complete. 2026-02-25T17:13:48.783 INFO:teuthology.run_tasks:Running task print... 2026-02-25T17:13:48.797 INFO:teuthology.task.print:**** done ceph 2026-02-25T17:13:48.797 INFO:teuthology.run_tasks:Running task print... 2026-02-25T17:13:48.811 INFO:teuthology.task.print:*** upgrading, no cephfs present 2026-02-25T17:13:48.811 INFO:teuthology.run_tasks:Running task exec... 2026-02-25T17:13:48.825 INFO:teuthology.task.exec:Executing custom commands... 2026-02-25T17:13:48.825 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@trial076.front.sepia.ceph.com 2026-02-25T17:13:48.825 DEBUG:teuthology.orchestra.run.trial076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs dump' 2026-02-25T17:13:48.888 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.884+0000 7fd3a5bbc640 1 Processor -- start 2026-02-25T17:13:48.888 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.884+0000 7fd3a5bbc640 1 -- start start 2026-02-25T17:13:48.888 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.885+0000 7fd3a5bbc640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fd3a0124070 0x7fd3a0124440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.888 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.885+0000 7fd3a5bbc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd3a0124980 0x7fd3a006b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.888 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.885+0000 7fd3a5bbc640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a006d120 con 0x7fd3a006d600 2026-02-25T17:13:48.888 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.885+0000 7fd3a5bbc640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a0069a90 con 0x7fd3a0124070 2026-02-25T17:13:48.888 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.885+0000 7fd3a5bbc640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a006c980 con 0x7fd3a0124980 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.885+0000 7fd39f7fe640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fd3a0124070 0x7fd3a0124440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.885+0000 7fd39effd640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7fd3a006d600 0x7fd3a006ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:50986/0 (socket says 10.20.193.76:50986) 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.885+0000 7fd39effd640 1 -- 10.20.193.76:0/15249696 learned_addr learned my addr 10.20.193.76:0/15249696 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.885+0000 7fd39ffff640 1 --2- 10.20.193.76:0/15249696 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd3a0124980 0x7fd3a006b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.885+0000 7fd39f7fe640 1 -- 10.20.193.76:0/15249696 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd3a0124980 msgr2=0x7fd3a006b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.885+0000 7fd39f7fe640 1 --2- 10.20.193.76:0/15249696 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd3a0124980 0x7fd3a006b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.885+0000 7fd39f7fe640 1 -- 10.20.193.76:0/15249696 >> v1:10.20.193.76:6789/0 conn(0x7fd3a006d600 legacy=0x7fd3a006ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.885+0000 7fd39f7fe640 1 -- 10.20.193.76:0/15249696 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a006b970 con 0x7fd3a0124070 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.885+0000 7fd39e7fc640 1 -- 10.20.193.76:0/15249696 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628344283 0 0) 0x7fd3a006d120 con 0x7fd3a006d600 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.885+0000 7fd39ffff640 1 --2- 10.20.193.76:0/15249696 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd3a0124980 0x7fd3a006b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.885+0000 7fd39f7fe640 1 --2- 10.20.193.76:0/15249696 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd3a0124070 0x7fd3a0124440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd390009850 tx=0x7fd39002ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9fe2d1c14b21df server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.885+0000 7fd39e7fc640 1 -- 10.20.193.76:0/15249696 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39002f8b0 con 0x7fd3a0124070 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.885+0000 7fd39e7fc640 1 -- 10.20.193.76:0/15249696 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39002fa10 con 0x7fd3a0124070 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.885+0000 7fd39e7fc640 1 -- 10.20.193.76:0/15249696 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39002fdb0 con 0x7fd3a0124070 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.886+0000 7fd3a5bbc640 1 -- 10.20.193.76:0/15249696 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd3a0124070 msgr2=0x7fd3a0124440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.886+0000 7fd3a5bbc640 1 --2- 10.20.193.76:0/15249696 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd3a0124070 0x7fd3a0124440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd390009850 tx=0x7fd39002ed50 comp rx=0 tx=0).stop 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.886+0000 7fd3a5bbc640 1 -- 10.20.193.76:0/15249696 shutdown_connections 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.886+0000 7fd3a5bbc640 1 --2- 10.20.193.76:0/15249696 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd3a0124980 0x7fd3a006b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.886+0000 7fd3a5bbc640 1 --2- 10.20.193.76:0/15249696 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd3a0124070 0x7fd3a0124440 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.886+0000 7fd3a5bbc640 1 -- 10.20.193.76:0/15249696 >> 10.20.193.76:0/15249696 conn(0x7fd3a009ac20 msgr2=0x7fd3a009b020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.886+0000 7fd3a5bbc640 1 -- 10.20.193.76:0/15249696 shutdown_connections 2026-02-25T17:13:48.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.886+0000 7fd3a5bbc640 1 -- 10.20.193.76:0/15249696 wait complete. 2026-02-25T17:13:48.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.886+0000 7fd3a5bbc640 1 Processor -- start 2026-02-25T17:13:48.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.886+0000 7fd3a5bbc640 1 -- start start 2026-02-25T17:13:48.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd3a5bbc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd3a006d600 0x7fd3a0121ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd3a5bbc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd3a0124070 0x7fd3a0122400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd3a5bbc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd3a0124980 0x7fd3a0122940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:13:48.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd3a5bbc640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a0098f50 con 0x7fd3a006d600 2026-02-25T17:13:48.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd3a5bbc640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a0120050 con 0x7fd3a0124980 2026-02-25T17:13:48.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd3a5bbc640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a01210c0 con 0x7fd3a0124070 2026-02-25T17:13:48.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd39f7fe640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd3a006d600 0x7fd3a0121ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd39f7fe640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd3a006d600 0x7fd3a0121ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:40296/0 (socket says 10.20.193.76:40296) 2026-02-25T17:13:48.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd39ffff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd3a0124980 0x7fd3a0122940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd39f7fe640 1 -- 10.20.193.76:0/1037924647 learned_addr learned my addr 10.20.193.76:0/1037924647 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:13:48.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd39effd640 1 --2- 10.20.193.76:0/1037924647 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd3a0124070 0x7fd3a0122400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:13:48.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd39f7fe640 1 -- 10.20.193.76:0/1037924647 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd3a0124070 msgr2=0x7fd3a0122400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd39f7fe640 1 --2- 10.20.193.76:0/1037924647 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd3a0124070 0x7fd3a0122400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd39f7fe640 1 -- 10.20.193.76:0/1037924647 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd3a0124980 msgr2=0x7fd3a0122940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd39f7fe640 1 --2- 10.20.193.76:0/1037924647 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd3a0124980 0x7fd3a0122940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd39f7fe640 1 -- 10.20.193.76:0/1037924647 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd398009a20 con 0x7fd3a006d600 2026-02-25T17:13:48.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd39f7fe640 1 --2- 10.20.193.76:0/1037924647 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd3a006d600 0x7fd3a0121ec0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd390009980 tx=0x7fd390037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:13:48.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd387fff640 1 -- 10.20.193.76:0/1037924647 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd390037e60 con 0x7fd3a006d600 2026-02-25T17:13:48.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd387fff640 1 -- 10.20.193.76:0/1037924647 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd390041400 con 0x7fd3a006d600 2026-02-25T17:13:48.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd3a5bbc640 1 -- 10.20.193.76:0/1037924647 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd390009390 con 0x7fd3a006d600 2026-02-25T17:13:48.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd387fff640 1 -- 10.20.193.76:0/1037924647 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd390041780 con 0x7fd3a006d600 2026-02-25T17:13:48.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd3a5bbc640 1 -- 10.20.193.76:0/1037924647 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a011f890 con 0x7fd3a006d600 2026-02-25T17:13:48.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.887+0000 7fd3a5bbc640 1 -- 10.20.193.76:0/1037924647 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a0122f40 con 0x7fd3a006d600 2026-02-25T17:13:48.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.888+0000 7fd387fff640 1 -- 10.20.193.76:0/1037924647 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7fd390041b30 con 0x7fd3a006d600 2026-02-25T17:13:48.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.888+0000 7fd387fff640 1 -- 10.20.193.76:0/1037924647 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2834+0+0 (secure 0 0 0) 0x7fd390088b20 con 0x7fd3a006d600 2026-02-25T17:13:48.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.890+0000 7fd387fff640 1 -- 10.20.193.76:0/1037924647 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7fd390063a30 con 0x7fd3a006d600 2026-02-25T17:13:48.964 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.960+0000 7fd3a5bbc640 1 -- 10.20.193.76:0/1037924647 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd3a005f010 con 0x7fd3a006d600 2026-02-25T17:13:48.964 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.960+0000 7fd387fff640 1 -- 10.20.193.76:0/1037924647 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 1 v1) v1 ==== 75+0+358 (secure 0 0 0) 0x7fd39003c030 con 0x7fd3a006d600 2026-02-25T17:13:48.965 INFO:teuthology.orchestra.run.trial076.stdout:e1 2026-02-25T17:13:48.965 INFO:teuthology.orchestra.run.trial076.stdout:enable_multiple, ever_enabled_multiple: 1,1 2026-02-25T17:13:48.965 INFO:teuthology.orchestra.run.trial076.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2026-02-25T17:13:48.965 INFO:teuthology.orchestra.run.trial076.stdout:legacy client fscid: -1 2026-02-25T17:13:48.965 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:13:48.965 INFO:teuthology.orchestra.run.trial076.stdout:No filesystems configured 2026-02-25T17:13:48.966 INFO:teuthology.orchestra.run.trial076.stderr:dumped fsmap epoch 1 2026-02-25T17:13:48.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.961+0000 7fd3a5bbc640 1 -- 10.20.193.76:0/1037924647 >> v1:10.20.193.76:6800/42442 conn(0x7fd38c04d0d0 legacy=0x7fd38c04f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.961+0000 7fd3a5bbc640 1 -- 10.20.193.76:0/1037924647 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd3a006d600 msgr2=0x7fd3a0121ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:13:48.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.961+0000 7fd3a5bbc640 1 --2- 10.20.193.76:0/1037924647 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd3a006d600 0x7fd3a0121ec0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd390009980 tx=0x7fd390037000 comp rx=0 tx=0).stop 2026-02-25T17:13:48.967 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.961+0000 7fd3a5bbc640 1 -- 10.20.193.76:0/1037924647 shutdown_connections 2026-02-25T17:13:48.967 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.961+0000 7fd3a5bbc640 1 --2- 10.20.193.76:0/1037924647 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd3a0124980 0x7fd3a0122940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.967 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.961+0000 7fd3a5bbc640 1 --2- 10.20.193.76:0/1037924647 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd3a0124070 0x7fd3a0122400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.967 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.961+0000 7fd3a5bbc640 1 --2- 10.20.193.76:0/1037924647 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd3a006d600 0x7fd3a0121ec0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:13:48.967 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.961+0000 7fd3a5bbc640 1 -- 10.20.193.76:0/1037924647 >> 10.20.193.76:0/1037924647 conn(0x7fd3a009ac20 msgr2=0x7fd3a0117330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:13:48.967 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.961+0000 7fd3a5bbc640 1 -- 10.20.193.76:0/1037924647 shutdown_connections 2026-02-25T17:13:48.967 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:13:48.961+0000 7fd3a5bbc640 1 -- 10.20.193.76:0/1037924647 wait complete. 2026-02-25T17:13:48.972 INFO:teuthology.run_tasks:Running task install.upgrade... 2026-02-25T17:13:48.988 INFO:teuthology.task.install:project ceph config {'mon.a': None} overrides {'flavor': 'default', 'sha1': '0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28'} 2026-02-25T17:13:48.989 INFO:teuthology.task.install:remote ubuntu@trial076.front.sepia.ceph.com config {'flavor': 'default', 'sha1': '0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28'} 2026-02-25T17:13:48.989 INFO:teuthology.task.install:extra packages: [] 2026-02-25T17:13:48.997 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-25T17:13:48.997 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2026-02-25T17:13:48.997 DEBUG:teuthology.orchestra.run.trial076:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2026-02-25T17:13:49.017 INFO:teuthology.orchestra.run.trial076.stdout:17.2.9-0.el9 2026-02-25T17:13:49.017 INFO:teuthology.packaging:The installed version of ceph-common is 17.2.9-0.el9 2026-02-25T17:13:49.018 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28 2026-02-25T17:13:49.178 INFO:teuthology.task.install:Ceph rpm upgrade from 17.2.9-0.el9 to 18.2.7-1050.g0ef62ce8 2026-02-25T17:13:49.178 INFO:teuthology.task.install.rpm:Host trial076 is: centos 9.stream x86_64 2026-02-25T17:13:49.178 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28 2026-02-25T17:13:49.320 INFO:teuthology.task.install.rpm:Repo base URL: https://2.chacra.ceph.com/r/ceph/reef-release/0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28/centos/9/flavors/default/ 2026-02-25T17:13:49.320 DEBUG:teuthology.orchestra.run.trial076:> sudo rm -f /etc/yum.repos.d/ceph.repo 2026-02-25T17:13:49.474 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef-release/0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef-release/0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef-release/0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-25T17:13:49.474 DEBUG:teuthology.orchestra.run.trial076:> set -ex 2026-02-25T17:13:49.474 DEBUG:teuthology.orchestra.run.trial076:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-25T17:13:49.499 DEBUG:teuthology.orchestra.run.trial076:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-25T17:13:49.564 DEBUG:teuthology.orchestra.run.trial076:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-25T17:13:49.628 DEBUG:teuthology.orchestra.run.trial076:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-25T17:13:49.683 INFO:teuthology.orchestra.run.trial076.stdout:check_obsoletes = 1 2026-02-25T17:13:49.693 DEBUG:teuthology.orchestra.run.trial076:> sudo yum clean all 2026-02-25T17:13:49.854 INFO:teuthology.orchestra.run.trial076.stdout:56 files removed 2026-02-25T17:13:49.870 DEBUG:teuthology.orchestra.run.trial076:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2026-02-25T17:13:50.154 INFO:teuthology.orchestra.run.trial076.stdout:ceph packages for x86_64 585 kB/s | 79 kB 00:00 2026-02-25T17:13:50.289 INFO:teuthology.orchestra.run.trial076.stdout:ceph noarch packages 108 kB/s | 12 kB 00:00 2026-02-25T17:13:50.417 INFO:teuthology.orchestra.run.trial076.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-25T17:13:53.365 INFO:teuthology.orchestra.run.trial076.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.9 MB 00:02 2026-02-25T17:13:56.713 INFO:teuthology.orchestra.run.trial076.stdout:CentOS Stream 9 - AppStream 9.6 MB/s | 27 MB 00:02 2026-02-25T17:14:01.492 INFO:teuthology.orchestra.run.trial076.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 8.0 MB 00:02 2026-02-25T17:14:03.300 INFO:teuthology.orchestra.run.trial076.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 20 kB 00:01 2026-02-25T17:14:04.545 INFO:teuthology.orchestra.run.trial076.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2026-02-25T17:14:07.752 INFO:teuthology.orchestra.run.trial076.stdout:lab-extras 1.4 MB/s | 50 kB 00:00 2026-02-25T17:14:08.948 INFO:teuthology.orchestra.run.trial076.stderr:Package cephadm available, but not installed. 2026-02-25T17:14:08.949 INFO:teuthology.orchestra.run.trial076.stdout:No match for argument: cephadm 2026-02-25T17:14:08.951 INFO:teuthology.orchestra.run.trial076.stderr:Package ceph-mgr-dashboard available, but not installed. 2026-02-25T17:14:08.951 INFO:teuthology.orchestra.run.trial076.stdout:No match for argument: ceph-mgr-dashboard 2026-02-25T17:14:08.952 INFO:teuthology.orchestra.run.trial076.stderr:Package ceph-mgr-diskprediction-local available, but not installed. 2026-02-25T17:14:08.952 INFO:teuthology.orchestra.run.trial076.stdout:No match for argument: ceph-mgr-diskprediction-local 2026-02-25T17:14:08.952 INFO:teuthology.orchestra.run.trial076.stderr:Package ceph-mgr-rook available, but not installed. 2026-02-25T17:14:08.953 INFO:teuthology.orchestra.run.trial076.stdout:No match for argument: ceph-mgr-rook 2026-02-25T17:14:08.953 INFO:teuthology.orchestra.run.trial076.stderr:Package ceph-mgr-cephadm available, but not installed. 2026-02-25T17:14:08.953 INFO:teuthology.orchestra.run.trial076.stdout:No match for argument: ceph-mgr-cephadm 2026-02-25T17:14:08.954 INFO:teuthology.orchestra.run.trial076.stderr:Package ceph-volume available, but not installed. 2026-02-25T17:14:08.954 INFO:teuthology.orchestra.run.trial076.stdout:No match for argument: ceph-volume 2026-02-25T17:14:08.990 INFO:teuthology.orchestra.run.trial076.stdout:Dependencies resolved. 2026-02-25T17:14:08.991 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:14:08.991 INFO:teuthology.orchestra.run.trial076.stdout: Package Arch Version Repository Size 2026-02-25T17:14:08.991 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:14:08.992 INFO:teuthology.orchestra.run.trial076.stdout:Upgrading: 2026-02-25T17:14:08.992 INFO:teuthology.orchestra.run.trial076.stdout: ceph x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 6.5 k 2026-02-25T17:14:08.992 INFO:teuthology.orchestra.run.trial076.stdout: ceph-base x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 5.1 M 2026-02-25T17:14:08.992 INFO:teuthology.orchestra.run.trial076.stdout: ceph-common x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 18 M 2026-02-25T17:14:08.992 INFO:teuthology.orchestra.run.trial076.stdout: ceph-fuse x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 850 k 2026-02-25T17:14:08.992 INFO:teuthology.orchestra.run.trial076.stdout: ceph-immutable-object-cache 2026-02-25T17:14:08.992 INFO:teuthology.orchestra.run.trial076.stdout: x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 142 k 2026-02-25T17:14:08.992 INFO:teuthology.orchestra.run.trial076.stdout: ceph-mds x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 2.1 M 2026-02-25T17:14:08.992 INFO:teuthology.orchestra.run.trial076.stdout: ceph-mgr x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 1.5 M 2026-02-25T17:14:08.992 INFO:teuthology.orchestra.run.trial076.stdout: ceph-mgr-modules-core noarch 2:18.2.7-1050.g0ef62ce8.el9 ceph-noarch 248 k 2026-02-25T17:14:08.992 INFO:teuthology.orchestra.run.trial076.stdout: ceph-mon x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 4.7 M 2026-02-25T17:14:08.993 INFO:teuthology.orchestra.run.trial076.stdout: ceph-osd x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 17 M 2026-02-25T17:14:08.993 INFO:teuthology.orchestra.run.trial076.stdout: ceph-radosgw x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 7.8 M 2026-02-25T17:14:08.993 INFO:teuthology.orchestra.run.trial076.stdout: ceph-selinux x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 25 k 2026-02-25T17:14:08.993 INFO:teuthology.orchestra.run.trial076.stdout: ceph-test x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 36 M 2026-02-25T17:14:08.993 INFO:teuthology.orchestra.run.trial076.stdout: libcephfs-devel x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 31 k 2026-02-25T17:14:08.993 INFO:teuthology.orchestra.run.trial076.stdout: libcephfs2 x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 711 k 2026-02-25T17:14:08.993 INFO:teuthology.orchestra.run.trial076.stdout: libcephsqlite x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 166 k 2026-02-25T17:14:08.993 INFO:teuthology.orchestra.run.trial076.stdout: librados-devel x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 126 k 2026-02-25T17:14:08.993 INFO:teuthology.orchestra.run.trial076.stdout: librados2 x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 3.3 M 2026-02-25T17:14:08.993 INFO:teuthology.orchestra.run.trial076.stdout: libradosstriper1 x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 475 k 2026-02-25T17:14:08.993 INFO:teuthology.orchestra.run.trial076.stdout: librbd1 x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 3.0 M 2026-02-25T17:14:08.993 INFO:teuthology.orchestra.run.trial076.stdout: librgw2 x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 4.5 M 2026-02-25T17:14:08.993 INFO:teuthology.orchestra.run.trial076.stdout: python3-ceph-argparse x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 45 k 2026-02-25T17:14:08.994 INFO:teuthology.orchestra.run.trial076.stdout: python3-ceph-common x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 130 k 2026-02-25T17:14:08.994 INFO:teuthology.orchestra.run.trial076.stdout: python3-cephfs x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 162 k 2026-02-25T17:14:08.994 INFO:teuthology.orchestra.run.trial076.stdout: python3-rados x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 323 k 2026-02-25T17:14:08.994 INFO:teuthology.orchestra.run.trial076.stdout: python3-rbd x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 302 k 2026-02-25T17:14:08.994 INFO:teuthology.orchestra.run.trial076.stdout: python3-rgw x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 100 k 2026-02-25T17:14:08.994 INFO:teuthology.orchestra.run.trial076.stdout: rbd-fuse x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 87 k 2026-02-25T17:14:08.994 INFO:teuthology.orchestra.run.trial076.stdout: rbd-mirror x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 3.0 M 2026-02-25T17:14:08.994 INFO:teuthology.orchestra.run.trial076.stdout: rbd-nbd x86_64 2:18.2.7-1050.g0ef62ce8.el9 ceph 172 k 2026-02-25T17:14:08.994 INFO:teuthology.orchestra.run.trial076.stdout:Installing dependencies: 2026-02-25T17:14:08.994 INFO:teuthology.orchestra.run.trial076.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-25T17:14:08.994 INFO:teuthology.orchestra.run.trial076.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2026-02-25T17:14:08.994 INFO:teuthology.orchestra.run.trial076.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-25T17:14:08.994 INFO:teuthology.orchestra.run.trial076.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-25T17:14:08.995 INFO:teuthology.orchestra.run.trial076.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-25T17:14:08.995 INFO:teuthology.orchestra.run.trial076.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-25T17:14:08.995 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:14:08.995 INFO:teuthology.orchestra.run.trial076.stdout:Transaction Summary 2026-02-25T17:14:08.995 INFO:teuthology.orchestra.run.trial076.stdout:================================================================================ 2026-02-25T17:14:08.995 INFO:teuthology.orchestra.run.trial076.stdout:Install 6 Packages 2026-02-25T17:14:08.995 INFO:teuthology.orchestra.run.trial076.stdout:Upgrade 30 Packages 2026-02-25T17:14:08.995 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:14:08.996 INFO:teuthology.orchestra.run.trial076.stdout:Total download size: 116 M 2026-02-25T17:14:08.996 INFO:teuthology.orchestra.run.trial076.stdout:Downloading Packages: 2026-02-25T17:14:10.563 INFO:teuthology.orchestra.run.trial076.stdout:(1/36): boost-program-options-1.75.0-13.el9.x86 138 kB/s | 104 kB 00:00 2026-02-25T17:16:21.838 INFO:teuthology.orchestra.run.trial076.stdout:[MIRROR] fmt-8.1.1-5.el9.x86_64.rpm: Curl error (28): Timeout was reached for https://cfhcable.mm.fcix.net/epel/9/Everything/x86_64/Packages/f/fmt-8.1.1-5.el9.x86_64.rpm [Failed to connect to cfhcable.mm.fcix.net port 443: Connection timed out] 2026-02-25T17:16:21.838 INFO:teuthology.orchestra.run.trial076.stdout:[MIRROR] libarrow-9.0.0-15.el9.x86_64.rpm: Curl error (28): Timeout was reached for https://cfhcable.mm.fcix.net/epel/9/Everything/x86_64/Packages/l/libarrow-9.0.0-15.el9.x86_64.rpm [Failed to connect to cfhcable.mm.fcix.net port 443: Connection timed out] 2026-02-25T17:16:21.838 INFO:teuthology.orchestra.run.trial076.stdout:[MIRROR] libarrow-doc-9.0.0-15.el9.noarch.rpm: Curl error (28): Timeout was reached for https://cfhcable.mm.fcix.net/epel/9/Everything/x86_64/Packages/l/libarrow-doc-9.0.0-15.el9.noarch.rpm [Failed to connect to cfhcable.mm.fcix.net port 443: Connection timed out] 2026-02-25T17:16:31.860 INFO:teuthology.orchestra.run.trial076.stdout:[MIRROR] libarrow-9.0.0-15.el9.x86_64.rpm: Curl error (6): Couldn't resolve host name for http://lesnet.mm.fcix.net/epel/9/Everything/x86_64/Packages/l/libarrow-9.0.0-15.el9.x86_64.rpm [Could not resolve host: lesnet.mm.fcix.net] 2026-02-25T17:16:31.860 INFO:teuthology.orchestra.run.trial076.stdout:[MIRROR] libarrow-doc-9.0.0-15.el9.noarch.rpm: Curl error (6): Couldn't resolve host name for http://lesnet.mm.fcix.net/epel/9/Everything/x86_64/Packages/l/libarrow-doc-9.0.0-15.el9.noarch.rpm [Could not resolve host: lesnet.mm.fcix.net] 2026-02-25T17:16:31.860 INFO:teuthology.orchestra.run.trial076.stdout:[MIRROR] fmt-8.1.1-5.el9.x86_64.rpm: Curl error (6): Couldn't resolve host name for http://lesnet.mm.fcix.net/epel/9/Everything/x86_64/Packages/f/fmt-8.1.1-5.el9.x86_64.rpm [Could not resolve host: lesnet.mm.fcix.net] 2026-02-25T17:18:41.141 INFO:teuthology.orchestra.run.trial076.stdout:[MIRROR] libarrow-9.0.0-15.el9.x86_64.rpm: Curl error (28): Timeout was reached for http://cfhcable.mm.fcix.net/epel/9/Everything/x86_64/Packages/l/libarrow-9.0.0-15.el9.x86_64.rpm [Failed to connect to cfhcable.mm.fcix.net port 80: Connection timed out] 2026-02-25T17:18:41.141 INFO:teuthology.orchestra.run.trial076.stdout:[MIRROR] libarrow-doc-9.0.0-15.el9.noarch.rpm: Curl error (28): Timeout was reached for http://cfhcable.mm.fcix.net/epel/9/Everything/x86_64/Packages/l/libarrow-doc-9.0.0-15.el9.noarch.rpm [Failed to connect to cfhcable.mm.fcix.net port 80: Connection timed out] 2026-02-25T17:18:41.141 INFO:teuthology.orchestra.run.trial076.stdout:[MIRROR] fmt-8.1.1-5.el9.x86_64.rpm: Curl error (28): Timeout was reached for http://cfhcable.mm.fcix.net/epel/9/Everything/x86_64/Packages/f/fmt-8.1.1-5.el9.x86_64.rpm [Failed to connect to cfhcable.mm.fcix.net port 80: Connection timed out] 2026-02-25T17:18:41.226 INFO:teuthology.orchestra.run.trial076.stdout:(2/36): libarrow-doc-9.0.0-15.el9.noarch.rpm 94 B/s | 25 kB 04:30 2026-02-25T17:18:41.392 INFO:teuthology.orchestra.run.trial076.stdout:(3/36): libarrow-9.0.0-15.el9.x86_64.rpm 17 kB/s | 4.4 MB 04:31 2026-02-25T17:18:41.519 INFO:teuthology.orchestra.run.trial076.stdout:(4/36): parquet-libs-9.0.0-15.el9.x86_64.rpm 2.8 MB/s | 838 kB 00:00 2026-02-25T17:18:41.585 INFO:teuthology.orchestra.run.trial076.stdout:(5/36): ceph-18.2.7-1050.g0ef62ce8.el9.x86_64.r 99 kB/s | 6.5 kB 00:00 2026-02-25T17:18:41.601 INFO:teuthology.orchestra.run.trial076.stdout:(6/36): re2-20211101-20.el9.x86_64.rpm 914 kB/s | 191 kB 00:00 2026-02-25T17:18:41.733 INFO:teuthology.orchestra.run.trial076.stdout:(7/36): ceph-base-18.2.7-1050.g0ef62ce8.el9.x86 35 MB/s | 5.1 MB 00:00 2026-02-25T17:18:41.750 INFO:teuthology.orchestra.run.trial076.stdout:(8/36): ceph-fuse-18.2.7-1050.g0ef62ce8.el9.x86 49 MB/s | 850 kB 00:00 2026-02-25T17:18:41.762 INFO:teuthology.orchestra.run.trial076.stdout:(9/36): ceph-immutable-object-cache-18.2.7-1050 12 MB/s | 142 kB 00:00 2026-02-25T17:18:41.803 INFO:teuthology.orchestra.run.trial076.stdout:(10/36): ceph-mds-18.2.7-1050.g0ef62ce8.el9.x86 52 MB/s | 2.1 MB 00:00 2026-02-25T17:18:41.831 INFO:teuthology.orchestra.run.trial076.stdout:(11/36): ceph-mgr-18.2.7-1050.g0ef62ce8.el9.x86 52 MB/s | 1.5 MB 00:00 2026-02-25T17:18:41.922 INFO:teuthology.orchestra.run.trial076.stdout:(12/36): ceph-mon-18.2.7-1050.g0ef62ce8.el9.x86 52 MB/s | 4.7 MB 00:00 2026-02-25T17:18:42.248 INFO:teuthology.orchestra.run.trial076.stdout:(13/36): ceph-osd-18.2.7-1050.g0ef62ce8.el9.x86 51 MB/s | 17 MB 00:00 2026-02-25T17:18:42.405 INFO:teuthology.orchestra.run.trial076.stdout:(14/36): ceph-radosgw-18.2.7-1050.g0ef62ce8.el9 50 MB/s | 7.8 MB 00:00 2026-02-25T17:18:42.416 INFO:teuthology.orchestra.run.trial076.stdout:(15/36): ceph-selinux-18.2.7-1050.g0ef62ce8.el9 2.1 MB/s | 25 kB 00:00 2026-02-25T17:18:43.184 INFO:teuthology.orchestra.run.trial076.stdout:(16/36): ceph-test-18.2.7-1050.g0ef62ce8.el9.x8 47 MB/s | 36 MB 00:00 2026-02-25T17:18:43.195 INFO:teuthology.orchestra.run.trial076.stdout:(17/36): libcephfs-devel-18.2.7-1050.g0ef62ce8. 2.6 MB/s | 31 kB 00:00 2026-02-25T17:18:43.210 INFO:teuthology.orchestra.run.trial076.stdout:(18/36): libcephfs2-18.2.7-1050.g0ef62ce8.el9.x 49 MB/s | 711 kB 00:00 2026-02-25T17:18:43.224 INFO:teuthology.orchestra.run.trial076.stdout:(19/36): libcephsqlite-18.2.7-1050.g0ef62ce8.el 11 MB/s | 166 kB 00:00 2026-02-25T17:18:43.237 INFO:teuthology.orchestra.run.trial076.stdout:(20/36): librados-devel-18.2.7-1050.g0ef62ce8.e 9.8 MB/s | 126 kB 00:00 2026-02-25T17:18:43.322 INFO:teuthology.orchestra.run.trial076.stdout:(21/36): librados2-18.2.7-1050.g0ef62ce8.el9.x8 39 MB/s | 3.3 MB 00:00 2026-02-25T17:18:43.344 INFO:teuthology.orchestra.run.trial076.stdout:(22/36): libradosstriper1-18.2.7-1050.g0ef62ce8 21 MB/s | 475 kB 00:00 2026-02-25T17:18:43.427 INFO:teuthology.orchestra.run.trial076.stdout:(23/36): librbd1-18.2.7-1050.g0ef62ce8.el9.x86_ 37 MB/s | 3.0 MB 00:00 2026-02-25T17:18:43.543 INFO:teuthology.orchestra.run.trial076.stdout:(24/36): librgw2-18.2.7-1050.g0ef62ce8.el9.x86_ 39 MB/s | 4.5 MB 00:00 2026-02-25T17:18:43.568 INFO:teuthology.orchestra.run.trial076.stdout:(25/36): ceph-common-18.2.7-1050.g0ef62ce8.el9. 9.4 MB/s | 18 MB 00:01 2026-02-25T17:18:43.569 INFO:teuthology.orchestra.run.trial076.stdout:(26/36): python3-ceph-argparse-18.2.7-1050.g0ef 1.7 MB/s | 45 kB 00:00 2026-02-25T17:18:43.580 INFO:teuthology.orchestra.run.trial076.stdout:(27/36): python3-ceph-common-18.2.7-1050.g0ef62 10 MB/s | 130 kB 00:00 2026-02-25T17:18:43.581 INFO:teuthology.orchestra.run.trial076.stdout:(28/36): python3-cephfs-18.2.7-1050.g0ef62ce8.e 13 MB/s | 162 kB 00:00 2026-02-25T17:18:43.593 INFO:teuthology.orchestra.run.trial076.stdout:(29/36): python3-rados-18.2.7-1050.g0ef62ce8.el 25 MB/s | 323 kB 00:00 2026-02-25T17:18:43.594 INFO:teuthology.orchestra.run.trial076.stdout:(30/36): python3-rbd-18.2.7-1050.g0ef62ce8.el9. 23 MB/s | 302 kB 00:00 2026-02-25T17:18:43.605 INFO:teuthology.orchestra.run.trial076.stdout:(31/36): python3-rgw-18.2.7-1050.g0ef62ce8.el9. 8.2 MB/s | 100 kB 00:00 2026-02-25T17:18:43.606 INFO:teuthology.orchestra.run.trial076.stdout:(32/36): rbd-fuse-18.2.7-1050.g0ef62ce8.el9.x86 7.3 MB/s | 87 kB 00:00 2026-02-25T17:18:43.627 INFO:teuthology.orchestra.run.trial076.stdout:(33/36): rbd-nbd-18.2.7-1050.g0ef62ce8.el9.x86_ 7.9 MB/s | 172 kB 00:00 2026-02-25T17:18:43.650 INFO:teuthology.orchestra.run.trial076.stdout:(34/36): ceph-mgr-modules-core-18.2.7-1050.g0ef 11 MB/s | 248 kB 00:00 2026-02-25T17:18:43.669 INFO:teuthology.orchestra.run.trial076.stdout:(35/36): rbd-mirror-18.2.7-1050.g0ef62ce8.el9.x 47 MB/s | 3.0 MB 00:00 2026-02-25T17:20:52.238 INFO:teuthology.orchestra.run.trial076.stdout:[MIRROR] fmt-8.1.1-5.el9.x86_64.rpm: Curl error (28): Timeout was reached for https://cfhcable.mm.fcix.net/epel/9/Everything/x86_64/Packages/f/fmt-8.1.1-5.el9.x86_64.rpm [Failed to connect to cfhcable.mm.fcix.net port 443: Connection timed out] 2026-02-25T17:20:52.372 INFO:teuthology.orchestra.run.trial076.stdout:(36/36): fmt-8.1.1-5.el9.x86_64.rpm 281 B/s | 111 kB 06:42 2026-02-25T17:20:52.372 INFO:teuthology.orchestra.run.trial076.stdout:-------------------------------------------------------------------------------- 2026-02-25T17:20:52.372 INFO:teuthology.orchestra.run.trial076.stdout:Total 295 kB/s | 116 MB 06:43 2026-02-25T17:20:52.380 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction check 2026-02-25T17:20:52.403 INFO:teuthology.orchestra.run.trial076.stdout:Transaction check succeeded. 2026-02-25T17:20:52.404 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction test 2026-02-25T17:20:52.799 INFO:teuthology.orchestra.run.trial076.stdout:Transaction test succeeded. 2026-02-25T17:20:52.799 INFO:teuthology.orchestra.run.trial076.stdout:Running transaction 2026-02-25T17:20:53.374 INFO:teuthology.orchestra.run.trial076.stdout: Preparing : 1/1 2026-02-25T17:20:53.381 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : librados2-2:18.2.7-1050.g0ef62ce8.el9.x86_64 1/66 2026-02-25T17:20:53.537 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: librados2-2:18.2.7-1050.g0ef62ce8.el9.x86_64 1/66 2026-02-25T17:20:53.539 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : librbd1-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2/66 2026-02-25T17:20:53.578 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: librbd1-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2/66 2026-02-25T17:20:53.579 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : libcephfs2-2:18.2.7-1050.g0ef62ce8.el9.x86_64 3/66 2026-02-25T17:20:53.604 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: libcephfs2-2:18.2.7-1050.g0ef62ce8.el9.x86_64 3/66 2026-02-25T17:20:53.612 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : python3-rados-2:18.2.7-1050.g0ef62ce8.el9.x86_64 4/66 2026-02-25T17:20:53.613 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : libcephsqlite-2:18.2.7-1050.g0ef62ce8.el9.x86_64 5/66 2026-02-25T17:20:53.645 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: libcephsqlite-2:18.2.7-1050.g0ef62ce8.el9.x86_64 5/66 2026-02-25T17:20:53.646 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : libradosstriper1-2:18.2.7-1050.g0ef62ce8.el9.x86_6 6/66 2026-02-25T17:20:53.659 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: libradosstriper1-2:18.2.7-1050.g0ef62ce8.el9.x86_6 6/66 2026-02-25T17:20:53.669 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : python3-ceph-argparse-2:18.2.7-1050.g0ef62ce8.el9. 7/66 2026-02-25T17:20:53.685 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : python3-cephfs-2:18.2.7-1050.g0ef62ce8.el9.x86_64 8/66 2026-02-25T17:20:53.693 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : python3-rbd-2:18.2.7-1050.g0ef62ce8.el9.x86_64 9/66 2026-02-25T17:20:53.738 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : librados-devel-2:18.2.7-1050.g0ef62ce8.el9.x86_64 10/66 2026-02-25T17:20:53.762 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : ceph-mgr-modules-core-2:18.2.7-1050.g0ef62ce8.el9. 11/66 2026-02-25T17:20:53.766 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : python3-ceph-common-2:18.2.7-1050.g0ef62ce8.el9.x8 12/66 2026-02-25T17:20:53.798 INFO:teuthology.orchestra.run.trial076.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/66 2026-02-25T17:20:53.800 INFO:teuthology.orchestra.run.trial076.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/66 2026-02-25T17:20:53.802 INFO:teuthology.orchestra.run.trial076.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 15/66 2026-02-25T17:20:53.805 INFO:teuthology.orchestra.run.trial076.stdout: Installing : fmt-8.1.1-5.el9.x86_64 16/66 2026-02-25T17:20:53.811 INFO:teuthology.orchestra.run.trial076.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 17/66 2026-02-25T17:20:54.006 INFO:teuthology.orchestra.run.trial076.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 18/66 2026-02-25T17:20:54.014 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : librgw2-2:18.2.7-1050.g0ef62ce8.el9.x86_64 19/66 2026-02-25T17:20:54.029 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: librgw2-2:18.2.7-1050.g0ef62ce8.el9.x86_64 19/66 2026-02-25T17:20:54.030 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : python3-rgw-2:18.2.7-1050.g0ef62ce8.el9.x86_64 20/66 2026-02-25T17:20:54.920 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-common-2:18.2.7-1050.g0ef62ce8.el9.x86_64 21/66 2026-02-25T17:20:54.941 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : ceph-common-2:18.2.7-1050.g0ef62ce8.el9.x86_64 21/66 2026-02-25T17:20:55.217 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-common-2:18.2.7-1050.g0ef62ce8.el9.x86_64 21/66 2026-02-25T17:20:55.224 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : ceph-base-2:18.2.7-1050.g0ef62ce8.el9.x86_64 22/66 2026-02-25T17:20:55.237 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-base-2:18.2.7-1050.g0ef62ce8.el9.x86_64 22/66 2026-02-25T17:20:55.238 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : ceph-selinux-2:18.2.7-1050.g0ef62ce8.el9.x86_64 23/66 2026-02-25T17:20:59.398 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-selinux-2:18.2.7-1050.g0ef62ce8.el9.x86_64 23/66 2026-02-25T17:20:59.400 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : ceph-mds-2:18.2.7-1050.g0ef62ce8.el9.x86_64 24/66 2026-02-25T17:20:59.470 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-mds-2:18.2.7-1050.g0ef62ce8.el9.x86_64 24/66 2026-02-25T17:20:59.471 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : ceph-mgr-2:18.2.7-1050.g0ef62ce8.el9.x86_64 25/66 2026-02-25T17:20:59.689 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-mgr-2:18.2.7-1050.g0ef62ce8.el9.x86_64 25/66 2026-02-25T17:20:59.699 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : ceph-mon-2:18.2.7-1050.g0ef62ce8.el9.x86_64 26/66 2026-02-25T17:21:00.445 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-mon-2:18.2.7-1050.g0ef62ce8.el9.x86_64 26/66 2026-02-25T17:21:00.461 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : ceph-osd-2:18.2.7-1050.g0ef62ce8.el9.x86_64 27/66 2026-02-25T17:21:00.469 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-osd-2:18.2.7-1050.g0ef62ce8.el9.x86_64 27/66 2026-02-25T17:21:00.831 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : ceph-2:18.2.7-1050.g0ef62ce8.el9.x86_64 28/66 2026-02-25T17:21:00.844 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : ceph-radosgw-2:18.2.7-1050.g0ef62ce8.el9.x86_64 29/66 2026-02-25T17:21:00.856 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-radosgw-2:18.2.7-1050.g0ef62ce8.el9.x86_64 29/66 2026-02-25T17:21:00.857 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : ceph-immutable-object-cache-2:18.2.7-1050.g0ef62ce 30/66 2026-02-25T17:21:00.998 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.7-1050.g0ef62ce 30/66 2026-02-25T17:21:01.002 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : rbd-mirror-2:18.2.7-1050.g0ef62ce8.el9.x86_64 31/66 2026-02-25T17:21:02.824 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: rbd-mirror-2:18.2.7-1050.g0ef62ce8.el9.x86_64 31/66 2026-02-25T17:21:02.833 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : ceph-test-2:18.2.7-1050.g0ef62ce8.el9.x86_64 32/66 2026-02-25T17:21:02.838 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : libcephfs-devel-2:18.2.7-1050.g0ef62ce8.el9.x86_64 33/66 2026-02-25T17:21:02.847 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : rbd-fuse-2:18.2.7-1050.g0ef62ce8.el9.x86_64 34/66 2026-02-25T17:21:02.886 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : rbd-nbd-2:18.2.7-1050.g0ef62ce8.el9.x86_64 35/66 2026-02-25T17:21:02.887 INFO:teuthology.orchestra.run.trial076.stdout: Upgrading : ceph-fuse-2:18.2.7-1050.g0ef62ce8.el9.x86_64 36/66 2026-02-25T17:21:02.893 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : ceph-2:17.2.9-0.el9.x86_64 37/66 2026-02-25T17:21:02.896 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : ceph-test-2:17.2.9-0.el9.x86_64 38/66 2026-02-25T17:21:02.904 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-radosgw-2:17.2.9-0.el9.x86_64 39/66 2026-02-25T17:21:02.904 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : ceph-radosgw-2:17.2.9-0.el9.x86_64 39/66 2026-02-25T17:21:02.918 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-radosgw-2:17.2.9-0.el9.x86_64 39/66 2026-02-25T17:21:02.919 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : rbd-nbd-2:17.2.9-0.el9.x86_64 40/66 2026-02-25T17:21:02.924 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: rbd-mirror-2:17.2.9-0.el9.x86_64 41/66 2026-02-25T17:21:02.924 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : rbd-mirror-2:17.2.9-0.el9.x86_64 41/66 2026-02-25T17:21:02.931 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: rbd-mirror-2:17.2.9-0.el9.x86_64 41/66 2026-02-25T17:21:02.936 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-mgr-2:17.2.9-0.el9.x86_64 42/66 2026-02-25T17:21:02.936 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : ceph-mgr-2:17.2.9-0.el9.x86_64 42/66 2026-02-25T17:21:02.942 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-mgr-2:17.2.9-0.el9.x86_64 42/66 2026-02-25T17:21:02.944 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : rbd-fuse-2:17.2.9-0.el9.x86_64 43/66 2026-02-25T17:21:02.949 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 44/66 2026-02-25T17:21:02.949 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 44/66 2026-02-25T17:21:02.955 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 44/66 2026-02-25T17:21:02.956 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : libcephfs-devel-2:17.2.9-0.el9.x86_64 45/66 2026-02-25T17:21:02.957 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : libcephsqlite-2:17.2.9-0.el9.x86_64 46/66 2026-02-25T17:21:02.967 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: libcephsqlite-2:17.2.9-0.el9.x86_64 46/66 2026-02-25T17:21:02.968 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : librados-devel-2:17.2.9-0.el9.x86_64 47/66 2026-02-25T17:21:02.972 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-mds-2:17.2.9-0.el9.x86_64 48/66 2026-02-25T17:21:02.972 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : ceph-mds-2:17.2.9-0.el9.x86_64 48/66 2026-02-25T17:21:02.978 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-mds-2:17.2.9-0.el9.x86_64 48/66 2026-02-25T17:21:02.982 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-mon-2:17.2.9-0.el9.x86_64 49/66 2026-02-25T17:21:02.983 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : ceph-mon-2:17.2.9-0.el9.x86_64 49/66 2026-02-25T17:21:02.989 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-mon-2:17.2.9-0.el9.x86_64 49/66 2026-02-25T17:21:02.994 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-osd-2:17.2.9-0.el9.x86_64 50/66 2026-02-25T17:21:02.994 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : ceph-osd-2:17.2.9-0.el9.x86_64 50/66 2026-02-25T17:21:03.001 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-osd-2:17.2.9-0.el9.x86_64 50/66 2026-02-25T17:21:03.001 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : ceph-selinux-2:17.2.9-0.el9.x86_64 51/66 2026-02-25T17:21:03.007 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-selinux-2:17.2.9-0.el9.x86_64 51/66 2026-02-25T17:21:03.013 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-base-2:17.2.9-0.el9.x86_64 52/66 2026-02-25T17:21:03.013 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : ceph-base-2:17.2.9-0.el9.x86_64 52/66 2026-02-25T17:21:03.027 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-base-2:17.2.9-0.el9.x86_64 52/66 2026-02-25T17:21:03.027 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : ceph-common-2:17.2.9-0.el9.x86_64 53/66 2026-02-25T17:21:03.035 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: ceph-common-2:17.2.9-0.el9.x86_64 53/66 2026-02-25T17:21:03.036 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : libradosstriper1-2:17.2.9-0.el9.x86_64 54/66 2026-02-25T17:21:03.047 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: libradosstriper1-2:17.2.9-0.el9.x86_64 54/66 2026-02-25T17:21:03.048 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : python3-cephfs-2:17.2.9-0.el9.x86_64 55/66 2026-02-25T17:21:03.049 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : python3-rbd-2:17.2.9-0.el9.x86_64 56/66 2026-02-25T17:21:03.049 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : librbd1-2:17.2.9-0.el9.x86_64 57/66 2026-02-25T17:21:03.059 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: librbd1-2:17.2.9-0.el9.x86_64 57/66 2026-02-25T17:21:03.061 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : python3-rgw-2:17.2.9-0.el9.x86_64 58/66 2026-02-25T17:21:03.061 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : librgw2-2:17.2.9-0.el9.x86_64 59/66 2026-02-25T17:21:03.071 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: librgw2-2:17.2.9-0.el9.x86_64 59/66 2026-02-25T17:21:03.072 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : python3-rados-2:17.2.9-0.el9.x86_64 60/66 2026-02-25T17:21:03.072 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : libcephfs2-2:17.2.9-0.el9.x86_64 61/66 2026-02-25T17:21:03.082 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: libcephfs2-2:17.2.9-0.el9.x86_64 61/66 2026-02-25T17:21:03.084 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : ceph-fuse-2:17.2.9-0.el9.x86_64 62/66 2026-02-25T17:21:03.085 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : python3-ceph-argparse-2:17.2.9-0.el9.x86_64 63/66 2026-02-25T17:21:03.086 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : python3-ceph-common-2:17.2.9-0.el9.x86_64 64/66 2026-02-25T17:21:03.088 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : ceph-mgr-modules-core-2:17.2.9-0.el9.noarch 65/66 2026-02-25T17:21:03.088 INFO:teuthology.orchestra.run.trial076.stdout: Cleanup : librados2-2:17.2.9-0.el9.x86_64 66/66 2026-02-25T17:21:03.434 INFO:teuthology.orchestra.run.trial076.stdout: Running scriptlet: librados2-2:17.2.9-0.el9.x86_64 66/66 2026-02-25T17:21:03.434 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 1/66 2026-02-25T17:21:03.435 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 2/66 2026-02-25T17:21:03.435 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 3/66 2026-02-25T17:21:03.435 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 4/66 2026-02-25T17:21:03.435 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 5/66 2026-02-25T17:21:03.435 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : re2-1:20211101-20.el9.x86_64 6/66 2026-02-25T17:21:03.435 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-2:18.2.7-1050.g0ef62ce8.el9.x86_64 7/66 2026-02-25T17:21:03.435 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-2:17.2.9-0.el9.x86_64 8/66 2026-02-25T17:21:03.435 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-base-2:18.2.7-1050.g0ef62ce8.el9.x86_64 9/66 2026-02-25T17:21:03.435 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-base-2:17.2.9-0.el9.x86_64 10/66 2026-02-25T17:21:03.435 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-common-2:18.2.7-1050.g0ef62ce8.el9.x86_64 11/66 2026-02-25T17:21:03.435 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-common-2:17.2.9-0.el9.x86_64 12/66 2026-02-25T17:21:03.435 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-fuse-2:18.2.7-1050.g0ef62ce8.el9.x86_64 13/66 2026-02-25T17:21:03.436 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-fuse-2:17.2.9-0.el9.x86_64 14/66 2026-02-25T17:21:03.436 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-immutable-object-cache-2:18.2.7-1050.g0ef62ce 15/66 2026-02-25T17:21:03.436 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 16/66 2026-02-25T17:21:03.436 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-mds-2:18.2.7-1050.g0ef62ce8.el9.x86_64 17/66 2026-02-25T17:21:03.436 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-mds-2:17.2.9-0.el9.x86_64 18/66 2026-02-25T17:21:03.436 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-mgr-2:18.2.7-1050.g0ef62ce8.el9.x86_64 19/66 2026-02-25T17:21:03.436 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-mgr-2:17.2.9-0.el9.x86_64 20/66 2026-02-25T17:21:03.436 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-mon-2:18.2.7-1050.g0ef62ce8.el9.x86_64 21/66 2026-02-25T17:21:03.436 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-mon-2:17.2.9-0.el9.x86_64 22/66 2026-02-25T17:21:03.436 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-osd-2:18.2.7-1050.g0ef62ce8.el9.x86_64 23/66 2026-02-25T17:21:03.436 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-osd-2:17.2.9-0.el9.x86_64 24/66 2026-02-25T17:21:03.436 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-radosgw-2:18.2.7-1050.g0ef62ce8.el9.x86_64 25/66 2026-02-25T17:21:03.436 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-radosgw-2:17.2.9-0.el9.x86_64 26/66 2026-02-25T17:21:03.437 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-selinux-2:18.2.7-1050.g0ef62ce8.el9.x86_64 27/66 2026-02-25T17:21:03.437 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-selinux-2:17.2.9-0.el9.x86_64 28/66 2026-02-25T17:21:03.437 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-test-2:18.2.7-1050.g0ef62ce8.el9.x86_64 29/66 2026-02-25T17:21:03.437 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-test-2:17.2.9-0.el9.x86_64 30/66 2026-02-25T17:21:03.437 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : libcephfs-devel-2:18.2.7-1050.g0ef62ce8.el9.x86_64 31/66 2026-02-25T17:21:03.437 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : libcephfs-devel-2:17.2.9-0.el9.x86_64 32/66 2026-02-25T17:21:03.437 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : libcephfs2-2:18.2.7-1050.g0ef62ce8.el9.x86_64 33/66 2026-02-25T17:21:03.437 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : libcephfs2-2:17.2.9-0.el9.x86_64 34/66 2026-02-25T17:21:03.437 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : libcephsqlite-2:18.2.7-1050.g0ef62ce8.el9.x86_64 35/66 2026-02-25T17:21:03.437 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : libcephsqlite-2:17.2.9-0.el9.x86_64 36/66 2026-02-25T17:21:03.437 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : librados-devel-2:18.2.7-1050.g0ef62ce8.el9.x86_64 37/66 2026-02-25T17:21:03.437 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : librados-devel-2:17.2.9-0.el9.x86_64 38/66 2026-02-25T17:21:03.437 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : librados2-2:18.2.7-1050.g0ef62ce8.el9.x86_64 39/66 2026-02-25T17:21:03.438 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : librados2-2:17.2.9-0.el9.x86_64 40/66 2026-02-25T17:21:03.438 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : libradosstriper1-2:18.2.7-1050.g0ef62ce8.el9.x86_6 41/66 2026-02-25T17:21:03.438 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : libradosstriper1-2:17.2.9-0.el9.x86_64 42/66 2026-02-25T17:21:03.438 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : librbd1-2:18.2.7-1050.g0ef62ce8.el9.x86_64 43/66 2026-02-25T17:21:03.438 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : librbd1-2:17.2.9-0.el9.x86_64 44/66 2026-02-25T17:21:03.438 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : librgw2-2:18.2.7-1050.g0ef62ce8.el9.x86_64 45/66 2026-02-25T17:21:03.438 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : librgw2-2:17.2.9-0.el9.x86_64 46/66 2026-02-25T17:21:03.438 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-ceph-argparse-2:18.2.7-1050.g0ef62ce8.el9. 47/66 2026-02-25T17:21:03.438 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-ceph-argparse-2:17.2.9-0.el9.x86_64 48/66 2026-02-25T17:21:03.438 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-ceph-common-2:18.2.7-1050.g0ef62ce8.el9.x8 49/66 2026-02-25T17:21:03.438 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-ceph-common-2:17.2.9-0.el9.x86_64 50/66 2026-02-25T17:21:03.438 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-cephfs-2:18.2.7-1050.g0ef62ce8.el9.x86_64 51/66 2026-02-25T17:21:03.438 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-cephfs-2:17.2.9-0.el9.x86_64 52/66 2026-02-25T17:21:03.439 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-rados-2:18.2.7-1050.g0ef62ce8.el9.x86_64 53/66 2026-02-25T17:21:03.439 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-rados-2:17.2.9-0.el9.x86_64 54/66 2026-02-25T17:21:03.439 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-rbd-2:18.2.7-1050.g0ef62ce8.el9.x86_64 55/66 2026-02-25T17:21:03.439 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-rbd-2:17.2.9-0.el9.x86_64 56/66 2026-02-25T17:21:03.439 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-rgw-2:18.2.7-1050.g0ef62ce8.el9.x86_64 57/66 2026-02-25T17:21:03.439 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : python3-rgw-2:17.2.9-0.el9.x86_64 58/66 2026-02-25T17:21:03.439 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : rbd-fuse-2:18.2.7-1050.g0ef62ce8.el9.x86_64 59/66 2026-02-25T17:21:03.439 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : rbd-fuse-2:17.2.9-0.el9.x86_64 60/66 2026-02-25T17:21:03.439 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : rbd-mirror-2:18.2.7-1050.g0ef62ce8.el9.x86_64 61/66 2026-02-25T17:21:03.439 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : rbd-mirror-2:17.2.9-0.el9.x86_64 62/66 2026-02-25T17:21:03.439 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : rbd-nbd-2:18.2.7-1050.g0ef62ce8.el9.x86_64 63/66 2026-02-25T17:21:03.439 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : rbd-nbd-2:17.2.9-0.el9.x86_64 64/66 2026-02-25T17:21:03.439 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-mgr-modules-core-2:18.2.7-1050.g0ef62ce8.el9. 65/66 2026-02-25T17:21:03.499 INFO:teuthology.orchestra.run.trial076.stdout: Verifying : ceph-mgr-modules-core-2:17.2.9-0.el9.noarch 66/66 2026-02-25T17:21:03.499 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:03.499 INFO:teuthology.orchestra.run.trial076.stdout:Upgraded: 2026-02-25T17:21:03.499 INFO:teuthology.orchestra.run.trial076.stdout: ceph-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.500 INFO:teuthology.orchestra.run.trial076.stdout: ceph-base-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.500 INFO:teuthology.orchestra.run.trial076.stdout: ceph-common-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.500 INFO:teuthology.orchestra.run.trial076.stdout: ceph-fuse-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.500 INFO:teuthology.orchestra.run.trial076.stdout: ceph-immutable-object-cache-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.500 INFO:teuthology.orchestra.run.trial076.stdout: ceph-mds-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.500 INFO:teuthology.orchestra.run.trial076.stdout: ceph-mgr-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.500 INFO:teuthology.orchestra.run.trial076.stdout: ceph-mgr-modules-core-2:18.2.7-1050.g0ef62ce8.el9.noarch 2026-02-25T17:21:03.500 INFO:teuthology.orchestra.run.trial076.stdout: ceph-mon-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.500 INFO:teuthology.orchestra.run.trial076.stdout: ceph-osd-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.500 INFO:teuthology.orchestra.run.trial076.stdout: ceph-radosgw-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.500 INFO:teuthology.orchestra.run.trial076.stdout: ceph-selinux-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.500 INFO:teuthology.orchestra.run.trial076.stdout: ceph-test-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.501 INFO:teuthology.orchestra.run.trial076.stdout: libcephfs-devel-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.501 INFO:teuthology.orchestra.run.trial076.stdout: libcephfs2-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.501 INFO:teuthology.orchestra.run.trial076.stdout: libcephsqlite-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.501 INFO:teuthology.orchestra.run.trial076.stdout: librados-devel-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.501 INFO:teuthology.orchestra.run.trial076.stdout: librados2-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.501 INFO:teuthology.orchestra.run.trial076.stdout: libradosstriper1-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.501 INFO:teuthology.orchestra.run.trial076.stdout: librbd1-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.501 INFO:teuthology.orchestra.run.trial076.stdout: librgw2-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.501 INFO:teuthology.orchestra.run.trial076.stdout: python3-ceph-argparse-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.501 INFO:teuthology.orchestra.run.trial076.stdout: python3-ceph-common-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.501 INFO:teuthology.orchestra.run.trial076.stdout: python3-cephfs-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.501 INFO:teuthology.orchestra.run.trial076.stdout: python3-rados-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.502 INFO:teuthology.orchestra.run.trial076.stdout: python3-rbd-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.502 INFO:teuthology.orchestra.run.trial076.stdout: python3-rgw-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.502 INFO:teuthology.orchestra.run.trial076.stdout: rbd-fuse-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.502 INFO:teuthology.orchestra.run.trial076.stdout: rbd-mirror-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.502 INFO:teuthology.orchestra.run.trial076.stdout: rbd-nbd-2:18.2.7-1050.g0ef62ce8.el9.x86_64 2026-02-25T17:21:03.502 INFO:teuthology.orchestra.run.trial076.stdout:Installed: 2026-02-25T17:21:03.502 INFO:teuthology.orchestra.run.trial076.stdout: boost-program-options-1.75.0-13.el9.x86_64 fmt-8.1.1-5.el9.x86_64 2026-02-25T17:21:03.502 INFO:teuthology.orchestra.run.trial076.stdout: libarrow-9.0.0-15.el9.x86_64 libarrow-doc-9.0.0-15.el9.noarch 2026-02-25T17:21:03.502 INFO:teuthology.orchestra.run.trial076.stdout: parquet-libs-9.0.0-15.el9.x86_64 re2-1:20211101-20.el9.x86_64 2026-02-25T17:21:03.502 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:03.502 INFO:teuthology.orchestra.run.trial076.stdout:Complete! 2026-02-25T17:21:03.549 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28 2026-02-25T17:21:03.720 DEBUG:teuthology.orchestra.run.trial076:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-25T17:21:03.740 INFO:teuthology.orchestra.run.trial076.stdout:18.2.7-1050.g0ef62ce8.el9 2026-02-25T17:21:03.741 INFO:teuthology.packaging:The installed version of ceph is 18.2.7-1050.g0ef62ce8.el9 2026-02-25T17:21:03.741 INFO:teuthology.task.install:The correct ceph version 18.2.7-1050.g0ef62ce8 is installed. 2026-02-25T17:21:03.744 INFO:teuthology.run_tasks:Running task print... 2026-02-25T17:21:03.760 INFO:teuthology.task.print:**** done install.upgrade 2026-02-25T17:21:03.760 INFO:teuthology.run_tasks:Running task ceph.restart... 2026-02-25T17:21:03.779 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-25T17:21:03.779 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T17:21:03.791 INFO:tasks.ceph.mon.a:Stopped 2026-02-25T17:21:03.791 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-25T17:21:03.791 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-25T17:21:03.833 INFO:tasks.ceph.mon.a:Started 2026-02-25T17:21:03.833 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-25T17:21:03.833 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T17:21:03.842 INFO:tasks.ceph.mon.b:Stopped 2026-02-25T17:21:03.842 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-25T17:21:03.843 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-25T17:21:03.885 INFO:tasks.ceph.mon.b:Started 2026-02-25T17:21:03.885 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-25T17:21:03.885 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T17:21:03.896 INFO:tasks.ceph.mon.c:Stopped 2026-02-25T17:21:03.896 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-25T17:21:03.897 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-25T17:21:03.940 INFO:tasks.ceph.mon.c:Started 2026-02-25T17:21:03.940 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-25T17:21:03.940 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T17:21:03.962 INFO:tasks.ceph.mgr.x:Stopped 2026-02-25T17:21:03.962 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-25T17:21:03.963 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-25T17:21:04.004 INFO:tasks.ceph.mgr.x:Started 2026-02-25T17:21:04.005 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-25T17:21:04.005 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T17:21:04.027 INFO:tasks.ceph.mgr.y:Stopped 2026-02-25T17:21:04.027 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-25T17:21:04.028 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2026-02-25T17:21:04.070 INFO:tasks.ceph.mgr.y:Started 2026-02-25T17:21:04.070 INFO:teuthology.run_tasks:Running task ceph.healthy... 2026-02-25T17:21:04.086 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-25T17:21:04.086 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-25T17:21:04.087 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-25T17:21:04.156 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.152+0000 7f0e2b9f6640 1 Processor -- start 2026-02-25T17:21:04.156 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.152+0000 7f0e2b9f6640 1 -- start start 2026-02-25T17:21:04.156 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.152+0000 7f0e2b9f6640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 0x7f0e2406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:04.156 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.152+0000 7f0e2b9f6640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 0x7f0e24134710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:04.156 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.152+0000 7f0e2b9f6640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e2409d9a0 con 0x7f0e2406e8f0 2026-02-25T17:21:04.156 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.152+0000 7f0e2b9f6640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e24099190 con 0x7f0e240987e0 2026-02-25T17:21:04.156 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.152+0000 7f0e2b9f6640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2408c910 con 0x7f0e2406dfd0 2026-02-25T17:21:04.156 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.152+0000 7f0e2976b640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 0x7f0e2406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:04.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.153+0000 7f0e2976b640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 0x7f0e2406e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:59522/0 (socket says 10.20.193.76:59522) 2026-02-25T17:21:04.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.153+0000 7f0e2976b640 1 -- 10.20.193.76:0/2147682341 learned_addr learned my addr 10.20.193.76:0/2147682341 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:04.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.153+0000 7f0e29f6c640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 0x7f0e24134710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:04.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.153+0000 7f0e2976b640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 msgr2=0x7f0e2406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-25T17:21:04.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.153+0000 7f0e2976b640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 msgr2=0x7f0e2406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:21:04.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.153+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 0x7f0e2406e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-25T17:21:04.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.153+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 0x7f0e2406e3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-25T17:21:04.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.153+0000 7f0e29f6c640 1 -- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 msgr2=0x7f0e24134710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-25T17:21:04.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.153+0000 7f0e29f6c640 1 -- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 msgr2=0x7f0e24134710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:21:04.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.153+0000 7f0e29f6c640 1 --2- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 0x7f0e24134710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-25T17:21:04.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.153+0000 7f0e29f6c640 1 --2- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 0x7f0e24134710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-25T17:21:04.356 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.354+0000 7f0e29f6c640 1 --2- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 0x7f0e24134710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:04.356 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.354+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 0x7f0e2406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:04.356 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.354+0000 7f0e29f6c640 1 -- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 msgr2=0x7f0e24134710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-25T17:21:04.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.354+0000 7f0e2976b640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 msgr2=0x7f0e2406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-25T17:21:04.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.354+0000 7f0e29f6c640 1 -- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 msgr2=0x7f0e24134710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:21:04.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.354+0000 7f0e2976b640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 msgr2=0x7f0e2406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:21:04.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.354+0000 7f0e29f6c640 1 --2- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 0x7f0e24134710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-25T17:21:04.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.354+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 0x7f0e2406e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-25T17:21:04.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.354+0000 7f0e29f6c640 1 --2- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 0x7f0e24134710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-25T17:21:04.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.354+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 0x7f0e2406e3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-25T17:21:04.757 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.755+0000 7f0e29f6c640 1 --2- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 0x7f0e24134710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:04.757 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.755+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 0x7f0e2406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:04.757 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.755+0000 7f0e2976b640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 msgr2=0x7f0e2406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-25T17:21:04.757 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.755+0000 7f0e2976b640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 msgr2=0x7f0e2406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:21:04.757 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.755+0000 7f0e29f6c640 1 -- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 msgr2=0x7f0e24134710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-25T17:21:04.757 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.755+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 0x7f0e2406e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-25T17:21:04.757 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.755+0000 7f0e29f6c640 1 -- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 msgr2=0x7f0e24134710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:21:04.757 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.755+0000 7f0e29f6c640 1 --2- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 0x7f0e24134710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-25T17:21:04.757 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.755+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 0x7f0e2406e3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-25T17:21:04.757 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:04.755+0000 7f0e29f6c640 1 --2- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 0x7f0e24134710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-25T17:21:05.559 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:05.556+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 0x7f0e2406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:05.559 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:05.556+0000 7f0e29f6c640 1 --2- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 0x7f0e24134710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:05.560 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:05.556+0000 7f0e2976b640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 msgr2=0x7f0e2406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-25T17:21:05.560 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:05.556+0000 7f0e2976b640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 msgr2=0x7f0e2406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:21:05.560 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:05.556+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 0x7f0e2406e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-25T17:21:05.560 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:05.556+0000 7f0e29f6c640 1 -- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 msgr2=0x7f0e24134710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-25T17:21:05.560 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:05.556+0000 7f0e29f6c640 1 -- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 msgr2=0x7f0e24134710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:21:05.561 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:05.556+0000 7f0e29f6c640 1 --2- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 0x7f0e24134710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-25T17:21:05.561 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:05.556+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 0x7f0e2406e3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-25T17:21:05.561 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:05.556+0000 7f0e29f6c640 1 --2- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 0x7f0e24134710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-25T17:21:07.156 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.152+0000 7f0e12ffd640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 msgr2=0x7f0e2406e3b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T17:21:07.156 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.152+0000 7f0e12ffd640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 0x7f0e2406e3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:07.156 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.152+0000 7f0e12ffd640 1 -- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 msgr2=0x7f0e24134710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T17:21:07.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.152+0000 7f0e12ffd640 1 --2- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 0x7f0e24134710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:07.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.152+0000 7f0e12ffd640 1 -- 10.20.193.76:0/2147682341 >> v1:10.20.193.76:6789/0 conn(0x7f0e2406e8f0 legacy=0x7f0e240980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:07.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.152+0000 7f0e12ffd640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 0x7f0e08005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:07.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.152+0000 7f0e12ffd640 1 -- 10.20.193.76:0/2147682341 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e080061d0 con 0x7f0e08003750 2026-02-25T17:21:07.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.153+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 0x7f0e08005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:07.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.153+0000 7f0e2976b640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 msgr2=0x7f0e08005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-25T17:21:07.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.153+0000 7f0e2976b640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 msgr2=0x7f0e08005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:21:07.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.153+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 0x7f0e08005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-25T17:21:07.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.153+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 0x7f0e08005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-25T17:21:07.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.354+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 0x7f0e08005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:07.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.354+0000 7f0e2976b640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 msgr2=0x7f0e08005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-25T17:21:07.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.354+0000 7f0e2976b640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 msgr2=0x7f0e08005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:21:07.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.354+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 0x7f0e08005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-25T17:21:07.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.354+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 0x7f0e08005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-25T17:21:07.757 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.755+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 0x7f0e08005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:07.758 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.755+0000 7f0e2976b640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 msgr2=0x7f0e08005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-25T17:21:07.758 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.755+0000 7f0e2976b640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 msgr2=0x7f0e08005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:21:07.758 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.755+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 0x7f0e08005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-25T17:21:07.758 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:07.755+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 0x7f0e08005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-25T17:21:08.559 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:08.556+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 0x7f0e08005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:08.559 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:08.556+0000 7f0e2976b640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 msgr2=0x7f0e08005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-25T17:21:08.560 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:08.556+0000 7f0e2976b640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 msgr2=0x7f0e08005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-25T17:21:08.560 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:08.556+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 0x7f0e08005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-25T17:21:08.560 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:08.556+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 0x7f0e08005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-25T17:21:09.123 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.121+0000 7f5f8b93b140 -1 client.0 error registering admin socket command: (17) File exists 2026-02-25T17:21:09.345 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.342+0000 7f5f8b93b140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-25T17:21:09.370 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.367+0000 7f5f8b93b140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-25T17:21:09.403 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.400+0000 7f5f8b93b140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-25T17:21:09.426 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.423+0000 7f5f8b93b140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-25T17:21:09.451 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.449+0000 7f5f8b93b140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-25T17:21:09.508 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.505+0000 7f5f8b93b140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-25T17:21:09.533 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.531+0000 7f5f8b93b140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-25T17:21:09.581 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.579+0000 7f5f8b93b140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-25T17:21:09.624 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.622+0000 7f5f8b93b140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-25T17:21:09.650 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.648+0000 7f5f8b93b140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-25T17:21:09.674 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.672+0000 7f5f8b93b140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-25T17:21:09.699 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.697+0000 7f5f8b93b140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-25T17:21:09.721 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.719+0000 7f5f8b93b140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-25T17:21:09.775 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.773+0000 7f5f8b93b140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-25T17:21:09.797 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.795+0000 7f5f8b93b140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-25T17:21:09.819 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.817+0000 7f5f8b93b140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-25T17:21:09.866 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.864+0000 7f5f8b93b140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-25T17:21:09.886 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.884+0000 7f5f8b93b140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-25T17:21:09.932 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.929+0000 7f5f8b93b140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-25T17:21:10.001 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:09.999+0000 7f5f8b93b140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-25T17:21:10.024 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:10.021+0000 7f5f8b93b140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-25T17:21:10.059 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.056+0000 7f1ad73da140 -1 client.0 error registering admin socket command: (17) File exists 2026-02-25T17:21:10.156 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.153+0000 7f0e12ffd640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 msgr2=0x7f0e08005bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-25T17:21:10.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.153+0000 7f0e12ffd640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 0x7f0e08005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.153+0000 7f0e12ffd640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 0x7f0e08008510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.153+0000 7f0e12ffd640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 0x7f0e08005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.153+0000 7f0e12ffd640 1 --2- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 0x7f0e0800ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.153+0000 7f0e12ffd640 1 -- 10.20.193.76:0/2147682341 --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e080061d0 con 0x7f0e240987e0 2026-02-25T17:21:10.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.153+0000 7f0e12ffd640 1 -- 10.20.193.76:0/2147682341 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0800b120 con 0x7f0e08003750 2026-02-25T17:21:10.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.153+0000 7f0e12ffd640 1 -- 10.20.193.76:0/2147682341 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0800b2e0 con 0x7f0e2406dfd0 2026-02-25T17:21:10.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.153+0000 7f0e29f6c640 1 --2- 10.20.193.76:0/2147682341 >> v2:10.20.193.76:3300/0 conn(0x7f0e240987e0 0x7f0e0800ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.153+0000 7f0e2976b640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 0x7f0e08008510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.158 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.153+0000 7f0e28f6a640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 0x7f0e08005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.158 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.153+0000 7f0e29f6c640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 msgr2=0x7f0e08008510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:10.158 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.153+0000 7f0e29f6c640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 0x7f0e08008510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.158 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.153+0000 7f0e29f6c640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 msgr2=0x7f0e08005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:10.158 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.153+0000 7f0e29f6c640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 0x7f0e08005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.158 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.153+0000 7f0e29f6c640 1 -- 10.20.193.76:0/2147682341 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e24072260 con 0x7f0e240987e0 2026-02-25T17:21:10.158 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.153+0000 7f0e28f6a640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 0x7f0e08005bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:10.158 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.153+0000 7f0e29f6c640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0e240987e0 0x7f0e0800ab30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009610 tx=0x7f0e2002fef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576a18d40f61098b server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.163 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.154+0000 7f0e13fff640 1 -- 10.20.193.76:0/2147682341 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20006ea0 con 0x7f0e240987e0 2026-02-25T17:21:10.163 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.155+0000 7f0e13fff640 1 -- 10.20.193.76:0/2147682341 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e20034070 con 0x7f0e240987e0 2026-02-25T17:21:10.163 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.155+0000 7f0e13fff640 1 -- 10.20.193.76:0/2147682341 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e20030b60 con 0x7f0e240987e0 2026-02-25T17:21:10.164 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.155+0000 7f0e2b9f6640 1 -- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0e240987e0 msgr2=0x7f0e0800ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.164 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.155+0000 7f0e2b9f6640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0e240987e0 0x7f0e0800ab30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0e20009610 tx=0x7f0e2002fef0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.164 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.155+0000 7f0e2b9f6640 1 -- 10.20.193.76:0/2147682341 shutdown_connections 2026-02-25T17:21:10.164 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.155+0000 7f0e2b9f6640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0e240987e0 0x7f0e0800ab30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.164 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.155+0000 7f0e2b9f6640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e08003750 0x7f0e08005bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.164 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.155+0000 7f0e2b9f6640 1 --2- 10.20.193.76:0/2147682341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406dfd0 0x7f0e08008510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.164 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.155+0000 7f0e2b9f6640 1 -- 10.20.193.76:0/2147682341 >> 10.20.193.76:0/2147682341 conn(0x7f0e2409a960 msgr2=0x7f0e2409ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.164 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.155+0000 7f0e2b9f6640 1 -- 10.20.193.76:0/2147682341 shutdown_connections 2026-02-25T17:21:10.164 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.155+0000 7f0e2b9f6640 1 -- 10.20.193.76:0/2147682341 wait complete. 2026-02-25T17:21:10.164 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.155+0000 7f0e2b9f6640 1 Processor -- start 2026-02-25T17:21:10.164 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.155+0000 7f0e2b9f6640 1 -- start start 2026-02-25T17:21:10.164 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e2b9f6640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0e08003750 0x7f0e241253c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.165 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e2b9f6640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e2406dfd0 0x7f0e24125900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.165 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e2b9f6640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406e8f0 0x7f0e24125e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.165 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e2b9f6640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2406fc50 con 0x7f0e08003750 2026-02-25T17:21:10.165 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e2b9f6640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e24126be0 con 0x7f0e2406dfd0 2026-02-25T17:21:10.165 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e2b9f6640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e240715d0 con 0x7f0e2406e8f0 2026-02-25T17:21:10.165 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e2976b640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0e08003750 0x7f0e241253c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.165 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e28f6a640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e2406dfd0 0x7f0e24125900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.165 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e2976b640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0e08003750 0x7f0e241253c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:39096/0 (socket says 10.20.193.76:39096) 2026-02-25T17:21:10.165 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e2976b640 1 -- 10.20.193.76:0/3917760712 learned_addr learned my addr 10.20.193.76:0/3917760712 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:10.165 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e29f6c640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406e8f0 0x7f0e24125e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.165 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e28f6a640 1 -- 10.20.193.76:0/3917760712 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406e8f0 msgr2=0x7f0e24125e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.165 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e28f6a640 1 --2- 10.20.193.76:0/3917760712 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406e8f0 0x7f0e24125e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.166 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e28f6a640 1 -- 10.20.193.76:0/3917760712 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0e08003750 msgr2=0x7f0e241253c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.166 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e28f6a640 1 --2- 10.20.193.76:0/3917760712 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0e08003750 0x7f0e241253c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.166 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e28f6a640 1 -- 10.20.193.76:0/3917760712 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2409d9a0 con 0x7f0e2406dfd0 2026-02-25T17:21:10.166 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e2976b640 1 --2- 10.20.193.76:0/3917760712 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0e08003750 0x7f0e241253c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:10.166 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e28f6a640 1 --2- 10.20.193.76:0/3917760712 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e2406dfd0 0x7f0e24125900 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800e760 tx=0x7f0e1800ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.166 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e11ffb640 1 -- 10.20.193.76:0/3917760712 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e18019070 con 0x7f0e2406dfd0 2026-02-25T17:21:10.166 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e11ffb640 1 -- 10.20.193.76:0/3917760712 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e180068d0 con 0x7f0e2406dfd0 2026-02-25T17:21:10.166 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e11ffb640 1 -- 10.20.193.76:0/3917760712 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e18006a60 con 0x7f0e2406dfd0 2026-02-25T17:21:10.166 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e2b9f6640 1 -- 10.20.193.76:0/3917760712 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e20009640 con 0x7f0e2406dfd0 2026-02-25T17:21:10.166 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.156+0000 7f0e2b9f6640 1 -- 10.20.193.76:0/3917760712 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e24126380 con 0x7f0e2406dfd0 2026-02-25T17:21:10.167 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.157+0000 7f0e2b9f6640 1 -- 10.20.193.76:0/3917760712 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e2406dd10 con 0x7f0e2406dfd0 2026-02-25T17:21:10.167 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.157+0000 7f0e11ffb640 1 -- 10.20.193.76:0/3917760712 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 6) v1 ==== 59352+0+0 (secure 0 0 0) 0x7f0e18006bc0 con 0x7f0e2406dfd0 2026-02-25T17:21:10.167 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.157+0000 7f0e2976b640 1 -- 10.20.193.76:0/3917760712 >> v1:10.20.193.76:6800/42442 conn(0x7f0df404d620 legacy=0x7f0df404fae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.76:6800/42442 2026-02-25T17:21:10.167 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.157+0000 7f0e11ffb640 1 -- 10.20.193.76:0/3917760712 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2806+0+0 (secure 0 0 0) 0x7f0e18063810 con 0x7f0e2406dfd0 2026-02-25T17:21:10.167 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.160+0000 7f0e11ffb640 1 -- 10.20.193.76:0/3917760712 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143111 (secure 0 0 0) 0x7f0e1803e380 con 0x7f0e2406dfd0 2026-02-25T17:21:10.192 INFO:tasks.ceph.mgr.y.trial076.stderr:2026-02-25T17:21:10.190+0000 7f5f8b93b140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-25T17:21:10.238 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.235+0000 7f0e2b9f6640 1 -- 10.20.193.76:0/3917760712 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0e2406e3b0 con 0x7f0e2406dfd0 2026-02-25T17:21:10.239 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.236+0000 7f0e11ffb640 1 -- 10.20.193.76:0/3917760712 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v6) v1 ==== 74+0+117211 (secure 0 0 0) 0x7f0e18041b90 con 0x7f0e2406dfd0 2026-02-25T17:21:10.240 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:10.240 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.238+0000 7f0e2b9f6640 1 -- 10.20.193.76:0/3917760712 >> v1:10.20.193.76:6800/42442 conn(0x7f0df404d620 legacy=0x7f0df404fae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-25T17:21:10.240 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.238+0000 7f0e2b9f6640 1 -- 10.20.193.76:0/3917760712 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e2406dfd0 msgr2=0x7f0e24125900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.240 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.238+0000 7f0e2b9f6640 1 --2- 10.20.193.76:0/3917760712 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e2406dfd0 0x7f0e24125900 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800e760 tx=0x7f0e1800ec30 comp rx=0 tx=0).stop 2026-02-25T17:21:10.240 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.238+0000 7f0e2b9f6640 1 -- 10.20.193.76:0/3917760712 shutdown_connections 2026-02-25T17:21:10.240 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.238+0000 7f0e2b9f6640 1 --2- 10.20.193.76:0/3917760712 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0e2406e8f0 0x7f0e24125e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.240 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.238+0000 7f0e2b9f6640 1 --2- 10.20.193.76:0/3917760712 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0e2406dfd0 0x7f0e24125900 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.240 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.238+0000 7f0e2b9f6640 1 --2- 10.20.193.76:0/3917760712 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0e08003750 0x7f0e241253c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.241 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.238+0000 7f0e2b9f6640 1 -- 10.20.193.76:0/3917760712 >> 10.20.193.76:0/3917760712 conn(0x7f0e2409a960 msgr2=0x7f0e2409b890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.241 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.238+0000 7f0e2b9f6640 1 -- 10.20.193.76:0/3917760712 shutdown_connections 2026-02-25T17:21:10.241 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.238+0000 7f0e2b9f6640 1 -- 10.20.193.76:0/3917760712 wait complete. 2026-02-25T17:21:10.248 INFO:teuthology.orchestra.run.trial076.stdout:{"epoch":6,"flags":0,"active_gid":4104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6800","nonce":42442}]},"active_addr":"10.20.193.76:6800/42442","active_change":"2026-02-25T17:13:34.800806+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4099,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.76:0","nonce":1432153956}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.76:0","nonce":94912213}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.76:0","nonce":1754372634}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.76:0","nonce":599075350}]}]} 2026-02-25T17:21:10.250 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-25T17:21:10.250 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-25T17:21:10.250 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T17:21:10.251 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.247+0000 7f1ad73da140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-25T17:21:10.271 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.269+0000 7f1ad73da140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-25T17:21:10.297 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.294+0000 7f1ad73da140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-25T17:21:10.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.314+0000 7f11c8747640 1 Processor -- start 2026-02-25T17:21:10.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.314+0000 7f11c8747640 1 -- start start 2026-02-25T17:21:10.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.314+0000 7f11c8747640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f11c006dfd0 0x7f11c006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.314+0000 7f11c8747640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f11c00987e0 0x7f11c0134710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.314+0000 7f11c8747640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c009d9a0 con 0x7f11c006e8f0 2026-02-25T17:21:10.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.314+0000 7f11c8747640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c0099190 con 0x7f11c006dfd0 2026-02-25T17:21:10.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.314+0000 7f11c8747640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c008c910 con 0x7f11c00987e0 2026-02-25T17:21:10.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.314+0000 7f11c6cbd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f11c00987e0 0x7f11c0134710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.314+0000 7f11c64bc640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f11c006dfd0 0x7f11c006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.314+0000 7f11c5cbb640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f11c006e8f0 0x7f11c00980d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:46868/0 (socket says 10.20.193.76:46868) 2026-02-25T17:21:10.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.314+0000 7f11c5cbb640 1 -- 10.20.193.76:0/3466166606 learned_addr learned my addr 10.20.193.76:0/3466166606 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:10.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.314+0000 7f11c6cbd640 1 -- 10.20.193.76:0/3466166606 >> v2:10.20.193.76:3300/0 conn(0x7f11c006dfd0 msgr2=0x7f11c006e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:10.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.314+0000 7f11c6cbd640 1 --2- 10.20.193.76:0/3466166606 >> v2:10.20.193.76:3300/0 conn(0x7f11c006dfd0 0x7f11c006e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.314+0000 7f11c6cbd640 1 -- 10.20.193.76:0/3466166606 >> v1:10.20.193.76:6789/0 conn(0x7f11c006e8f0 legacy=0x7f11c00980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.314+0000 7f11c6cbd640 1 -- 10.20.193.76:0/3466166606 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c0072260 con 0x7f11c00987e0 2026-02-25T17:21:10.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.315+0000 7f11c6cbd640 1 --2- 10.20.193.76:0/3466166606 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f11c00987e0 0x7f11c0134710 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f11bc009d90 tx=0x7f11bc02f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7eb7bb6ca606bebc server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.315+0000 7f11c54ba640 1 -- 10.20.193.76:0/3466166606 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc006ea0 con 0x7f11c00987e0 2026-02-25T17:21:10.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.315+0000 7f11c54ba640 1 -- 10.20.193.76:0/3466166606 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11bc037440 con 0x7f11c00987e0 2026-02-25T17:21:10.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.315+0000 7f11c54ba640 1 -- 10.20.193.76:0/3466166606 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc02fea0 con 0x7f11c00987e0 2026-02-25T17:21:10.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.315+0000 7f11c8747640 1 -- 10.20.193.76:0/3466166606 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f11c00987e0 msgr2=0x7f11c0134710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.320 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.315+0000 7f11c8747640 1 --2- 10.20.193.76:0/3466166606 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f11c00987e0 0x7f11c0134710 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f11bc009d90 tx=0x7f11bc02f1e0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.320 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.315+0000 7f11c8747640 1 -- 10.20.193.76:0/3466166606 shutdown_connections 2026-02-25T17:21:10.320 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.315+0000 7f11c8747640 1 --2- 10.20.193.76:0/3466166606 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f11c00987e0 0x7f11c0134710 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.320 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.315+0000 7f11c8747640 1 --2- 10.20.193.76:0/3466166606 >> v2:10.20.193.76:3300/0 conn(0x7f11c006dfd0 0x7f11c006e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.320 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.315+0000 7f11c8747640 1 -- 10.20.193.76:0/3466166606 >> 10.20.193.76:0/3466166606 conn(0x7f11c009a960 msgr2=0x7f11c009ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.320 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.315+0000 7f11c8747640 1 -- 10.20.193.76:0/3466166606 shutdown_connections 2026-02-25T17:21:10.320 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.315+0000 7f11c8747640 1 -- 10.20.193.76:0/3466166606 wait complete. 2026-02-25T17:21:10.320 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.315+0000 7f1ad73da140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-25T17:21:10.323 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.315+0000 7f11c8747640 1 Processor -- start 2026-02-25T17:21:10.323 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c8747640 1 -- start start 2026-02-25T17:21:10.323 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c8747640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f11c006dfd0 0x7f11c01c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.323 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c8747640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f11c006e8f0 0x7f11c01c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.324 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c8747640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f11c00987e0 0x7f11c0124970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.324 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c8747640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c0126a50 con 0x7f11c006e8f0 2026-02-25T17:21:10.324 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c8747640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c008da50 con 0x7f11c006dfd0 2026-02-25T17:21:10.324 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c8747640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11c008dec0 con 0x7f11c00987e0 2026-02-25T17:21:10.324 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c64bc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f11c006dfd0 0x7f11c01c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.324 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c5cbb640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f11c006e8f0 0x7f11c01c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.324 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c64bc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f11c006dfd0 0x7f11c01c3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:41666/0 (socket says 10.20.193.76:41666) 2026-02-25T17:21:10.324 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c64bc640 1 -- 10.20.193.76:0/1662613972 learned_addr learned my addr 10.20.193.76:0/1662613972 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:10.324 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c6cbd640 1 --2- 10.20.193.76:0/1662613972 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f11c00987e0 0x7f11c0124970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.324 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c64bc640 1 -- 10.20.193.76:0/1662613972 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f11c00987e0 msgr2=0x7f11c0124970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.324 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c64bc640 1 --2- 10.20.193.76:0/1662613972 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f11c00987e0 0x7f11c0124970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.324 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c64bc640 1 -- 10.20.193.76:0/1662613972 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f11c006e8f0 msgr2=0x7f11c01c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.325 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c64bc640 1 --2- 10.20.193.76:0/1662613972 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f11c006e8f0 0x7f11c01c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.325 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c64bc640 1 -- 10.20.193.76:0/1662613972 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc009a70 con 0x7f11c006dfd0 2026-02-25T17:21:10.325 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c5cbb640 1 --2- 10.20.193.76:0/1662613972 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f11c006e8f0 0x7f11c01c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:10.325 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c64bc640 1 --2- 10.20.193.76:0/1662613972 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f11c006dfd0 0x7f11c01c3680 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f11b000ec10 tx=0x7f11b000c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.325 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11a6ffd640 1 -- 10.20.193.76:0/1662613972 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b0009770 con 0x7f11c006dfd0 2026-02-25T17:21:10.325 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11a6ffd640 1 -- 10.20.193.76:0/1662613972 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b000cc40 con 0x7f11c006dfd0 2026-02-25T17:21:10.325 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11a6ffd640 1 -- 10.20.193.76:0/1662613972 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b0013470 con 0x7f11c006dfd0 2026-02-25T17:21:10.325 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c8747640 1 -- 10.20.193.76:0/1662613972 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c01263a0 con 0x7f11c006dfd0 2026-02-25T17:21:10.325 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.316+0000 7f11c8747640 1 -- 10.20.193.76:0/1662613972 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c008d6e0 con 0x7f11c006dfd0 2026-02-25T17:21:10.325 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.317+0000 7f11a6ffd640 1 -- 10.20.193.76:0/1662613972 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 6) v1 ==== 59352+0+0 (secure 0 0 0) 0x7f11b0011070 con 0x7f11c006dfd0 2026-02-25T17:21:10.325 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.317+0000 7f11c8747640 1 -- 10.20.193.76:0/1662613972 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c0095fd0 con 0x7f11c006dfd0 2026-02-25T17:21:10.325 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.317+0000 7f11c5cbb640 1 -- 10.20.193.76:0/1662613972 >> v1:10.20.193.76:6800/42442 conn(0x7f119004d620 legacy=0x7f119004fae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.76:6800/42442 2026-02-25T17:21:10.326 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.317+0000 7f11a6ffd640 1 -- 10.20.193.76:0/1662613972 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2806+0+0 (secure 0 0 0) 0x7f11b0063b00 con 0x7f11c006dfd0 2026-02-25T17:21:10.326 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.319+0000 7f11a6ffd640 1 -- 10.20.193.76:0/1662613972 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143111 (secure 0 0 0) 0x7f11b003e6d0 con 0x7f11c006dfd0 2026-02-25T17:21:10.343 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.340+0000 7f1ad73da140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-25T17:21:10.384 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.382+0000 7f11c8747640 1 -- 10.20.193.76:0/1662613972 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11c0071f00 con 0x7f11c006dfd0 2026-02-25T17:21:10.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.383+0000 7f11a6ffd640 1 -- 10.20.193.76:0/1662613972 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8602 (secure 0 0 0) 0x7f11b0017030 con 0x7f11c006dfd0 2026-02-25T17:21:10.385 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:10.386 INFO:teuthology.orchestra.run.trial076.stdout:{"epoch":15,"fsid":"0648ee30-4e19-4268-91ad-07b0e65a8518","created":"2026-02-25T17:13:33.780133+0000","modified":"2026-02-25T17:13:56.776498+0000","last_up_change":"2026-02-25T17:13:41.008215+0000","last_in_change":"2026-02-25T17:13:34.859194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-25T17:13:42.208987+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-25T17:13:42.832027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85909bd3-2540-48a9-a649-33709fa74613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6806","nonce":43127}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6808","nonce":43127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6812","nonce":43127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6810","nonce":43127}]},"public_addr":"10.20.193.76:6806/43127","cluster_addr":"10.20.193.76:6808/43127","heartbeat_back_addr":"10.20.193.76:6812/43127","heartbeat_front_addr":"10.20.193.76:6810/43127","state":["exists","up"]},{"osd":1,"uuid":"f0a0a51c-d629-464e-bc04-dacbaaf78efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6805","nonce":43126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6807","nonce":43126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6811","nonce":43126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6809","nonce":43126}]},"public_addr":"10.20.193.76:6805/43126","cluster_addr":"10.20.193.76:6807/43126","heartbeat_back_addr":"10.20.193.76:6811/43126","heartbeat_front_addr":"10.20.193.76:6809/43126","state":["exists","up"]},{"osd":2,"uuid":"9633000b-764d-457a-b560-539dc5830e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6813","nonce":43128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6814","nonce":43128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6816","nonce":43128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6815","nonce":43128}]},"public_addr":"10.20.193.76:6813/43128","cluster_addr":"10.20.193.76:6814/43128","heartbeat_back_addr":"10.20.193.76:6816/43128","heartbeat_front_addr":"10.20.193.76:6815/43128","state":["exists","up"]},{"osd":3,"uuid":"fc098e34-48a8-4414-ad41-60abdf7388a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6801","nonce":43129}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6802","nonce":43129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6804","nonce":43129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6803","nonce":43129}]},"public_addr":"10.20.193.76:6801/43129","cluster_addr":"10.20.193.76:6802/43129","heartbeat_back_addr":"10.20.193.76:6804/43129","heartbeat_front_addr":"10.20.193.76:6803/43129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.998715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.974454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:40.020834+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.943932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T17:21:10.386 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.383+0000 7f11c8747640 1 -- 10.20.193.76:0/1662613972 >> v1:10.20.193.76:6800/42442 conn(0x7f119004d620 legacy=0x7f119004fae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-25T17:21:10.387 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.383+0000 7f11c8747640 1 -- 10.20.193.76:0/1662613972 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f11c006dfd0 msgr2=0x7f11c01c3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.387 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.383+0000 7f11c8747640 1 --2- 10.20.193.76:0/1662613972 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f11c006dfd0 0x7f11c01c3680 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f11b000ec10 tx=0x7f11b000c520 comp rx=0 tx=0).stop 2026-02-25T17:21:10.387 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.383+0000 7f11c8747640 1 -- 10.20.193.76:0/1662613972 shutdown_connections 2026-02-25T17:21:10.387 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.383+0000 7f11c8747640 1 --2- 10.20.193.76:0/1662613972 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f11c00987e0 0x7f11c0124970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.387 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.383+0000 7f11c8747640 1 --2- 10.20.193.76:0/1662613972 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f11c006e8f0 0x7f11c01c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.387 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.383+0000 7f11c8747640 1 --2- 10.20.193.76:0/1662613972 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f11c006dfd0 0x7f11c01c3680 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.387 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.383+0000 7f11c8747640 1 -- 10.20.193.76:0/1662613972 >> 10.20.193.76:0/1662613972 conn(0x7f11c009a960 msgr2=0x7f11c006cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.387 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.383+0000 7f11c8747640 1 -- 10.20.193.76:0/1662613972 shutdown_connections 2026-02-25T17:21:10.387 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.383+0000 7f11c8747640 1 -- 10.20.193.76:0/1662613972 wait complete. 2026-02-25T17:21:10.394 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-25T17:21:10.395 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T17:21:10.395 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.392+0000 7f1ad73da140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-25T17:21:10.419 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.417+0000 7f1ad73da140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-25T17:21:10.466 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.459+0000 7f41effd9640 1 Processor -- start 2026-02-25T17:21:10.466 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.459+0000 7f41effd9640 1 -- start start 2026-02-25T17:21:10.466 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.459+0000 7f41effd9640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f41e812b080 0x7f41e812b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.466 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.459+0000 7f41effd9640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f41e812b9a0 0x7f41e8098470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.466 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.459+0000 7f41effd9640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e80719c0 con 0x7f41e80989b0 2026-02-25T17:21:10.466 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.459+0000 7f41effd9640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e806e2a0 con 0x7f41e812b080 2026-02-25T17:21:10.466 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.459+0000 7f41effd9640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e809d9a0 con 0x7f41e812b9a0 2026-02-25T17:21:10.466 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.459+0000 7f41ed54d640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f41e812b9a0 0x7f41e8098470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.459+0000 7f41ed54d640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f41e812b9a0 0x7f41e8098470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:41676/0 (socket says 10.20.193.76:41676) 2026-02-25T17:21:10.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.459+0000 7f41ed54d640 1 -- 10.20.193.76:0/483038239 learned_addr learned my addr 10.20.193.76:0/483038239 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:10.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.459+0000 7f41edd4e640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f41e812b080 0x7f41e812b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.459+0000 7f41ee54f640 1 --1- 10.20.193.76:0/483038239 >> v1:10.20.193.76:6789/0 conn(0x7f41e80989b0 0x7f41e8098e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:46870/0 (socket says 10.20.193.76:46870) 2026-02-25T17:21:10.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.460+0000 7f41ecd4c640 1 -- 10.20.193.76:0/483038239 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312029326 0 0) 0x7f41e80719c0 con 0x7f41e80989b0 2026-02-25T17:21:10.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.460+0000 7f41ecd4c640 1 -- 10.20.193.76:0/483038239 --> v1:10.20.193.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41d0003620 con 0x7f41e80989b0 2026-02-25T17:21:10.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.460+0000 7f41ed54d640 1 -- 10.20.193.76:0/483038239 >> v2:10.20.193.76:3300/0 conn(0x7f41e812b080 msgr2=0x7f41e812b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:10.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.460+0000 7f41ed54d640 1 --2- 10.20.193.76:0/483038239 >> v2:10.20.193.76:3300/0 conn(0x7f41e812b080 0x7f41e812b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.460+0000 7f41ed54d640 1 -- 10.20.193.76:0/483038239 >> v1:10.20.193.76:6789/0 conn(0x7f41e80989b0 legacy=0x7f41e8098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.460+0000 7f41ed54d640 1 -- 10.20.193.76:0/483038239 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e80611c0 con 0x7f41e812b9a0 2026-02-25T17:21:10.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.460+0000 7f41ed54d640 1 --2- 10.20.193.76:0/483038239 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f41e812b9a0 0x7f41e8098470 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f41dc009970 tx=0x7f41dc02ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=113873225d3c42ca server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.467 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.460+0000 7f41ecd4c640 1 -- 10.20.193.76:0/483038239 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc02fb10 con 0x7f41e812b9a0 2026-02-25T17:21:10.468 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.460+0000 7f41ecd4c640 1 -- 10.20.193.76:0/483038239 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41dc02fc70 con 0x7f41e812b9a0 2026-02-25T17:21:10.468 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.460+0000 7f41ecd4c640 1 -- 10.20.193.76:0/483038239 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc037440 con 0x7f41e812b9a0 2026-02-25T17:21:10.468 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.460+0000 7f41effd9640 1 -- 10.20.193.76:0/483038239 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f41e812b9a0 msgr2=0x7f41e8098470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.468 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.460+0000 7f41effd9640 1 --2- 10.20.193.76:0/483038239 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f41e812b9a0 0x7f41e8098470 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f41dc009970 tx=0x7f41dc02ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:10.468 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.460+0000 7f41effd9640 1 -- 10.20.193.76:0/483038239 shutdown_connections 2026-02-25T17:21:10.468 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.460+0000 7f41effd9640 1 --2- 10.20.193.76:0/483038239 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f41e812b9a0 0x7f41e8098470 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.468 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.460+0000 7f41effd9640 1 --2- 10.20.193.76:0/483038239 >> v2:10.20.193.76:3300/0 conn(0x7f41e812b080 0x7f41e812b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.468 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.460+0000 7f41effd9640 1 -- 10.20.193.76:0/483038239 >> 10.20.193.76:0/483038239 conn(0x7f41e809a960 msgr2=0x7f41e809ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.468 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.460+0000 7f41effd9640 1 -- 10.20.193.76:0/483038239 shutdown_connections 2026-02-25T17:21:10.468 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.460+0000 7f41effd9640 1 -- 10.20.193.76:0/483038239 wait complete. 2026-02-25T17:21:10.468 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.461+0000 7f41effd9640 1 Processor -- start 2026-02-25T17:21:10.469 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.461+0000 7f41effd9640 1 -- start start 2026-02-25T17:21:10.469 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.461+0000 7f41effd9640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f41e80989b0 0x7f41e8126fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.469 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.461+0000 7f41effd9640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f41e812b080 0x7f41e8127510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.469 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.461+0000 7f41effd9640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f41e812b9a0 0x7f41e8127a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.469 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.461+0000 7f41effd9640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e8128b10 con 0x7f41e80989b0 2026-02-25T17:21:10.469 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.461+0000 7f41effd9640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e81251e0 con 0x7f41e812b080 2026-02-25T17:21:10.469 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.461+0000 7f41effd9640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f41e8128050 con 0x7f41e812b9a0 2026-02-25T17:21:10.469 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.461+0000 7f41edd4e640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f41e80989b0 0x7f41e8126fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.469 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.461+0000 7f41ed54d640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f41e812b080 0x7f41e8127510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.469 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.461+0000 7f41edd4e640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f41e80989b0 0x7f41e8126fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:39126/0 (socket says 10.20.193.76:39126) 2026-02-25T17:21:10.470 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.461+0000 7f41ed54d640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f41e812b080 0x7f41e8127510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:41688/0 (socket says 10.20.193.76:41688) 2026-02-25T17:21:10.470 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.461+0000 7f41edd4e640 1 -- 10.20.193.76:0/215242430 learned_addr learned my addr 10.20.193.76:0/215242430 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:10.470 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.461+0000 7f41ee54f640 1 --2- 10.20.193.76:0/215242430 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f41e812b9a0 0x7f41e8127a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.470 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.461+0000 7f41edd4e640 1 -- 10.20.193.76:0/215242430 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f41e812b9a0 msgr2=0x7f41e8127a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.470 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.461+0000 7f41edd4e640 1 --2- 10.20.193.76:0/215242430 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f41e812b9a0 0x7f41e8127a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.470 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.461+0000 7f41edd4e640 1 -- 10.20.193.76:0/215242430 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f41e812b080 msgr2=0x7f41e8127510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.470 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.461+0000 7f41edd4e640 1 --2- 10.20.193.76:0/215242430 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f41e812b080 0x7f41e8127510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.470 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.461+0000 7f41edd4e640 1 -- 10.20.193.76:0/215242430 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc0095d0 con 0x7f41e80989b0 2026-02-25T17:21:10.470 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.461+0000 7f41ed54d640 1 --2- 10.20.193.76:0/215242430 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f41e812b080 0x7f41e8127510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:10.470 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.462+0000 7f41edd4e640 1 --2- 10.20.193.76:0/215242430 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f41e80989b0 0x7f41e8126fd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f41d800ec10 tx=0x7f41d800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.470 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.462+0000 7f41d67fc640 1 -- 10.20.193.76:0/215242430 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8009770 con 0x7f41e80989b0 2026-02-25T17:21:10.470 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.462+0000 7f41d67fc640 1 -- 10.20.193.76:0/215242430 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d800cbe0 con 0x7f41e80989b0 2026-02-25T17:21:10.471 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.462+0000 7f41d67fc640 1 -- 10.20.193.76:0/215242430 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8013470 con 0x7f41e80989b0 2026-02-25T17:21:10.471 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.462+0000 7f41effd9640 1 -- 10.20.193.76:0/215242430 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e8125920 con 0x7f41e80989b0 2026-02-25T17:21:10.471 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.462+0000 7f41effd9640 1 -- 10.20.193.76:0/215242430 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e8126340 con 0x7f41e80989b0 2026-02-25T17:21:10.471 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.462+0000 7f41effd9640 1 -- 10.20.193.76:0/215242430 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e812b460 con 0x7f41e80989b0 2026-02-25T17:21:10.471 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.462+0000 7f41d67fc640 1 -- 10.20.193.76:0/215242430 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 6) v1 ==== 59352+0+0 (secure 0 0 0) 0x7f41d8011070 con 0x7f41e80989b0 2026-02-25T17:21:10.471 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.463+0000 7f41ed54d640 1 -- 10.20.193.76:0/215242430 >> v1:10.20.193.76:6800/42442 conn(0x7f41b804d620 legacy=0x7f41b804fae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.76:6800/42442 2026-02-25T17:21:10.471 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.463+0000 7f41d67fc640 1 -- 10.20.193.76:0/215242430 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2806+0+0 (secure 0 0 0) 0x7f41d8063a80 con 0x7f41e80989b0 2026-02-25T17:21:10.472 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.464+0000 7f1ad73da140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-25T17:21:10.472 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.465+0000 7f41d67fc640 1 -- 10.20.193.76:0/215242430 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143111 (secure 0 0 0) 0x7f41d803e650 con 0x7f41e80989b0 2026-02-25T17:21:10.507 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.505+0000 7f1ad73da140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-25T17:21:10.531 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.528+0000 7f41effd9640 1 -- 10.20.193.76:0/215242430 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41e8068270 con 0x7f41e80989b0 2026-02-25T17:21:10.531 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.529+0000 7f1ad73da140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-25T17:21:10.532 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.529+0000 7f41d67fc640 1 -- 10.20.193.76:0/215242430 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8602 (secure 0 0 0) 0x7f41d8017030 con 0x7f41e80989b0 2026-02-25T17:21:10.532 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:10.532 INFO:teuthology.orchestra.run.trial076.stdout:{"epoch":15,"fsid":"0648ee30-4e19-4268-91ad-07b0e65a8518","created":"2026-02-25T17:13:33.780133+0000","modified":"2026-02-25T17:13:56.776498+0000","last_up_change":"2026-02-25T17:13:41.008215+0000","last_in_change":"2026-02-25T17:13:34.859194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-25T17:13:42.208987+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-25T17:13:42.832027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85909bd3-2540-48a9-a649-33709fa74613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6806","nonce":43127}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6808","nonce":43127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6812","nonce":43127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6810","nonce":43127}]},"public_addr":"10.20.193.76:6806/43127","cluster_addr":"10.20.193.76:6808/43127","heartbeat_back_addr":"10.20.193.76:6812/43127","heartbeat_front_addr":"10.20.193.76:6810/43127","state":["exists","up"]},{"osd":1,"uuid":"f0a0a51c-d629-464e-bc04-dacbaaf78efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6805","nonce":43126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6807","nonce":43126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6811","nonce":43126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6809","nonce":43126}]},"public_addr":"10.20.193.76:6805/43126","cluster_addr":"10.20.193.76:6807/43126","heartbeat_back_addr":"10.20.193.76:6811/43126","heartbeat_front_addr":"10.20.193.76:6809/43126","state":["exists","up"]},{"osd":2,"uuid":"9633000b-764d-457a-b560-539dc5830e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6813","nonce":43128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6814","nonce":43128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6816","nonce":43128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6815","nonce":43128}]},"public_addr":"10.20.193.76:6813/43128","cluster_addr":"10.20.193.76:6814/43128","heartbeat_back_addr":"10.20.193.76:6816/43128","heartbeat_front_addr":"10.20.193.76:6815/43128","state":["exists","up"]},{"osd":3,"uuid":"fc098e34-48a8-4414-ad41-60abdf7388a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6801","nonce":43129}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6802","nonce":43129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6804","nonce":43129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6803","nonce":43129}]},"public_addr":"10.20.193.76:6801/43129","cluster_addr":"10.20.193.76:6802/43129","heartbeat_back_addr":"10.20.193.76:6804/43129","heartbeat_front_addr":"10.20.193.76:6803/43129","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.998715+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.974454+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:40.020834+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.943932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T17:21:10.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.530+0000 7f41effd9640 1 -- 10.20.193.76:0/215242430 >> v1:10.20.193.76:6800/42442 conn(0x7f41b804d620 legacy=0x7f41b804fae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-25T17:21:10.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.530+0000 7f41effd9640 1 -- 10.20.193.76:0/215242430 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f41e80989b0 msgr2=0x7f41e8126fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.530+0000 7f41effd9640 1 --2- 10.20.193.76:0/215242430 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f41e80989b0 0x7f41e8126fd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f41d800ec10 tx=0x7f41d800c520 comp rx=0 tx=0).stop 2026-02-25T17:21:10.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.530+0000 7f41effd9640 1 -- 10.20.193.76:0/215242430 shutdown_connections 2026-02-25T17:21:10.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.530+0000 7f41effd9640 1 --2- 10.20.193.76:0/215242430 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f41e812b9a0 0x7f41e8127a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.530+0000 7f41effd9640 1 --2- 10.20.193.76:0/215242430 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f41e812b080 0x7f41e8127510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.530+0000 7f41effd9640 1 --2- 10.20.193.76:0/215242430 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f41e80989b0 0x7f41e8126fd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.530+0000 7f41effd9640 1 -- 10.20.193.76:0/215242430 >> 10.20.193.76:0/215242430 conn(0x7f41e809a960 msgr2=0x7f41e809b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.530+0000 7f41effd9640 1 -- 10.20.193.76:0/215242430 shutdown_connections 2026-02-25T17:21:10.533 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.530+0000 7f41effd9640 1 -- 10.20.193.76:0/215242430 wait complete. 2026-02-25T17:21:10.540 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-25T17:21:10.541 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-25T17:21:10.542 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-25T17:21:10.542 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-25T17:21:10.555 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.553+0000 7f1ad73da140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-25T17:21:10.580 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.578+0000 7f1ad73da140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-25T17:21:10.602 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.600+0000 7f1ad73da140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-25T17:21:10.625 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.622+0000 7f42d0ed1640 1 Processor -- start 2026-02-25T17:21:10.625 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.622+0000 7f276eb1b640 1 Processor -- start 2026-02-25T17:21:10.626 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f276eb1b640 1 -- start start 2026-02-25T17:21:10.626 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f42d0ed1640 1 -- start start 2026-02-25T17:21:10.626 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7fda45be5640 1 Processor -- start 2026-02-25T17:21:10.627 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f1b57bb9640 1 Processor -- start 2026-02-25T17:21:10.627 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7fda45be5640 1 -- start start 2026-02-25T17:21:10.627 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f1b57bb9640 1 -- start start 2026-02-25T17:21:10.628 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f42d0ed1640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f42cc06dfd0 0x7f42cc06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.628 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f42d0ed1640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f42cc06e8f0 0x7f42cc0980d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.628 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f42d0ed1640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42cc09d9a0 con 0x7f42cc098610 2026-02-25T17:21:10.628 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f276eb1b640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2768131370 0x7f2768133760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.629 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f42d0ed1640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42cc099190 con 0x7f42cc06dfd0 2026-02-25T17:21:10.629 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f42d0ed1640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc08c910 con 0x7f42cc06e8f0 2026-02-25T17:21:10.629 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f276eb1b640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2768133ca0 0x7f2768136090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.629 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f276eb1b640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27680616e0 con 0x7f2768096cc0 2026-02-25T17:21:10.630 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f276eb1b640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27680964c0 con 0x7f2768131370 2026-02-25T17:21:10.630 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f276eb1b640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27680967d0 con 0x7f2768133ca0 2026-02-25T17:21:10.630 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f42c9d74640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f42cc06e8f0 0x7f42cc0980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.630 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f42c9d74640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f42cc06e8f0 0x7f42cc0980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:41696/0 (socket says 10.20.193.76:41696) 2026-02-25T17:21:10.630 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f42c9d74640 1 -- 10.20.193.76:0/3083678645 learned_addr learned my addr 10.20.193.76:0/3083678645 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:10.631 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f276d091640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2768133ca0 0x7f2768136090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.631 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f276c890640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f2768096cc0 0x7f27680970a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:46874/0 (socket says 10.20.193.76:46874) 2026-02-25T17:21:10.631 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f275ffff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2768131370 0x7f2768133760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.631 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f276c890640 1 -- 10.20.193.76:0/3360274865 learned_addr learned my addr 10.20.193.76:0/3360274865 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:10.632 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f42ca575640 1 --2- 10.20.193.76:0/3083678645 >> v2:10.20.193.76:3300/0 conn(0x7f42cc06dfd0 0x7f42cc06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.632 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f1b57bb9640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f1b5012b3e0 0x7f1b5012b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.632 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f1b57bb9640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1b5012eb90 0x7f1b50136820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.633 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f1b57bb9640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b5012af40 con 0x7f1b5006d680 2026-02-25T17:21:10.633 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f1b57bb9640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5012b1e0 con 0x7f1b5012b3e0 2026-02-25T17:21:10.633 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f1b57bb9640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5006ddf0 con 0x7f1b5012eb90 2026-02-25T17:21:10.633 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7fda45be5640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fda40071240 0x7fda40071620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.633 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7fda45be5640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fda40071b60 0x7fda4012c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.633 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f42c9573640 1 -- 10.20.193.76:0/3083678645 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678409548 0 0) 0x7f42cc09d9a0 con 0x7f42cc098610 2026-02-25T17:21:10.634 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f275f7fe640 1 -- 10.20.193.76:0/3360274865 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627161425 0 0) 0x7f27680616e0 con 0x7f2768096cc0 2026-02-25T17:21:10.634 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f1b5612f640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1b5012eb90 0x7f1b50136820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.634 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7fda45be5640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda400703d0 con 0x7fda40071fc0 2026-02-25T17:21:10.635 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7fda45be5640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda40070720 con 0x7fda40071240 2026-02-25T17:21:10.635 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f1b5612f640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1b5012eb90 0x7f1b50136820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:48380/0 (socket says 10.20.193.76:48380) 2026-02-25T17:21:10.635 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f1b5612f640 1 -- 10.20.193.76:0/3271918964 learned_addr learned my addr 10.20.193.76:0/3271918964 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:10.635 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7fda45be5640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda40069c00 con 0x7fda40071b60 2026-02-25T17:21:10.636 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f42c9573640 1 -- 10.20.193.76:0/3083678645 --> v1:10.20.193.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42b8003620 con 0x7f42cc098610 2026-02-25T17:21:10.636 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f275f7fe640 1 -- 10.20.193.76:0/3360274865 --> v1:10.20.193.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2754003620 con 0x7f2768096cc0 2026-02-25T17:21:10.636 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7fda3effd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fda40071b60 0x7fda4012c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.636 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f42c9d74640 1 -- 10.20.193.76:0/3083678645 >> v2:10.20.193.76:3300/0 conn(0x7f42cc06dfd0 msgr2=0x7f42cc06e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:10.637 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f42c9d74640 1 --2- 10.20.193.76:0/3083678645 >> v2:10.20.193.76:3300/0 conn(0x7f42cc06dfd0 0x7f42cc06e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.637 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f276d091640 1 -- 10.20.193.76:0/3360274865 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2768131370 msgr2=0x7f2768133760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:10.637 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f276d091640 1 --2- 10.20.193.76:0/3360274865 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2768131370 0x7f2768133760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.637 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f276d091640 1 -- 10.20.193.76:0/3360274865 >> v1:10.20.193.76:6789/0 conn(0x7f2768096cc0 legacy=0x7f27680970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.637 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f42c9d74640 1 -- 10.20.193.76:0/3083678645 >> v1:10.20.193.76:6789/0 conn(0x7f42cc098610 legacy=0x7f42cc133700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.638 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f42c9d74640 1 -- 10.20.193.76:0/3083678645 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc072260 con 0x7f42cc06e8f0 2026-02-25T17:21:10.638 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7fda3effd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fda40071b60 0x7fda4012c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:41712/0 (socket says 10.20.193.76:41712) 2026-02-25T17:21:10.638 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7fda3effd640 1 -- 10.20.193.76:0/13419339 learned_addr learned my addr 10.20.193.76:0/13419339 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:10.638 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f276d091640 1 -- 10.20.193.76:0/3360274865 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2768061430 con 0x7f2768133ca0 2026-02-25T17:21:10.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7fda3f7fe640 1 --2- 10.20.193.76:0/13419339 >> v2:10.20.193.76:3300/0 conn(0x7fda40071240 0x7fda40071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f1b5612f640 1 -- 10.20.193.76:0/3271918964 >> v2:10.20.193.76:3300/0 conn(0x7f1b5012b3e0 msgr2=0x7f1b5012b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:10.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f1b5612f640 1 --2- 10.20.193.76:0/3271918964 >> v2:10.20.193.76:3300/0 conn(0x7f1b5012b3e0 0x7f1b5012b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f1b5612f640 1 -- 10.20.193.76:0/3271918964 >> v1:10.20.193.76:6789/0 conn(0x7f1b5006d680 legacy=0x7f1b5012e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:10.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7f1b5612f640 1 -- 10.20.193.76:0/3271918964 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b500a1780 con 0x7f1b5012eb90 2026-02-25T17:21:10.640 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7fda3effd640 1 -- 10.20.193.76:0/13419339 >> v2:10.20.193.76:3300/0 conn(0x7fda40071240 msgr2=0x7fda40071620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:10.640 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7fda3effd640 1 --2- 10.20.193.76:0/13419339 >> v2:10.20.193.76:3300/0 conn(0x7fda40071240 0x7fda40071620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.640 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7fda3effd640 1 -- 10.20.193.76:0/13419339 >> v1:10.20.193.76:6789/0 conn(0x7fda40071fc0 legacy=0x7fda4012c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:10.640 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7fda3effd640 1 -- 10.20.193.76:0/13419339 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda40070b40 con 0x7fda40071b60 2026-02-25T17:21:10.640 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.623+0000 7fda3f7fe640 1 --2- 10.20.193.76:0/13419339 >> v2:10.20.193.76:3300/0 conn(0x7fda40071240 0x7fda40071620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-25T17:21:10.641 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f276d091640 1 --2- 10.20.193.76:0/3360274865 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2768133ca0 0x7f2768136090 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2764009dc0 tx=0x7f276402f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6a5ce9c24ab5c3a server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.641 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f1b5612f640 1 --2- 10.20.193.76:0/3271918964 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1b5012eb90 0x7f1b50136820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009e50 tx=0x7f1b4c02f260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a75203625572d925 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.641 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f42c9d74640 1 --2- 10.20.193.76:0/3083678645 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f42cc06e8f0 0x7f42cc0980d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009970 tx=0x7f42b402eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f99cead0f388a597 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.641 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f42c9573640 1 -- 10.20.193.76:0/3083678645 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b402fbb0 con 0x7f42cc06e8f0 2026-02-25T17:21:10.642 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f275f7fe640 1 -- 10.20.193.76:0/3360274865 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2764006ea0 con 0x7f2768133ca0 2026-02-25T17:21:10.642 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7fda3effd640 1 --2- 10.20.193.76:0/13419339 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fda40071b60 0x7fda4012c2a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fda30009970 tx=0x7fda3002ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd27caf48a62b1d server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.642 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f42c9573640 1 -- 10.20.193.76:0/3083678645 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b402fd10 con 0x7f42cc06e8f0 2026-02-25T17:21:10.643 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f1b5492c640 1 -- 10.20.193.76:0/3271918964 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c006ea0 con 0x7f1b5012eb90 2026-02-25T17:21:10.643 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f275f7fe640 1 -- 10.20.193.76:0/3360274865 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276402fdf0 con 0x7f2768133ca0 2026-02-25T17:21:10.643 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f275f7fe640 1 -- 10.20.193.76:0/3360274865 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2764037640 con 0x7f2768133ca0 2026-02-25T17:21:10.643 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f42c9573640 1 -- 10.20.193.76:0/3083678645 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4037660 con 0x7f42cc06e8f0 2026-02-25T17:21:10.644 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f1b5492c640 1 -- 10.20.193.76:0/3271918964 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4c02fc80 con 0x7f1b5012eb90 2026-02-25T17:21:10.644 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f1b5492c640 1 -- 10.20.193.76:0/3271918964 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c0373f0 con 0x7f1b5012eb90 2026-02-25T17:21:10.644 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7fda3e7fc640 1 -- 10.20.193.76:0/13419339 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3002fac0 con 0x7fda40071b60 2026-02-25T17:21:10.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7fda3e7fc640 1 -- 10.20.193.76:0/13419339 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3002fc20 con 0x7fda40071b60 2026-02-25T17:21:10.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7fda3e7fc640 1 -- 10.20.193.76:0/13419339 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda30037440 con 0x7fda40071b60 2026-02-25T17:21:10.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f276eb1b640 1 -- 10.20.193.76:0/3360274865 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2768133ca0 msgr2=0x7f2768136090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f276eb1b640 1 --2- 10.20.193.76:0/3360274865 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2768133ca0 0x7f2768136090 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2764009dc0 tx=0x7f276402f1c0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f276eb1b640 1 -- 10.20.193.76:0/3360274865 shutdown_connections 2026-02-25T17:21:10.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f276eb1b640 1 --2- 10.20.193.76:0/3360274865 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2768133ca0 0x7f2768136090 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f276eb1b640 1 --2- 10.20.193.76:0/3360274865 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2768131370 0x7f2768133760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f276eb1b640 1 -- 10.20.193.76:0/3360274865 >> 10.20.193.76:0/3360274865 conn(0x7f276809d1d0 msgr2=0x7f276809d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f276eb1b640 1 -- 10.20.193.76:0/3360274865 shutdown_connections 2026-02-25T17:21:10.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f276eb1b640 1 -- 10.20.193.76:0/3360274865 wait complete. 2026-02-25T17:21:10.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f1b57bb9640 1 -- 10.20.193.76:0/3271918964 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1b5012eb90 msgr2=0x7f1b50136820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.647 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f1b57bb9640 1 --2- 10.20.193.76:0/3271918964 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1b5012eb90 0x7f1b50136820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009e50 tx=0x7f1b4c02f260 comp rx=0 tx=0).stop 2026-02-25T17:21:10.647 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f1b57bb9640 1 -- 10.20.193.76:0/3271918964 shutdown_connections 2026-02-25T17:21:10.647 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f1b57bb9640 1 --2- 10.20.193.76:0/3271918964 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1b5012eb90 0x7f1b50136820 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.647 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7fda45be5640 1 -- 10.20.193.76:0/13419339 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fda40071b60 msgr2=0x7fda4012c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.647 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7fda45be5640 1 --2- 10.20.193.76:0/13419339 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fda40071b60 0x7fda4012c2a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fda30009970 tx=0x7fda3002ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:10.648 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f1b57bb9640 1 --2- 10.20.193.76:0/3271918964 >> v2:10.20.193.76:3300/0 conn(0x7f1b5012b3e0 0x7f1b5012b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.648 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f1b57bb9640 1 -- 10.20.193.76:0/3271918964 >> 10.20.193.76:0/3271918964 conn(0x7f1b5009f3c0 msgr2=0x7f1b500a0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.648 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7fda45be5640 1 -- 10.20.193.76:0/13419339 shutdown_connections 2026-02-25T17:21:10.648 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7fda45be5640 1 --2- 10.20.193.76:0/13419339 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fda40071b60 0x7fda4012c2a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.648 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7fda45be5640 1 --2- 10.20.193.76:0/13419339 >> v2:10.20.193.76:3300/0 conn(0x7fda40071240 0x7fda40071620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.648 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7fda45be5640 1 -- 10.20.193.76:0/13419339 >> 10.20.193.76:0/13419339 conn(0x7fda4009cde0 msgr2=0x7fda4009d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.649 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f1b57bb9640 1 -- 10.20.193.76:0/3271918964 shutdown_connections 2026-02-25T17:21:10.649 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f42d0ed1640 1 -- 10.20.193.76:0/3083678645 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f42cc06e8f0 msgr2=0x7f42cc0980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.649 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f42d0ed1640 1 --2- 10.20.193.76:0/3083678645 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f42cc06e8f0 0x7f42cc0980d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009970 tx=0x7f42b402eef0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.649 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7fda45be5640 1 -- 10.20.193.76:0/13419339 shutdown_connections 2026-02-25T17:21:10.650 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f1b57bb9640 1 -- 10.20.193.76:0/3271918964 wait complete. 2026-02-25T17:21:10.650 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7fda45be5640 1 -- 10.20.193.76:0/13419339 wait complete. 2026-02-25T17:21:10.651 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f42d0ed1640 1 -- 10.20.193.76:0/3083678645 shutdown_connections 2026-02-25T17:21:10.652 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f42d0ed1640 1 --2- 10.20.193.76:0/3083678645 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f42cc06e8f0 0x7f42cc0980d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.652 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f42d0ed1640 1 --2- 10.20.193.76:0/3083678645 >> v2:10.20.193.76:3300/0 conn(0x7f42cc06dfd0 0x7f42cc06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.652 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f42d0ed1640 1 -- 10.20.193.76:0/3083678645 >> 10.20.193.76:0/3083678645 conn(0x7f42cc09a960 msgr2=0x7f42cc09ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.652 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.624+0000 7f42d0ed1640 1 -- 10.20.193.76:0/3083678645 shutdown_connections 2026-02-25T17:21:10.652 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f42d0ed1640 1 -- 10.20.193.76:0/3083678645 wait complete. 2026-02-25T17:21:10.653 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f276eb1b640 1 Processor -- start 2026-02-25T17:21:10.653 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f276eb1b640 1 -- start start 2026-02-25T17:21:10.653 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f1b57bb9640 1 Processor -- start 2026-02-25T17:21:10.653 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f1b57bb9640 1 -- start start 2026-02-25T17:21:10.654 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7fda45be5640 1 Processor -- start 2026-02-25T17:21:10.655 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f276eb1b640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2768096cc0 0x7f276812ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.655 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f276eb1b640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2768131370 0x7f276812f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.655 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f276eb1b640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2768133ca0 0x7f276812f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.655 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f276eb1b640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2768130630 con 0x7f2768133ca0 2026-02-25T17:21:10.655 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f276eb1b640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276806ceb0 con 0x7f2768131370 2026-02-25T17:21:10.655 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f276eb1b640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f276806d690 con 0x7f2768096cc0 2026-02-25T17:21:10.655 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7fda45be5640 1 -- start start 2026-02-25T17:21:10.656 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f42d0ed1640 1 Processor -- start 2026-02-25T17:21:10.656 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f275ffff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2768131370 0x7f276812f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.656 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f276c890640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2768096cc0 0x7f276812ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.656 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f276d091640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2768133ca0 0x7f276812f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.657 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f275ffff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2768131370 0x7f276812f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:41726/0 (socket says 10.20.193.76:41726) 2026-02-25T17:21:10.657 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f275ffff640 1 -- 10.20.193.76:0/1595493447 learned_addr learned my addr 10.20.193.76:0/1595493447 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:10.657 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f42d0ed1640 1 -- start start 2026-02-25T17:21:10.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f1b57bb9640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1b5006d680 0x7f1b501c5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f1b57bb9640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1b5012b3e0 0x7f1b501c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f1b57bb9640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f1b5012eb90 0x7f1b5011a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f1b57bb9640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5011da80 con 0x7f1b5012eb90 2026-02-25T17:21:10.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f1b57bb9640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5011d6b0 con 0x7f1b5012b3e0 2026-02-25T17:21:10.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f1b57bb9640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b50128c30 con 0x7f1b5006d680 2026-02-25T17:21:10.659 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f275ffff640 1 -- 10.20.193.76:0/1595493447 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2768096cc0 msgr2=0x7f276812ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.659 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f275ffff640 1 --2- 10.20.193.76:0/1595493447 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2768096cc0 0x7f276812ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.659 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f275ffff640 1 -- 10.20.193.76:0/1595493447 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2768133ca0 msgr2=0x7f276812f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.659 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f275ffff640 1 --2- 10.20.193.76:0/1595493447 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2768133ca0 0x7f276812f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.659 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f275ffff640 1 -- 10.20.193.76:0/1595493447 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2764009a70 con 0x7f2768131370 2026-02-25T17:21:10.659 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7fda45be5640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fda40071240 0x7fda40097dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.659 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7fda45be5640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fda40071b60 0x7fda40098310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.660 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f1b5592e640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1b5006d680 0x7f1b501c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.660 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f1b5512d640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1b5012b3e0 0x7f1b501c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.660 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7fda45be5640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fda40071fc0 0x7fda401310d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.660 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7fda45be5640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda40133430 con 0x7fda40071fc0 2026-02-25T17:21:10.660 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7fda45be5640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda400728b0 con 0x7fda40071b60 2026-02-25T17:21:10.660 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7fda45be5640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda40133830 con 0x7fda40071240 2026-02-25T17:21:10.661 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f1b5512d640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1b5012b3e0 0x7f1b501c5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:41742/0 (socket says 10.20.193.76:41742) 2026-02-25T17:21:10.661 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f1b5512d640 1 -- 10.20.193.76:0/930303019 learned_addr learned my addr 10.20.193.76:0/930303019 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:10.661 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f1b5592e640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1b5006d680 0x7f1b501c5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:48394/0 (socket says 10.20.193.76:48394) 2026-02-25T17:21:10.661 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f42d0ed1640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f42cc06dfd0 0x7f42cc1c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.661 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7fda3f7fe640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fda40071240 0x7fda40097dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.662 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7fda3effd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fda40071b60 0x7fda40098310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.662 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7fda3f7fe640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fda40071240 0x7fda40097dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:48406/0 (socket says 10.20.193.76:48406) 2026-02-25T17:21:10.662 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f275ffff640 1 --2- 10.20.193.76:0/1595493447 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2768131370 0x7f276812f1f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f275000ebe0 tx=0x7f275000c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.662 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7fda3f7fe640 1 -- 10.20.193.76:0/361403192 learned_addr learned my addr 10.20.193.76:0/361403192 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:10.662 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f42d0ed1640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f42cc06e8f0 0x7f42cc1c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.663 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f42d0ed1640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f42cc098610 0x7f42cc1c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.663 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f42d0ed1640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc08e7d0 con 0x7f42cc098610 2026-02-25T17:21:10.663 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7fda3ffff640 1 --2- 10.20.193.76:0/361403192 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fda40071fc0 0x7fda401310d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.663 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f42d0ed1640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc08fb40 con 0x7f42cc06e8f0 2026-02-25T17:21:10.663 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f42d0ed1640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc126b70 con 0x7f42cc06dfd0 2026-02-25T17:21:10.663 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f42ca575640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f42cc06dfd0 0x7f42cc1c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.664 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f275d7fa640 1 -- 10.20.193.76:0/1595493447 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750009770 con 0x7f2768131370 2026-02-25T17:21:10.664 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f1b5612f640 1 --2- 10.20.193.76:0/930303019 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f1b5012eb90 0x7f1b5011a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.664 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f42ca575640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f42cc06dfd0 0x7f42cc1c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:48408/0 (socket says 10.20.193.76:48408) 2026-02-25T17:21:10.664 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f42ca575640 1 -- 10.20.193.76:0/3318109778 learned_addr learned my addr 10.20.193.76:0/3318109778 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:10.665 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f1b5512d640 1 -- 10.20.193.76:0/930303019 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1b5006d680 msgr2=0x7f1b501c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.665 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f1b5512d640 1 --2- 10.20.193.76:0/930303019 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1b5006d680 0x7f1b501c5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.665 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f275d7fa640 1 -- 10.20.193.76:0/1595493447 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275000cbe0 con 0x7f2768131370 2026-02-25T17:21:10.665 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f276eb1b640 1 -- 10.20.193.76:0/1595493447 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276806ca40 con 0x7f2768131370 2026-02-25T17:21:10.665 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f42cad76640 1 --2- 10.20.193.76:0/3318109778 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f42cc098610 0x7f42cc1c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.666 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f1b5512d640 1 -- 10.20.193.76:0/930303019 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f1b5012eb90 msgr2=0x7f1b5011a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.666 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f1b5512d640 1 --2- 10.20.193.76:0/930303019 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f1b5012eb90 0x7f1b5011a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.666 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f1b5512d640 1 -- 10.20.193.76:0/930303019 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c009b30 con 0x7f1b5012b3e0 2026-02-25T17:21:10.666 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.625+0000 7f42c9d74640 1 --2- 10.20.193.76:0/3318109778 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f42cc06e8f0 0x7f42cc1c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.666 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f1b5512d640 1 --2- 10.20.193.76:0/930303019 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1b5012b3e0 0x7f1b501c5ac0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400b750 tx=0x7f1b4400bc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.667 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7fda3f7fe640 1 -- 10.20.193.76:0/361403192 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fda40071b60 msgr2=0x7fda40098310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.667 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7fda3f7fe640 1 --2- 10.20.193.76:0/361403192 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fda40071b60 0x7fda40098310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.667 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7fda3f7fe640 1 -- 10.20.193.76:0/361403192 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fda40071fc0 msgr2=0x7fda401310d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.667 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7fda3f7fe640 1 --2- 10.20.193.76:0/361403192 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fda40071fc0 0x7fda401310d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.667 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7fda3f7fe640 1 -- 10.20.193.76:0/361403192 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda300095d0 con 0x7fda40071240 2026-02-25T17:21:10.668 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f42ca575640 1 -- 10.20.193.76:0/3318109778 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f42cc06e8f0 msgr2=0x7f42cc1c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.668 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f42ca575640 1 --2- 10.20.193.76:0/3318109778 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f42cc06e8f0 0x7f42cc1c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.668 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f42ca575640 1 -- 10.20.193.76:0/3318109778 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f42cc098610 msgr2=0x7f42cc1c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.668 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f42ca575640 1 --2- 10.20.193.76:0/3318109778 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f42cc098610 0x7f42cc1c5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.668 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f42ca575640 1 -- 10.20.193.76:0/3318109778 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b40095d0 con 0x7f42cc06dfd0 2026-02-25T17:21:10.668 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7fda3f7fe640 1 --2- 10.20.193.76:0/361403192 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fda40071240 0x7fda40097dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fda2c00d800 tx=0x7fda2c00dcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.668 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f275d7fa640 1 -- 10.20.193.76:0/1595493447 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750013470 con 0x7f2768131370 2026-02-25T17:21:10.668 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f276eb1b640 1 -- 10.20.193.76:0/1595493447 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276812fc70 con 0x7f2768131370 2026-02-25T17:21:10.669 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7fda1bfff640 1 -- 10.20.193.76:0/361403192 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c00b8d0 con 0x7fda40071240 2026-02-25T17:21:10.669 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f42ca575640 1 --2- 10.20.193.76:0/3318109778 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f42cc06dfd0 0x7f42cc1c5430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f42c000ec10 tx=0x7f42c000c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.669 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7fda1bfff640 1 -- 10.20.193.76:0/361403192 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2c00ba30 con 0x7fda40071240 2026-02-25T17:21:10.669 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7fda45be5640 1 -- 10.20.193.76:0/361403192 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda40098850 con 0x7fda40071240 2026-02-25T17:21:10.669 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7fda1bfff640 1 -- 10.20.193.76:0/361403192 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c00bde0 con 0x7fda40071240 2026-02-25T17:21:10.670 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f1b3e7fc640 1 -- 10.20.193.76:0/930303019 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44004480 con 0x7f1b5012b3e0 2026-02-25T17:21:10.670 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f1b3e7fc640 1 -- 10.20.193.76:0/930303019 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b440045e0 con 0x7f1b5012b3e0 2026-02-25T17:21:10.670 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f1b3e7fc640 1 -- 10.20.193.76:0/930303019 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b440029a0 con 0x7f1b5012b3e0 2026-02-25T17:21:10.670 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f1b57bb9640 1 -- 10.20.193.76:0/930303019 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b5011bd80 con 0x7f1b5012b3e0 2026-02-25T17:21:10.670 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7fda45be5640 1 -- 10.20.193.76:0/361403192 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda40133f60 con 0x7fda40071240 2026-02-25T17:21:10.671 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f42b2ffd640 1 -- 10.20.193.76:0/3318109778 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c0009770 con 0x7f42cc06dfd0 2026-02-25T17:21:10.671 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f1b57bb9640 1 -- 10.20.193.76:0/930303019 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b501c6000 con 0x7f1b5012b3e0 2026-02-25T17:21:10.671 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f42b2ffd640 1 -- 10.20.193.76:0/3318109778 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c000cc40 con 0x7f42cc06dfd0 2026-02-25T17:21:10.671 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f42d0ed1640 1 -- 10.20.193.76:0/3318109778 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42cc08ef90 con 0x7f42cc06dfd0 2026-02-25T17:21:10.671 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f42b2ffd640 1 -- 10.20.193.76:0/3318109778 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c0013470 con 0x7f42cc06dfd0 2026-02-25T17:21:10.671 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f42d0ed1640 1 -- 10.20.193.76:0/3318109778 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42cc08cfe0 con 0x7f42cc06dfd0 2026-02-25T17:21:10.672 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f276eb1b640 1 -- 10.20.193.76:0/1595493447 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f27681349c0 con 0x7f2768131370 2026-02-25T17:21:10.672 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7fda45be5640 1 -- 10.20.193.76:0/361403192 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fda40099c50 con 0x7fda40071240 2026-02-25T17:21:10.672 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f1b57bb9640 1 -- 10.20.193.76:0/930303019 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b500a0f40 con 0x7f1b5012b3e0 2026-02-25T17:21:10.672 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f275d7fa640 1 -- 10.20.193.76:0/1595493447 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 6) v1 ==== 59352+0+0 (secure 0 0 0) 0x7f2750011070 con 0x7f2768131370 2026-02-25T17:21:10.672 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f42d0ed1640 1 -- 10.20.193.76:0/3318109778 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f42cc098a70 con 0x7f42cc06dfd0 2026-02-25T17:21:10.673 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7fda1bfff640 1 -- 10.20.193.76:0/361403192 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 6) v1 ==== 59352+0+0 (secure 0 0 0) 0x7fda2c01b070 con 0x7fda40071240 2026-02-25T17:21:10.673 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.626+0000 7f1b3e7fc640 1 -- 10.20.193.76:0/930303019 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 6) v1 ==== 59352+0+0 (secure 0 0 0) 0x7f1b44002b00 con 0x7f1b5012b3e0 2026-02-25T17:21:10.673 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7f42b2ffd640 1 -- 10.20.193.76:0/3318109778 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 6) v1 ==== 59352+0+0 (secure 0 0 0) 0x7f42c0011070 con 0x7f42cc06dfd0 2026-02-25T17:21:10.673 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7f275d7fa640 1 -- 10.20.193.76:0/1595493447 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2806+0+0 (secure 0 0 0) 0x7f2750063a00 con 0x7f2768131370 2026-02-25T17:21:10.673 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7f276c890640 1 -- 10.20.193.76:0/1595493447 >> v1:10.20.193.76:6800/42442 conn(0x7f273804d620 legacy=0x7f273804fae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.76:6800/42442 2026-02-25T17:21:10.674 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7f275d7fa640 1 -- 10.20.193.76:0/1595493447 --> v1:10.20.193.76:6806/43127 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2738057510 con 0x7f2738053860 2026-02-25T17:21:10.674 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7f275d7fa640 1 -- 10.20.193.76:0/1595493447 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27500682c0 con 0x7f2768131370 2026-02-25T17:21:10.674 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7fda1bfff640 1 -- 10.20.193.76:0/361403192 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2806+0+0 (secure 0 0 0) 0x7fda2c063eb0 con 0x7fda40071240 2026-02-25T17:21:10.674 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7fda3effd640 1 -- 10.20.193.76:0/361403192 >> v1:10.20.193.76:6800/42442 conn(0x7fda1004d620 legacy=0x7fda1004fae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.76:6800/42442 2026-02-25T17:21:10.674 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7f1b5592e640 1 -- 10.20.193.76:0/930303019 >> v1:10.20.193.76:6800/42442 conn(0x7f1b2004d620 legacy=0x7f1b2004fae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.76:6800/42442 2026-02-25T17:21:10.674 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7fda1bfff640 1 -- 10.20.193.76:0/361403192 --> v1:10.20.193.76:6805/43126 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fda10057680 con 0x7fda100539d0 2026-02-25T17:21:10.674 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7fda1bfff640 1 -- 10.20.193.76:0/361403192 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda2c066570 con 0x7fda40071240 2026-02-25T17:21:10.675 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7f1b3e7fc640 1 -- 10.20.193.76:0/930303019 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2806+0+0 (secure 0 0 0) 0x7f1b440632f0 con 0x7f1b5012b3e0 2026-02-25T17:21:10.675 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7f1b3e7fc640 1 -- 10.20.193.76:0/930303019 --> v1:10.20.193.76:6801/43129 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1b20057680 con 0x7f1b200539d0 2026-02-25T17:21:10.675 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7f1b3e7fc640 1 -- 10.20.193.76:0/930303019 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b440658d0 con 0x7f1b5012b3e0 2026-02-25T17:21:10.675 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7f42c9d74640 1 -- 10.20.193.76:0/3318109778 >> v1:10.20.193.76:6800/42442 conn(0x7f429804d620 legacy=0x7f429804fae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.76:6800/42442 2026-02-25T17:21:10.675 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7f42b2ffd640 1 -- 10.20.193.76:0/3318109778 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2806+0+0 (secure 0 0 0) 0x7f42c0063b20 con 0x7f42cc06dfd0 2026-02-25T17:21:10.675 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7f42b2ffd640 1 -- 10.20.193.76:0/3318109778 --> v1:10.20.193.76:6813/43128 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4298057680 con 0x7f42980539d0 2026-02-25T17:21:10.675 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7f42b2ffd640 1 -- 10.20.193.76:0/3318109778 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42c00682c0 con 0x7f42cc06dfd0 2026-02-25T17:21:10.675 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7f275d7fa640 1 -- 10.20.193.76:0/1595493447 <== osd.0 v1:10.20.193.76:6806/43127 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25011 (unknown 0 0 1028417783) 0x7f2738057510 con 0x7f2738053860 2026-02-25T17:21:10.676 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7f1b3e7fc640 1 -- 10.20.193.76:0/930303019 <== osd.3 v1:10.20.193.76:6801/43129 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25011 (unknown 0 0 1028417783) 0x7f1b20057680 con 0x7f1b200539d0 2026-02-25T17:21:10.676 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7fda1bfff640 1 -- 10.20.193.76:0/361403192 <== osd.1 v1:10.20.193.76:6805/43126 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25011 (unknown 0 0 1028417783) 0x7fda10057680 con 0x7fda100539d0 2026-02-25T17:21:10.676 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.627+0000 7f42b2ffd640 1 -- 10.20.193.76:0/3318109778 <== osd.2 v1:10.20.193.76:6813/43128 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25011 (unknown 0 0 1028417783) 0x7f4298057680 con 0x7f42980539d0 2026-02-25T17:21:10.676 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.633+0000 7fda45be5640 1 -- 10.20.193.76:0/361403192 --> v1:10.20.193.76:6805/43126 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fda4006eac0 con 0x7fda100539d0 2026-02-25T17:21:10.676 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.633+0000 7f276eb1b640 1 -- 10.20.193.76:0/1595493447 --> v1:10.20.193.76:6806/43127 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f27680970a0 con 0x7f2738053860 2026-02-25T17:21:10.677 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.633+0000 7fda1bfff640 1 -- 10.20.193.76:0/361403192 <== osd.1 v1:10.20.193.76:6805/43126 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 4105021785) 0x7fda4006eac0 con 0x7fda100539d0 2026-02-25T17:21:10.677 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.633+0000 7f275d7fa640 1 -- 10.20.193.76:0/1595493447 <== osd.0 v1:10.20.193.76:6806/43127 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3892140717) 0x7f27680970a0 con 0x7f2738053860 2026-02-25T17:21:10.677 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.633+0000 7fda45be5640 1 -- 10.20.193.76:0/361403192 >> v1:10.20.193.76:6805/43126 conn(0x7fda100539d0 legacy=0x7fda10055e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.677 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.633+0000 7fda45be5640 1 -- 10.20.193.76:0/361403192 >> v1:10.20.193.76:6800/42442 conn(0x7fda1004d620 legacy=0x7fda1004fae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-25T17:21:10.677 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.633+0000 7fda45be5640 1 -- 10.20.193.76:0/361403192 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fda40071240 msgr2=0x7fda40097dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.678 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.633+0000 7f276eb1b640 1 -- 10.20.193.76:0/1595493447 >> v1:10.20.193.76:6806/43127 conn(0x7f2738053860 legacy=0x7f2738055ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.678 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.633+0000 7fda45be5640 1 --2- 10.20.193.76:0/361403192 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fda40071240 0x7fda40097dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fda2c00d800 tx=0x7fda2c00dcd0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.678 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.633+0000 7fda3ffff640 1 -- 10.20.193.76:0/361403192 reap_dead start 2026-02-25T17:21:10.678 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.633+0000 7f276eb1b640 1 -- 10.20.193.76:0/1595493447 >> v1:10.20.193.76:6800/42442 conn(0x7f273804d620 legacy=0x7f273804fae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-25T17:21:10.678 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.633+0000 7f276eb1b640 1 -- 10.20.193.76:0/1595493447 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2768131370 msgr2=0x7f276812f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.678 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.633+0000 7f276eb1b640 1 --2- 10.20.193.76:0/1595493447 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2768131370 0x7f276812f1f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f275000ebe0 tx=0x7f275000c520 comp rx=0 tx=0).stop 2026-02-25T17:21:10.678 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.633+0000 7fda45be5640 1 -- 10.20.193.76:0/361403192 shutdown_connections 2026-02-25T17:21:10.679 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.633+0000 7fda45be5640 1 -- 10.20.193.76:0/361403192 >> 10.20.193.76:0/361403192 conn(0x7fda4009cde0 msgr2=0x7fda4012c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.679 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.633+0000 7f276d091640 1 -- 10.20.193.76:0/1595493447 reap_dead start 2026-02-25T17:21:10.679 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.633+0000 7fda45be5640 1 -- 10.20.193.76:0/361403192 shutdown_connections 2026-02-25T17:21:10.679 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.633+0000 7f276eb1b640 1 -- 10.20.193.76:0/1595493447 shutdown_connections 2026-02-25T17:21:10.679 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.633+0000 7f276eb1b640 1 -- 10.20.193.76:0/1595493447 >> 10.20.193.76:0/1595493447 conn(0x7f276809d1d0 msgr2=0x7f27680928d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.679 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.633+0000 7fda45be5640 1 -- 10.20.193.76:0/361403192 wait complete. 2026-02-25T17:21:10.680 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.634+0000 7f276eb1b640 1 -- 10.20.193.76:0/1595493447 shutdown_connections 2026-02-25T17:21:10.680 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.634+0000 7f276eb1b640 1 -- 10.20.193.76:0/1595493447 wait complete. 2026-02-25T17:21:10.680 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.634+0000 7f1b57bb9640 1 -- 10.20.193.76:0/930303019 --> v1:10.20.193.76:6801/43129 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1b5012f230 con 0x7f1b200539d0 2026-02-25T17:21:10.680 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.634+0000 7f1b3e7fc640 1 -- 10.20.193.76:0/930303019 <== osd.3 v1:10.20.193.76:6801/43129 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 4105021785) 0x7f1b5012f230 con 0x7f1b200539d0 2026-02-25T17:21:10.680 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.634+0000 7f42d0ed1640 1 -- 10.20.193.76:0/3318109778 --> v1:10.20.193.76:6813/43128 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f42cc08f840 con 0x7f42980539d0 2026-02-25T17:21:10.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.634+0000 7f1b57bb9640 1 -- 10.20.193.76:0/930303019 >> v1:10.20.193.76:6801/43129 conn(0x7f1b200539d0 legacy=0x7f1b20055e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.635+0000 7f1b57bb9640 1 -- 10.20.193.76:0/930303019 >> v1:10.20.193.76:6800/42442 conn(0x7f1b2004d620 legacy=0x7f1b2004fae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-25T17:21:10.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.635+0000 7f1b57bb9640 1 -- 10.20.193.76:0/930303019 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1b5012b3e0 msgr2=0x7f1b501c5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.635+0000 7f1b57bb9640 1 --2- 10.20.193.76:0/930303019 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1b5012b3e0 0x7f1b501c5ac0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400b750 tx=0x7f1b4400bc20 comp rx=0 tx=0).stop 2026-02-25T17:21:10.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.635+0000 7f1b5612f640 1 -- 10.20.193.76:0/930303019 reap_dead start 2026-02-25T17:21:10.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.635+0000 7f1b57bb9640 1 -- 10.20.193.76:0/930303019 shutdown_connections 2026-02-25T17:21:10.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.635+0000 7f1b57bb9640 1 -- 10.20.193.76:0/930303019 >> 10.20.193.76:0/930303019 conn(0x7f1b5009f3c0 msgr2=0x7f1b5009d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.635+0000 7f42b2ffd640 1 -- 10.20.193.76:0/3318109778 <== osd.2 v1:10.20.193.76:6813/43128 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 4105021785) 0x7f42cc08f840 con 0x7f42980539d0 2026-02-25T17:21:10.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.635+0000 7f1b57bb9640 1 -- 10.20.193.76:0/930303019 shutdown_connections 2026-02-25T17:21:10.681 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.635+0000 7f1b57bb9640 1 -- 10.20.193.76:0/930303019 wait complete. 2026-02-25T17:21:10.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.635+0000 7f42d0ed1640 1 -- 10.20.193.76:0/3318109778 >> v1:10.20.193.76:6813/43128 conn(0x7f42980539d0 legacy=0x7f4298055e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.635+0000 7f42d0ed1640 1 -- 10.20.193.76:0/3318109778 >> v1:10.20.193.76:6800/42442 conn(0x7f429804d620 legacy=0x7f429804fae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-25T17:21:10.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.635+0000 7f42d0ed1640 1 -- 10.20.193.76:0/3318109778 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f42cc06dfd0 msgr2=0x7f42cc1c5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.635+0000 7f42d0ed1640 1 --2- 10.20.193.76:0/3318109778 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f42cc06dfd0 0x7f42cc1c5430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f42c000ec10 tx=0x7f42c000c520 comp rx=0 tx=0).stop 2026-02-25T17:21:10.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.635+0000 7f42cad76640 1 -- 10.20.193.76:0/3318109778 reap_dead start 2026-02-25T17:21:10.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.635+0000 7f42d0ed1640 1 -- 10.20.193.76:0/3318109778 shutdown_connections 2026-02-25T17:21:10.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.635+0000 7f42d0ed1640 1 -- 10.20.193.76:0/3318109778 >> 10.20.193.76:0/3318109778 conn(0x7f42cc09a960 msgr2=0x7f42cc06bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.635+0000 7f42d0ed1640 1 -- 10.20.193.76:0/3318109778 shutdown_connections 2026-02-25T17:21:10.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.635+0000 7f42d0ed1640 1 -- 10.20.193.76:0/3318109778 wait complete. 2026-02-25T17:21:10.683 INFO:teuthology.orchestra.run.trial076.stdout:38654705756 2026-02-25T17:21:10.683 INFO:teuthology.orchestra.run.trial076.stdout:38654705755 2026-02-25T17:21:10.684 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-25T17:21:10.684 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-25T17:21:10.684 INFO:teuthology.orchestra.run.trial076.stdout:38654705755 2026-02-25T17:21:10.685 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-25T17:21:10.685 INFO:teuthology.orchestra.run.trial076.stdout:38654705755 2026-02-25T17:21:10.685 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-25T17:21:10.686 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.650+0000 7f1ad73da140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-25T17:21:10.686 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.671+0000 7f1ad73da140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-25T17:21:10.694 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.692+0000 7f1ad73da140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-25T17:21:10.740 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.738+0000 7f1ad73da140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-25T17:21:10.762 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.760+0000 7f1ad73da140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-25T17:21:10.763 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f4bb5d27640 1 Processor -- start 2026-02-25T17:21:10.763 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f4bb5d27640 1 -- start start 2026-02-25T17:21:10.764 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f5f0abdc640 1 Processor -- start 2026-02-25T17:21:10.764 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f5f0abdc640 1 -- start start 2026-02-25T17:21:10.764 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7fa75d5dc640 1 Processor -- start 2026-02-25T17:21:10.764 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f4bb5d27640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f4bb0098000 0x7f4bb006b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.765 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7fc4dbb92640 1 Processor -- start 2026-02-25T17:21:10.765 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f4bb5d27640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f4bb006db80 0x7f4bb006bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.765 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f4bb5d27640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bb006d560 con 0x7f4bb006c2d0 2026-02-25T17:21:10.765 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f4bb5d27640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bb006d740 con 0x7f4bb0098000 2026-02-25T17:21:10.765 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f4bb5d27640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb006e490 con 0x7f4bb006db80 2026-02-25T17:21:10.766 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f5f0abdc640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f5f0412e530 0x7f5f0412e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.766 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7fa75d5dc640 1 -- start start 2026-02-25T17:21:10.766 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7fc4dbb92640 1 -- start start 2026-02-25T17:21:10.767 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f5f0abdc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5f0409d390 0x7f5f0412ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.767 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f5f0abdc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5f04097460 0x7f5f040978d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.767 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f5f0abdc640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0406d420 con 0x7f5f0412e530 2026-02-25T17:21:10.767 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f5f0abdc640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0412f390 con 0x7f5f0409d390 2026-02-25T17:21:10.767 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f5f0abdc640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0409b050 con 0x7f5f04097460 2026-02-25T17:21:10.768 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f4baf7fe640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f4bb0098000 0x7f4bb006b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.768 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f4baffff640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f4bb006c2d0 0x7f4bb0134d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:46914/0 (socket says 10.20.193.76:46914) 2026-02-25T17:21:10.768 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f4baffff640 1 -- 10.20.193.76:0/321876400 learned_addr learned my addr 10.20.193.76:0/321876400 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:10.768 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f5efbfff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5f0409d390 0x7f5f0412ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.769 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f4baeffd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f4bb006db80 0x7f4bb006bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.769 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f5efbfff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5f0409d390 0x7f5f0412ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:41794/0 (socket says 10.20.193.76:41794) 2026-02-25T17:21:10.770 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f5efbfff640 1 -- 10.20.193.76:0/544994483 learned_addr learned my addr 10.20.193.76:0/544994483 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:10.770 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f5f08951640 1 --2- 10.20.193.76:0/544994483 >> v2:10.20.193.76:3300/0 conn(0x7f5f0412e530 0x7f5f0412e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.770 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.761+0000 7f5f09152640 1 --2- 10.20.193.76:0/544994483 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5f04097460 0x7f5f040978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.770 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fc4dbb92640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc4d406dfd0 0x7fc4d406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.770 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fc4dbb92640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc4d406e8f0 0x7fc4d40980d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.771 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f5efbfff640 1 -- 10.20.193.76:0/544994483 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5f04097460 msgr2=0x7f5f040978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:10.771 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f5efbfff640 1 --2- 10.20.193.76:0/544994483 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5f04097460 0x7f5f040978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.771 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f5efbfff640 1 -- 10.20.193.76:0/544994483 >> v2:10.20.193.76:3300/0 conn(0x7f5f0412e530 msgr2=0x7f5f0412e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:10.771 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f4baf7fe640 1 -- 10.20.193.76:0/321876400 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f4bb006db80 msgr2=0x7f4bb006bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:10.771 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f4baf7fe640 1 --2- 10.20.193.76:0/321876400 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f4bb006db80 0x7f4bb006bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.771 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f4baf7fe640 1 -- 10.20.193.76:0/321876400 >> v1:10.20.193.76:6789/0 conn(0x7f4bb006c2d0 legacy=0x7f4bb0134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.772 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f5efbfff640 1 --2- 10.20.193.76:0/544994483 >> v2:10.20.193.76:3300/0 conn(0x7f5f0412e530 0x7f5f0412e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.772 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f5efbfff640 1 -- 10.20.193.76:0/544994483 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0406da80 con 0x7f5f0409d390 2026-02-25T17:21:10.772 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f5f08951640 1 --2- 10.20.193.76:0/544994483 >> v2:10.20.193.76:3300/0 conn(0x7f5f0412e530 0x7f5f0412e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-25T17:21:10.772 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fa75d5dc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa75806dfd0 0x7fa75806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.772 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f4baf7fe640 1 -- 10.20.193.76:0/321876400 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb009e900 con 0x7f4bb0098000 2026-02-25T17:21:10.773 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fc4dbb92640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d409d9a0 con 0x7fc4d4098610 2026-02-25T17:21:10.773 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fc4dbb92640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d4099190 con 0x7fc4d406dfd0 2026-02-25T17:21:10.773 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fc4dbb92640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d408c910 con 0x7fc4d406e8f0 2026-02-25T17:21:10.774 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fa75d5dc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fa7580987e0 0x7fa758134710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.774 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fa75d5dc640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75809d9a0 con 0x7fa75806e8f0 2026-02-25T17:21:10.774 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fa75d5dc640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa758099190 con 0x7fa7580987e0 2026-02-25T17:21:10.774 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fa75d5dc640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa75808c910 con 0x7fa75806dfd0 2026-02-25T17:21:10.774 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fc4da108640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7fc4d4098610 0x7fc4d4133700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:46918/0 (socket says 10.20.193.76:46918) 2026-02-25T17:21:10.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fc4d9907640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc4d406dfd0 0x7fc4d406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fc4da108640 1 -- 10.20.193.76:0/660366581 learned_addr learned my addr 10.20.193.76:0/660366581 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:10.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fc4d9106640 1 --2- 10.20.193.76:0/660366581 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc4d406e8f0 0x7fc4d40980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fa7567fc640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7fa75806e8f0 0x7fa7580980d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:46934/0 (socket says 10.20.193.76:46934) 2026-02-25T17:21:10.775 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fa7567fc640 1 -- 10.20.193.76:0/344491219 learned_addr learned my addr 10.20.193.76:0/344491219 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:10.776 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fa7577fe640 1 --2- 10.20.193.76:0/344491219 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fa7580987e0 0x7fa758134710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.776 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fa756ffd640 1 --2- 10.20.193.76:0/344491219 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa75806dfd0 0x7fa75806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.776 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fa755ffb640 1 -- 10.20.193.76:0/344491219 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294834722 0 0) 0x7fa75809d9a0 con 0x7fa75806e8f0 2026-02-25T17:21:10.776 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fc4d8905640 1 -- 10.20.193.76:0/660366581 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162789202 0 0) 0x7fc4d409d9a0 con 0x7fc4d4098610 2026-02-25T17:21:10.776 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fc4d9907640 1 -- 10.20.193.76:0/660366581 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc4d406e8f0 msgr2=0x7fc4d40980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:10.776 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fc4d9907640 1 --2- 10.20.193.76:0/660366581 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc4d406e8f0 0x7fc4d40980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.776 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fc4d9907640 1 -- 10.20.193.76:0/660366581 >> v1:10.20.193.76:6789/0 conn(0x7fc4d4098610 legacy=0x7fc4d4133700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.777 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fa755ffb640 1 -- 10.20.193.76:0/344491219 --> v1:10.20.193.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa744003620 con 0x7fa75806e8f0 2026-02-25T17:21:10.777 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fc4d9907640 1 -- 10.20.193.76:0/660366581 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d4072260 con 0x7fc4d406dfd0 2026-02-25T17:21:10.778 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fa756ffd640 1 -- 10.20.193.76:0/344491219 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fa7580987e0 msgr2=0x7fa758134710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:10.778 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fa756ffd640 1 --2- 10.20.193.76:0/344491219 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fa7580987e0 0x7fa758134710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.778 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fa756ffd640 1 -- 10.20.193.76:0/344491219 >> v1:10.20.193.76:6789/0 conn(0x7fa75806e8f0 legacy=0x7fa7580980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.778 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fa756ffd640 1 -- 10.20.193.76:0/344491219 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa758072260 con 0x7fa75806dfd0 2026-02-25T17:21:10.778 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fa7577fe640 1 --2- 10.20.193.76:0/344491219 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fa7580987e0 0x7fa758134710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:10.778 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f5efbfff640 1 --2- 10.20.193.76:0/544994483 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5f0409d390 0x7f5f0412ee50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009970 tx=0x7f5eec02ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28114df16fe3c8b5 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.779 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f5efb7fe640 1 -- 10.20.193.76:0/544994483 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec02fac0 con 0x7f5f0409d390 2026-02-25T17:21:10.779 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f4baf7fe640 1 --2- 10.20.193.76:0/321876400 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4bb0098000 0x7f4bb006b850 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0098d0 tx=0x7f4b9c02edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385beac8d3b77636 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.779 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f5efb7fe640 1 -- 10.20.193.76:0/544994483 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec02fc20 con 0x7f5f0409d390 2026-02-25T17:21:10.780 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f5efb7fe640 1 -- 10.20.193.76:0/544994483 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec037440 con 0x7f5f0409d390 2026-02-25T17:21:10.780 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f4bae7fc640 1 -- 10.20.193.76:0/321876400 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c02fa40 con 0x7f4bb0098000 2026-02-25T17:21:10.780 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f4bae7fc640 1 -- 10.20.193.76:0/321876400 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c02fba0 con 0x7f4bb0098000 2026-02-25T17:21:10.780 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f4bae7fc640 1 -- 10.20.193.76:0/321876400 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c037440 con 0x7f4bb0098000 2026-02-25T17:21:10.781 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7fc4d9907640 1 --2- 10.20.193.76:0/660366581 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc4d406dfd0 0x7fc4d406e3b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40098d0 tx=0x7fc4c402ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c51f40bcf92cc852 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.781 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f5f0abdc640 1 -- 10.20.193.76:0/544994483 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5f0409d390 msgr2=0x7f5f0412ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.781 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f5f0abdc640 1 --2- 10.20.193.76:0/544994483 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5f0409d390 0x7f5f0412ee50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009970 tx=0x7f5eec02ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:10.781 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f5f0abdc640 1 -- 10.20.193.76:0/544994483 shutdown_connections 2026-02-25T17:21:10.781 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f5f0abdc640 1 --2- 10.20.193.76:0/544994483 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5f04097460 0x7f5f040978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.781 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f5f0abdc640 1 --2- 10.20.193.76:0/544994483 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5f0409d390 0x7f5f0412ee50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f5f0abdc640 1 --2- 10.20.193.76:0/544994483 >> v2:10.20.193.76:3300/0 conn(0x7f5f0412e530 0x7f5f0412e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.762+0000 7f5f0abdc640 1 -- 10.20.193.76:0/544994483 >> 10.20.193.76:0/544994483 conn(0x7f5f0409e130 msgr2=0x7f5f0409ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fa756ffd640 1 --2- 10.20.193.76:0/344491219 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa75806dfd0 0x7fa75806e3b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa74c0098d0 tx=0x7fa74c02ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2beb92a3be22be1c server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.782 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f5f0abdc640 1 -- 10.20.193.76:0/544994483 shutdown_connections 2026-02-25T17:21:10.783 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fc4d8905640 1 -- 10.20.193.76:0/660366581 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c402fab0 con 0x7fc4d406dfd0 2026-02-25T17:21:10.783 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f5f0abdc640 1 -- 10.20.193.76:0/544994483 wait complete. 2026-02-25T17:21:10.783 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f4bb5d27640 1 -- 10.20.193.76:0/321876400 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4bb0098000 msgr2=0x7f4bb006b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.783 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f4bb5d27640 1 --2- 10.20.193.76:0/321876400 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4bb0098000 0x7f4bb006b850 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0098d0 tx=0x7f4b9c02edc0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.784 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fc4d8905640 1 -- 10.20.193.76:0/660366581 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c402fc10 con 0x7fc4d406dfd0 2026-02-25T17:21:10.784 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fc4d8905640 1 -- 10.20.193.76:0/660366581 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4037440 con 0x7fc4d406dfd0 2026-02-25T17:21:10.784 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f4bb5d27640 1 -- 10.20.193.76:0/321876400 shutdown_connections 2026-02-25T17:21:10.785 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f4bb5d27640 1 --2- 10.20.193.76:0/321876400 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f4bb006db80 0x7f4bb006bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.785 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f4bb5d27640 1 --2- 10.20.193.76:0/321876400 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4bb0098000 0x7f4bb006b850 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.785 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f4bb5d27640 1 -- 10.20.193.76:0/321876400 >> 10.20.193.76:0/321876400 conn(0x7f4bb009db70 msgr2=0x7f4bb009df80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.785 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f4bb5d27640 1 -- 10.20.193.76:0/321876400 shutdown_connections 2026-02-25T17:21:10.785 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f4bb5d27640 1 -- 10.20.193.76:0/321876400 wait complete. 2026-02-25T17:21:10.785 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fc4dbb92640 1 -- 10.20.193.76:0/660366581 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc4d406dfd0 msgr2=0x7fc4d406e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.785 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fc4dbb92640 1 --2- 10.20.193.76:0/660366581 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc4d406dfd0 0x7fc4d406e3b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40098d0 tx=0x7fc4c402ee80 comp rx=0 tx=0).stop 2026-02-25T17:21:10.786 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f5f0abdc640 1 Processor -- start 2026-02-25T17:21:10.786 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fc4dbb92640 1 -- 10.20.193.76:0/660366581 shutdown_connections 2026-02-25T17:21:10.786 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fc4dbb92640 1 --2- 10.20.193.76:0/660366581 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc4d406e8f0 0x7fc4d40980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.786 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fc4dbb92640 1 --2- 10.20.193.76:0/660366581 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc4d406dfd0 0x7fc4d406e3b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.786 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fc4dbb92640 1 -- 10.20.193.76:0/660366581 >> 10.20.193.76:0/660366581 conn(0x7fc4d409a960 msgr2=0x7fc4d409ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.787 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f5f0abdc640 1 -- start start 2026-02-25T17:21:10.787 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fc4dbb92640 1 -- 10.20.193.76:0/660366581 shutdown_connections 2026-02-25T17:21:10.787 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fc4dbb92640 1 -- 10.20.193.76:0/660366581 wait complete. 2026-02-25T17:21:10.788 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fa755ffb640 1 -- 10.20.193.76:0/344491219 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c02fab0 con 0x7fa75806dfd0 2026-02-25T17:21:10.788 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fa755ffb640 1 -- 10.20.193.76:0/344491219 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c02fc10 con 0x7fa75806dfd0 2026-02-25T17:21:10.788 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fa755ffb640 1 -- 10.20.193.76:0/344491219 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c037440 con 0x7fa75806dfd0 2026-02-25T17:21:10.789 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f5f0abdc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5f04097460 0x7f5f0412bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.789 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f5f0abdc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5f0409d390 0x7f5f041260c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.789 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f5f0abdc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5f0412e530 0x7f5f04126600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.789 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f5f0abdc640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f04127a50 con 0x7f5f04097460 2026-02-25T17:21:10.789 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f5f0abdc640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f04128650 con 0x7f5f0412e530 2026-02-25T17:21:10.789 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f5f0abdc640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0409b2e0 con 0x7f5f0409d390 2026-02-25T17:21:10.789 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f5f08951640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5f04097460 0x7f5f0412bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.789 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f5efbfff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5f0409d390 0x7f5f041260c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.790 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fa75d5dc640 1 -- 10.20.193.76:0/344491219 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa75806dfd0 msgr2=0x7fa75806e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.790 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fa75d5dc640 1 --2- 10.20.193.76:0/344491219 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa75806dfd0 0x7fa75806e3b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa74c0098d0 tx=0x7fa74c02ee80 comp rx=0 tx=0).stop 2026-02-25T17:21:10.790 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f5f09152640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5f0412e530 0x7f5f04126600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.790 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f4bb5d27640 1 Processor -- start 2026-02-25T17:21:10.791 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f5f08951640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5f04097460 0x7f5f0412bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:39222/0 (socket says 10.20.193.76:39222) 2026-02-25T17:21:10.791 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f5efbfff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5f0409d390 0x7f5f041260c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:48454/0 (socket says 10.20.193.76:48454) 2026-02-25T17:21:10.791 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7f5f08951640 1 -- 10.20.193.76:0/212303190 learned_addr learned my addr 10.20.193.76:0/212303190 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:10.791 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fa75d5dc640 1 -- 10.20.193.76:0/344491219 shutdown_connections 2026-02-25T17:21:10.791 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fa75d5dc640 1 --2- 10.20.193.76:0/344491219 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fa7580987e0 0x7fa758134710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.792 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fa75d5dc640 1 --2- 10.20.193.76:0/344491219 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa75806dfd0 0x7fa75806e3b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.792 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.763+0000 7fa75d5dc640 1 -- 10.20.193.76:0/344491219 >> 10.20.193.76:0/344491219 conn(0x7fa75809a960 msgr2=0x7fa75809ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.792 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fa75d5dc640 1 -- 10.20.193.76:0/344491219 shutdown_connections 2026-02-25T17:21:10.792 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fa75d5dc640 1 -- 10.20.193.76:0/344491219 wait complete. 2026-02-25T17:21:10.792 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4bb5d27640 1 -- start start 2026-02-25T17:21:10.793 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f5f08951640 1 -- 10.20.193.76:0/212303190 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5f0409d390 msgr2=0x7f5f041260c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.793 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f5f08951640 1 --2- 10.20.193.76:0/212303190 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5f0409d390 0x7f5f041260c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.793 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f5f08951640 1 -- 10.20.193.76:0/212303190 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5f0412e530 msgr2=0x7f5f04126600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.793 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f5f08951640 1 --2- 10.20.193.76:0/212303190 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5f0412e530 0x7f5f04126600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.793 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f5f08951640 1 -- 10.20.193.76:0/212303190 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec0095d0 con 0x7f5f04097460 2026-02-25T17:21:10.793 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f5f09152640 1 --2- 10.20.193.76:0/212303190 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5f0412e530 0x7f5f04126600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:10.793 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f5f08951640 1 --2- 10.20.193.76:0/212303190 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5f04097460 0x7f5f0412bbc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400d8a0 tx=0x7f5ef400dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.793 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fc4dbb92640 1 Processor -- start 2026-02-25T17:21:10.794 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4bb5d27640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f4bb006c2d0 0x7f4bb0123a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.794 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4bb5d27640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4bb006db80 0x7f4bb0123f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.794 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4bb5d27640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f4bb0098000 0x7f4bb01244a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.794 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4bb5d27640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb0125e60 con 0x7f4bb006db80 2026-02-25T17:21:10.794 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4bb5d27640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb01362c0 con 0x7f4bb0098000 2026-02-25T17:21:10.794 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4bb5d27640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb0071f70 con 0x7f4bb006c2d0 2026-02-25T17:21:10.795 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fc4dbb92640 1 -- start start 2026-02-25T17:21:10.795 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f5ef97fa640 1 -- 10.20.193.76:0/212303190 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4004030 con 0x7f5f04097460 2026-02-25T17:21:10.795 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4baf7fe640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f4bb006c2d0 0x7f4bb0123a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.795 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4baf7fe640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f4bb006c2d0 0x7f4bb0123a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:48462/0 (socket says 10.20.193.76:48462) 2026-02-25T17:21:10.795 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4baf7fe640 1 -- 10.20.193.76:0/2337540193 learned_addr learned my addr 10.20.193.76:0/2337540193 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:10.796 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f5ef97fa640 1 -- 10.20.193.76:0/212303190 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef4004190 con 0x7f5f04097460 2026-02-25T17:21:10.796 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4baeffd640 1 --2- 10.20.193.76:0/2337540193 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4bb006db80 0x7f4bb0123f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.796 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4baffff640 1 --2- 10.20.193.76:0/2337540193 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f4bb0098000 0x7f4bb01244a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.796 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f5f0abdc640 1 -- 10.20.193.76:0/212303190 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f04134400 con 0x7f5f04097460 2026-02-25T17:21:10.796 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f5ef97fa640 1 -- 10.20.193.76:0/212303190 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4004540 con 0x7f5f04097460 2026-02-25T17:21:10.797 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f5f0abdc640 1 -- 10.20.193.76:0/212303190 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f04126b40 con 0x7f5f04097460 2026-02-25T17:21:10.797 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4baf7fe640 1 -- 10.20.193.76:0/2337540193 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f4bb0098000 msgr2=0x7f4bb01244a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.797 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4baf7fe640 1 --2- 10.20.193.76:0/2337540193 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f4bb0098000 0x7f4bb01244a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.797 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4baf7fe640 1 -- 10.20.193.76:0/2337540193 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4bb006db80 msgr2=0x7f4bb0123f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.797 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4baf7fe640 1 --2- 10.20.193.76:0/2337540193 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4bb006db80 0x7f4bb0123f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.797 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4baf7fe640 1 -- 10.20.193.76:0/2337540193 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c009500 con 0x7f4bb006c2d0 2026-02-25T17:21:10.797 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fa75d5dc640 1 Processor -- start 2026-02-25T17:21:10.798 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4baf7fe640 1 --2- 10.20.193.76:0/2337540193 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f4bb006c2d0 0x7f4bb0123a20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009130 tx=0x7f4b9c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.798 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fa75d5dc640 1 -- start start 2026-02-25T17:21:10.799 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fc4dbb92640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc4d406dfd0 0x7fc4d41c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.799 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fc4dbb92640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc4d406e8f0 0x7fc4d41c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.799 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fc4dbb92640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc4d4098610 0x7fc4d408ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.799 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fc4dbb92640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d4090d80 con 0x7fc4d406dfd0 2026-02-25T17:21:10.799 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fc4dbb92640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d4090fc0 con 0x7fc4d4098610 2026-02-25T17:21:10.799 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fc4dbb92640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d4091a30 con 0x7fc4d406e8f0 2026-02-25T17:21:10.799 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fc4d9106640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc4d406e8f0 0x7fc4d41c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.799 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4b8bfff640 1 -- 10.20.193.76:0/2337540193 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c042650 con 0x7f4bb006c2d0 2026-02-25T17:21:10.800 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fc4da108640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc4d4098610 0x7fc4d408ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.800 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fc4d9106640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc4d406e8f0 0x7fc4d41c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:48478/0 (socket says 10.20.193.76:48478) 2026-02-25T17:21:10.800 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fc4d9106640 1 -- 10.20.193.76:0/3060831853 learned_addr learned my addr 10.20.193.76:0/3060831853 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:10.800 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4b8bfff640 1 -- 10.20.193.76:0/2337540193 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c0427d0 con 0x7f4bb006c2d0 2026-02-25T17:21:10.800 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4bb5d27640 1 -- 10.20.193.76:0/2337540193 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb0127250 con 0x7f4bb006c2d0 2026-02-25T17:21:10.800 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4b8bfff640 1 -- 10.20.193.76:0/2337540193 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c042b80 con 0x7f4bb006c2d0 2026-02-25T17:21:10.801 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7f4bb5d27640 1 -- 10.20.193.76:0/2337540193 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb01249e0 con 0x7f4bb006c2d0 2026-02-25T17:21:10.801 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fc4d9106640 1 -- 10.20.193.76:0/3060831853 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc4d4098610 msgr2=0x7fc4d408ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.801 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fc4d9106640 1 --2- 10.20.193.76:0/3060831853 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc4d4098610 0x7fc4d408ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.801 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fc4d9106640 1 -- 10.20.193.76:0/3060831853 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc4d406dfd0 msgr2=0x7fc4d41c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.801 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fc4d9106640 1 --2- 10.20.193.76:0/3060831853 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc4d406dfd0 0x7fc4d41c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.801 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fc4d9106640 1 -- 10.20.193.76:0/3060831853 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c4009500 con 0x7fc4d406e8f0 2026-02-25T17:21:10.801 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fa75d5dc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fa75806dfd0 0x7fa758124750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.801 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.764+0000 7fa75d5dc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa75806e8f0 0x7fa758124c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fc4d9106640 1 --2- 10.20.193.76:0/3060831853 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc4d406e8f0 0x7fc4d41c5be0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800ebe0 tx=0x7fc4c800c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fa75d5dc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fa7580987e0 0x7fa7581251d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:10.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fa75d5dc640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa758095d70 con 0x7fa75806dfd0 2026-02-25T17:21:10.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fa75d5dc640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75808d650 con 0x7fa7580987e0 2026-02-25T17:21:10.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fa75d5dc640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa758126770 con 0x7fa75806e8f0 2026-02-25T17:21:10.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fa756ffd640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fa75806dfd0 0x7fa758124750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fa7567fc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa75806e8f0 0x7fa758124c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fa7577fe640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fa7580987e0 0x7fa7581251d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:10.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fa756ffd640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fa75806dfd0 0x7fa758124750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:39252/0 (socket says 10.20.193.76:39252) 2026-02-25T17:21:10.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fa756ffd640 1 -- 10.20.193.76:0/2178931632 learned_addr learned my addr 10.20.193.76:0/2178931632 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:10.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7f5f0abdc640 1 -- 10.20.193.76:0/212303190 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f040978d0 con 0x7f5f04097460 2026-02-25T17:21:10.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fc4c27fc640 1 -- 10.20.193.76:0/3060831853 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8009770 con 0x7fc4d406e8f0 2026-02-25T17:21:10.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fc4c27fc640 1 -- 10.20.193.76:0/3060831853 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c800cc40 con 0x7fc4d406e8f0 2026-02-25T17:21:10.804 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fc4c27fc640 1 -- 10.20.193.76:0/3060831853 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c8013470 con 0x7fc4d406e8f0 2026-02-25T17:21:10.804 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fc4dbb92640 1 -- 10.20.193.76:0/3060831853 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d40922f0 con 0x7fc4d406e8f0 2026-02-25T17:21:10.804 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fc4dbb92640 1 -- 10.20.193.76:0/3060831853 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d41c6120 con 0x7fc4d406e8f0 2026-02-25T17:21:10.804 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fa756ffd640 1 -- 10.20.193.76:0/2178931632 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa75806e8f0 msgr2=0x7fa758124c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.804 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fa756ffd640 1 --2- 10.20.193.76:0/2178931632 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa75806e8f0 0x7fa758124c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.804 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fa756ffd640 1 -- 10.20.193.76:0/2178931632 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fa7580987e0 msgr2=0x7fa7581251d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.804 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fa756ffd640 1 --2- 10.20.193.76:0/2178931632 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fa7580987e0 0x7fa7581251d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.804 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fa756ffd640 1 -- 10.20.193.76:0/2178931632 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa748009a70 con 0x7fa75806dfd0 2026-02-25T17:21:10.804 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fa756ffd640 1 --2- 10.20.193.76:0/2178931632 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fa75806dfd0 0x7fa758124750 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009130 tx=0x7fa74c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:10.804 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7f5ef97fa640 1 -- 10.20.193.76:0/212303190 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 6) v1 ==== 59352+0+0 (secure 0 0 0) 0x7f5ef401b070 con 0x7f5f04097460 2026-02-25T17:21:10.805 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fa7377fe640 1 -- 10.20.193.76:0/2178931632 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c046070 con 0x7fa75806dfd0 2026-02-25T17:21:10.805 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fa7377fe640 1 -- 10.20.193.76:0/2178931632 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c042470 con 0x7fa75806dfd0 2026-02-25T17:21:10.805 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fa7377fe640 1 -- 10.20.193.76:0/2178931632 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c042800 con 0x7fa75806dfd0 2026-02-25T17:21:10.805 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7f4bb5d27640 1 -- 10.20.193.76:0/2337540193 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb00707b0 con 0x7f4bb006c2d0 2026-02-25T17:21:10.805 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7f4b8bfff640 1 -- 10.20.193.76:0/2337540193 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 6) v1 ==== 59352+0+0 (secure 0 0 0) 0x7f4b9c052020 con 0x7f4bb006c2d0 2026-02-25T17:21:10.805 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7f5efbfff640 1 -- 10.20.193.76:0/212303190 >> v1:10.20.193.76:6800/42442 conn(0x7f5ed404d620 legacy=0x7f5ed404fae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.76:6800/42442 2026-02-25T17:21:10.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7f5ef97fa640 1 -- 10.20.193.76:0/212303190 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2806+0+0 (secure 0 0 0) 0x7f5ef4063e40 con 0x7f5f04097460 2026-02-25T17:21:10.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fc4dbb92640 1 -- 10.20.193.76:0/3060831853 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d4098ed0 con 0x7fc4d406e8f0 2026-02-25T17:21:10.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7f4baeffd640 1 -- 10.20.193.76:0/2337540193 >> v1:10.20.193.76:6800/42442 conn(0x7f4b8004d620 legacy=0x7f4b8004fae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.76:6800/42442 2026-02-25T17:21:10.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7f4b8bfff640 1 -- 10.20.193.76:0/2337540193 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2806+0+0 (secure 0 0 0) 0x7f4b9c089410 con 0x7f4bb006c2d0 2026-02-25T17:21:10.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.765+0000 7fc4c27fc640 1 -- 10.20.193.76:0/3060831853 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 6) v1 ==== 59352+0+0 (secure 0 0 0) 0x7fc4c8011070 con 0x7fc4d406e8f0 2026-02-25T17:21:10.807 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.766+0000 7fa75d5dc640 1 -- 10.20.193.76:0/2178931632 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74c009500 con 0x7fa75806dfd0 2026-02-25T17:21:10.807 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.766+0000 7fa75d5dc640 1 -- 10.20.193.76:0/2178931632 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa758125710 con 0x7fa75806dfd0 2026-02-25T17:21:10.807 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.766+0000 7fc4c27fc640 1 -- 10.20.193.76:0/3060831853 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2806+0+0 (secure 0 0 0) 0x7fc4c8063940 con 0x7fc4d406e8f0 2026-02-25T17:21:10.807 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.766+0000 7fc4d9907640 1 -- 10.20.193.76:0/3060831853 >> v1:10.20.193.76:6800/42442 conn(0x7fc4a404d650 legacy=0x7fc4a404fb10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.76:6800/42442 2026-02-25T17:21:10.807 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.766+0000 7fa75d5dc640 1 -- 10.20.193.76:0/2178931632 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75808d330 con 0x7fa75806dfd0 2026-02-25T17:21:10.807 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.767+0000 7f5ef97fa640 1 -- 10.20.193.76:0/212303190 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143111 (secure 0 0 0) 0x7f5ef403ea10 con 0x7f5f04097460 2026-02-25T17:21:10.807 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.767+0000 7f4b8bfff640 1 -- 10.20.193.76:0/2337540193 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143111 (secure 0 0 0) 0x7f4b9c063e20 con 0x7f4bb006c2d0 2026-02-25T17:21:10.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.767+0000 7fa7377fe640 1 -- 10.20.193.76:0/2178931632 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 6) v1 ==== 59352+0+0 (secure 0 0 0) 0x7fa74c040420 con 0x7fa75806dfd0 2026-02-25T17:21:10.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.768+0000 7fa7377fe640 1 -- 10.20.193.76:0/2178931632 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2806+0+0 (secure 0 0 0) 0x7fa74c0895f0 con 0x7fa75806dfd0 2026-02-25T17:21:10.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.768+0000 7fa7567fc640 1 -- 10.20.193.76:0/2178931632 >> v1:10.20.193.76:6800/42442 conn(0x7fa72404d620 legacy=0x7fa72404fae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.76:6800/42442 2026-02-25T17:21:10.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.769+0000 7fa7377fe640 1 -- 10.20.193.76:0/2178931632 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143111 (secure 0 0 0) 0x7fa74c068060 con 0x7fa75806dfd0 2026-02-25T17:21:10.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.769+0000 7fc4c27fc640 1 -- 10.20.193.76:0/3060831853 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143111 (secure 0 0 0) 0x7fc4c803e510 con 0x7fc4d406e8f0 2026-02-25T17:21:10.810 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.808+0000 7f1ad73da140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-25T17:21:10.833 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.831+0000 7f4bb5d27640 1 -- 10.20.193.76:0/2337540193 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4bb006b850 con 0x7f4bb006c2d0 2026-02-25T17:21:10.833 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.831+0000 7f4b8bfff640 1 -- 10.20.193.76:0/2337540193 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4b9c046020 con 0x7f4bb006c2d0 2026-02-25T17:21:10.834 INFO:teuthology.orchestra.run.trial076.stdout:38654705754 2026-02-25T17:21:10.835 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.833+0000 7f4bb5d27640 1 -- 10.20.193.76:0/2337540193 >> v1:10.20.193.76:6800/42442 conn(0x7f4b8004d620 legacy=0x7f4b8004fae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-25T17:21:10.835 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.833+0000 7f4bb5d27640 1 -- 10.20.193.76:0/2337540193 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f4bb006c2d0 msgr2=0x7f4bb0123a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.835 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.833+0000 7f4bb5d27640 1 --2- 10.20.193.76:0/2337540193 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f4bb006c2d0 0x7f4bb0123a20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009130 tx=0x7f4b9c0047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.835 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.833+0000 7f4bb5d27640 1 -- 10.20.193.76:0/2337540193 shutdown_connections 2026-02-25T17:21:10.835 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.833+0000 7f4bb5d27640 1 --2- 10.20.193.76:0/2337540193 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f4bb0098000 0x7f4bb01244a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.836 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.833+0000 7f4bb5d27640 1 --2- 10.20.193.76:0/2337540193 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f4bb006db80 0x7f4bb0123f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.836 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.833+0000 7f4bb5d27640 1 --2- 10.20.193.76:0/2337540193 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f4bb006c2d0 0x7f4bb0123a20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.836 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.833+0000 7f4bb5d27640 1 -- 10.20.193.76:0/2337540193 >> 10.20.193.76:0/2337540193 conn(0x7f4bb009db70 msgr2=0x7f4bb009a010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.836 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.833+0000 7f4bb5d27640 1 -- 10.20.193.76:0/2337540193 shutdown_connections 2026-02-25T17:21:10.836 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.833+0000 7f4bb5d27640 1 -- 10.20.193.76:0/2337540193 wait complete. 2026-02-25T17:21:10.836 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.833+0000 7f5f0abdc640 1 -- 10.20.193.76:0/212303190 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5f040681d0 con 0x7f5f04097460 2026-02-25T17:21:10.836 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.833+0000 7f5ef97fa640 1 -- 10.20.193.76:0/212303190 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ef4042220 con 0x7f5f04097460 2026-02-25T17:21:10.836 INFO:teuthology.orchestra.run.trial076.stdout:38654705755 2026-02-25T17:21:10.837 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.833+0000 7fa75d5dc640 1 -- 10.20.193.76:0/2178931632 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa75804ebc0 con 0x7fa75806dfd0 2026-02-25T17:21:10.837 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.834+0000 7fa7377fe640 1 -- 10.20.193.76:0/2178931632 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa75804ebc0 con 0x7fa75806dfd0 2026-02-25T17:21:10.837 INFO:teuthology.orchestra.run.trial076.stdout:38654705754 2026-02-25T17:21:10.838 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.834+0000 7fc4dbb92640 1 -- 10.20.193.76:0/3060831853 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc4d40922d0 con 0x7fc4d406e8f0 2026-02-25T17:21:10.838 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7fc4c27fc640 1 -- 10.20.193.76:0/3060831853 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc4c8017030 con 0x7fc4d406e8f0 2026-02-25T17:21:10.838 INFO:teuthology.orchestra.run.trial076.stdout:38654705754 2026-02-25T17:21:10.839 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7f5f0abdc640 1 -- 10.20.193.76:0/212303190 >> v1:10.20.193.76:6800/42442 conn(0x7f5ed404d620 legacy=0x7f5ed404fae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-25T17:21:10.839 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7f5f0abdc640 1 -- 10.20.193.76:0/212303190 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5f04097460 msgr2=0x7f5f0412bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.839 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7f5f0abdc640 1 --2- 10.20.193.76:0/212303190 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5f04097460 0x7f5f0412bbc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400d8a0 tx=0x7f5ef400dd70 comp rx=0 tx=0).stop 2026-02-25T17:21:10.839 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7f5f0abdc640 1 -- 10.20.193.76:0/212303190 shutdown_connections 2026-02-25T17:21:10.839 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7f5f0abdc640 1 --2- 10.20.193.76:0/212303190 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5f0412e530 0x7f5f04126600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.839 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7f5f0abdc640 1 --2- 10.20.193.76:0/212303190 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5f0409d390 0x7f5f041260c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.839 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7f5f0abdc640 1 --2- 10.20.193.76:0/212303190 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5f04097460 0x7f5f0412bbc0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.839 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7f5f0abdc640 1 -- 10.20.193.76:0/212303190 >> 10.20.193.76:0/212303190 conn(0x7f5f0409e130 msgr2=0x7f5f04134f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.839 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7f5f0abdc640 1 -- 10.20.193.76:0/212303190 shutdown_connections 2026-02-25T17:21:10.839 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7f5f0abdc640 1 -- 10.20.193.76:0/212303190 wait complete. 2026-02-25T17:21:10.840 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7fa75d5dc640 1 -- 10.20.193.76:0/2178931632 >> v1:10.20.193.76:6800/42442 conn(0x7fa72404d620 legacy=0x7fa72404fae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-25T17:21:10.840 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7fa75d5dc640 1 -- 10.20.193.76:0/2178931632 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fa75806dfd0 msgr2=0x7fa758124750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.840 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7fa75d5dc640 1 --2- 10.20.193.76:0/2178931632 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fa75806dfd0 0x7fa758124750 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009130 tx=0x7fa74c0047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.840 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7fa75d5dc640 1 -- 10.20.193.76:0/2178931632 shutdown_connections 2026-02-25T17:21:10.840 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7fa75d5dc640 1 --2- 10.20.193.76:0/2178931632 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fa7580987e0 0x7fa7581251d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.840 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7fa75d5dc640 1 --2- 10.20.193.76:0/2178931632 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa75806e8f0 0x7fa758124c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.841 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7fa75d5dc640 1 --2- 10.20.193.76:0/2178931632 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fa75806dfd0 0x7fa758124750 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.841 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7fa75d5dc640 1 -- 10.20.193.76:0/2178931632 >> 10.20.193.76:0/2178931632 conn(0x7fa75809a960 msgr2=0x7fa75806bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.841 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7fa75d5dc640 1 -- 10.20.193.76:0/2178931632 shutdown_connections 2026-02-25T17:21:10.841 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.835+0000 7fa75d5dc640 1 -- 10.20.193.76:0/2178931632 wait complete. 2026-02-25T17:21:10.841 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.836+0000 7fc4dbb92640 1 -- 10.20.193.76:0/3060831853 >> v1:10.20.193.76:6800/42442 conn(0x7fc4a404d650 legacy=0x7fc4a404fb10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-25T17:21:10.842 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.836+0000 7fc4dbb92640 1 -- 10.20.193.76:0/3060831853 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc4d406e8f0 msgr2=0x7fc4d41c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:10.842 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.836+0000 7fc4dbb92640 1 --2- 10.20.193.76:0/3060831853 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc4d406e8f0 0x7fc4d41c5be0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800ebe0 tx=0x7fc4c800c520 comp rx=0 tx=0).stop 2026-02-25T17:21:10.842 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.836+0000 7fc4dbb92640 1 -- 10.20.193.76:0/3060831853 shutdown_connections 2026-02-25T17:21:10.842 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.836+0000 7fc4dbb92640 1 --2- 10.20.193.76:0/3060831853 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc4d4098610 0x7fc4d408ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.842 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.836+0000 7fc4dbb92640 1 --2- 10.20.193.76:0/3060831853 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc4d406e8f0 0x7fc4d41c5be0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.842 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.836+0000 7fc4dbb92640 1 --2- 10.20.193.76:0/3060831853 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc4d406dfd0 0x7fc4d41c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:10.842 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.836+0000 7fc4dbb92640 1 -- 10.20.193.76:0/3060831853 >> 10.20.193.76:0/3060831853 conn(0x7fc4d409a960 msgr2=0x7fc4d4129fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:10.842 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.836+0000 7fc4dbb92640 1 -- 10.20.193.76:0/3060831853 shutdown_connections 2026-02-25T17:21:10.842 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:10.836+0000 7fc4dbb92640 1 -- 10.20.193.76:0/3060831853 wait complete. 2026-02-25T17:21:10.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705755 got 38654705754 for osd.3 2026-02-25T17:21:10.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705756 got 38654705755 for osd.0 2026-02-25T17:21:10.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705755 got 38654705754 for osd.2 2026-02-25T17:21:10.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705755 got 38654705754 for osd.1 2026-02-25T17:21:10.862 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.860+0000 7f1ad73da140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-25T17:21:10.883 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:10.881+0000 7f1ad73da140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-25T17:21:11.040 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:11.038+0000 7f1ad73da140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-25T17:21:11.845 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-25T17:21:11.846 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-25T17:21:11.846 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-25T17:21:11.848 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-25T17:21:11.917 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.914+0000 7ff2ca9aa640 1 Processor -- start 2026-02-25T17:21:11.918 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.914+0000 7ff2ca9aa640 1 -- start start 2026-02-25T17:21:11.918 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7ff2ca9aa640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff2c412bb70 0x7ff2c41305b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:11.918 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7ff2ca9aa640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7ff2c4130af0 0x7ff2c4132ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:11.918 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7ff2ca9aa640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c40719c0 con 0x7ff2c412b080 2026-02-25T17:21:11.918 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7ff2ca9aa640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c406e580 con 0x7ff2c4130af0 2026-02-25T17:21:11.918 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7ff2ca9aa640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c406e2a0 con 0x7ff2c412bb70 2026-02-25T17:21:11.918 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7ff2c37fe640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff2c412bb70 0x7ff2c41305b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:11.918 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7ff2c8f20640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7ff2c4130af0 0x7ff2c4132ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:11.918 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7ff2c37fe640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff2c412bb70 0x7ff2c41305b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:48572/0 (socket says 10.20.193.76:48572) 2026-02-25T17:21:11.919 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7ff2c37fe640 1 -- 10.20.193.76:0/4025673192 learned_addr learned my addr 10.20.193.76:0/4025673192 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:11.919 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7ff2c3fff640 1 --1- 10.20.193.76:0/4025673192 >> v1:10.20.193.76:6789/0 conn(0x7ff2c412b080 0x7ff2c412b460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:46948/0 (socket says 10.20.193.76:46948) 2026-02-25T17:21:11.919 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7f055f086640 1 Processor -- start 2026-02-25T17:21:11.919 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7f055f086640 1 -- start start 2026-02-25T17:21:11.920 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7ff2c2ffd640 1 -- 10.20.193.76:0/4025673192 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495137203 0 0) 0x7ff2c40719c0 con 0x7ff2c412b080 2026-02-25T17:21:11.920 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7ff2c2ffd640 1 -- 10.20.193.76:0/4025673192 --> v1:10.20.193.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2a80058b0 con 0x7ff2c412b080 2026-02-25T17:21:11.920 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7ff2c37fe640 1 -- 10.20.193.76:0/4025673192 >> v2:10.20.193.76:3300/0 conn(0x7ff2c4130af0 msgr2=0x7ff2c4132ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:11.921 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7ff2c37fe640 1 --2- 10.20.193.76:0/4025673192 >> v2:10.20.193.76:3300/0 conn(0x7ff2c4130af0 0x7ff2c4132ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.921 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7ff2c37fe640 1 -- 10.20.193.76:0/4025673192 >> v1:10.20.193.76:6789/0 conn(0x7ff2c412b080 legacy=0x7ff2c412b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:11.921 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7ff2c37fe640 1 -- 10.20.193.76:0/4025673192 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c409d9a0 con 0x7ff2c412bb70 2026-02-25T17:21:11.921 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7ff2c8f20640 1 --2- 10.20.193.76:0/4025673192 >> v2:10.20.193.76:3300/0 conn(0x7ff2c4130af0 0x7ff2c4132ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:11.922 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7f055f086640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f0558131600 0x7f05581339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:11.922 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7f055f086640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0558133f30 0x7f0558136320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:11.922 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7f055f086640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055809e5b0 con 0x7f055812b260 2026-02-25T17:21:11.922 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7f055f086640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055809e400 con 0x7f0558131600 2026-02-25T17:21:11.922 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7f055f086640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f055809e100 con 0x7f0558133f30 2026-02-25T17:21:11.923 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7f055cdfb640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f055812b260 0x7f055812b640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:46956/0 (socket says 10.20.193.76:46956) 2026-02-25T17:21:11.923 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7f055cdfb640 1 -- 10.20.193.76:0/48949652 learned_addr learned my addr 10.20.193.76:0/48949652 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:11.923 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7f055d5fc640 1 --2- 10.20.193.76:0/48949652 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0558133f30 0x7f0558136320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:11.923 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7f054ffff640 1 --2- 10.20.193.76:0/48949652 >> v2:10.20.193.76:3300/0 conn(0x7f0558131600 0x7f05581339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:11.923 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7f054f7fe640 1 -- 10.20.193.76:0/48949652 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735065618 0 0) 0x7f055809e5b0 con 0x7f055812b260 2026-02-25T17:21:11.923 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7f054f7fe640 1 -- 10.20.193.76:0/48949652 --> v1:10.20.193.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0544003620 con 0x7f055812b260 2026-02-25T17:21:11.923 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7f054ffff640 1 -- 10.20.193.76:0/48949652 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0558133f30 msgr2=0x7f0558136320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:11.923 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7f054ffff640 1 --2- 10.20.193.76:0/48949652 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0558133f30 0x7f0558136320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.923 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7f054ffff640 1 -- 10.20.193.76:0/48949652 >> v1:10.20.193.76:6789/0 conn(0x7f055812b260 legacy=0x7f055812b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:11.923 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.915+0000 7f054ffff640 1 -- 10.20.193.76:0/48949652 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055812ae10 con 0x7f0558131600 2026-02-25T17:21:11.924 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f9faeddc640 1 Processor -- start 2026-02-25T17:21:11.924 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7ff2c37fe640 1 --2- 10.20.193.76:0/4025673192 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff2c412bb70 0x7ff2c41305b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009970 tx=0x7ff2b402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74906d5719b4dff5 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:11.924 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f9faeddc640 1 -- start start 2026-02-25T17:21:11.925 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7ff2c2ffd640 1 -- 10.20.193.76:0/4025673192 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b402fb10 con 0x7ff2c412bb70 2026-02-25T17:21:11.925 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7ff2c2ffd640 1 -- 10.20.193.76:0/4025673192 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b402fc70 con 0x7ff2c412bb70 2026-02-25T17:21:11.925 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7ff2c2ffd640 1 -- 10.20.193.76:0/4025673192 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4037440 con 0x7ff2c412bb70 2026-02-25T17:21:11.925 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f9faeddc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9fa806b850 0x7f9fa806bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:11.926 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f9faeddc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9fa806c170 0x7f9fa8097b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:11.926 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f054ffff640 1 --2- 10.20.193.76:0/48949652 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0558131600 0x7f05581339f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f05400098a0 tx=0x7f054002ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e9e0eda5b5e8cc server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:11.926 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f9faeddc640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa8071f40 con 0x7f9fa806fd70 2026-02-25T17:21:11.926 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f9faeddc640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8070470 con 0x7f9fa806b850 2026-02-25T17:21:11.926 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f9faeddc640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa806c5e0 con 0x7f9fa806c170 2026-02-25T17:21:11.927 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f054f7fe640 1 -- 10.20.193.76:0/48949652 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054002fa40 con 0x7f0558131600 2026-02-25T17:21:11.927 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f9fad352640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9fa806c170 0x7f9fa8097b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:11.927 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f9facb51640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9fa806b850 0x7f9fa806bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:11.928 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f9f9ffff640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f9fa806fd70 0x7f9fa8097460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:46960/0 (socket says 10.20.193.76:46960) 2026-02-25T17:21:11.928 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f9f9ffff640 1 -- 10.20.193.76:0/2858728914 learned_addr learned my addr 10.20.193.76:0/2858728914 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:11.928 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f054f7fe640 1 -- 10.20.193.76:0/48949652 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054002fba0 con 0x7f0558131600 2026-02-25T17:21:11.928 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f054f7fe640 1 -- 10.20.193.76:0/48949652 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0540037440 con 0x7f0558131600 2026-02-25T17:21:11.928 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7ff2ca9aa640 1 -- 10.20.193.76:0/4025673192 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff2c412bb70 msgr2=0x7ff2c41305b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:11.929 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7ff2ca9aa640 1 --2- 10.20.193.76:0/4025673192 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff2c412bb70 0x7ff2c41305b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009970 tx=0x7ff2b402ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:11.929 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f9f9f7fe640 1 -- 10.20.193.76:0/2858728914 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520329114 0 0) 0x7f9fa8071f40 con 0x7f9fa806fd70 2026-02-25T17:21:11.929 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7ff2ca9aa640 1 -- 10.20.193.76:0/4025673192 shutdown_connections 2026-02-25T17:21:11.930 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7ff2ca9aa640 1 --2- 10.20.193.76:0/4025673192 >> v2:10.20.193.76:3300/0 conn(0x7ff2c4130af0 0x7ff2c4132ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.930 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7ff2ca9aa640 1 --2- 10.20.193.76:0/4025673192 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff2c412bb70 0x7ff2c41305b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.930 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7ff2ca9aa640 1 -- 10.20.193.76:0/4025673192 >> 10.20.193.76:0/4025673192 conn(0x7ff2c409a960 msgr2=0x7ff2c409ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:11.930 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f9f9f7fe640 1 -- 10.20.193.76:0/2858728914 --> v1:10.20.193.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f94003620 con 0x7f9fa806fd70 2026-02-25T17:21:11.930 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f9fad352640 1 -- 10.20.193.76:0/2858728914 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9fa806b850 msgr2=0x7f9fa806bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:11.930 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f9fad352640 1 --2- 10.20.193.76:0/2858728914 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9fa806b850 0x7f9fa806bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.931 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f9fad352640 1 -- 10.20.193.76:0/2858728914 >> v1:10.20.193.76:6789/0 conn(0x7f9fa806fd70 legacy=0x7f9fa8097460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:11.931 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f9fad352640 1 -- 10.20.193.76:0/2858728914 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa809cd00 con 0x7f9fa806c170 2026-02-25T17:21:11.931 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7ff2ca9aa640 1 -- 10.20.193.76:0/4025673192 shutdown_connections 2026-02-25T17:21:11.931 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f9facb51640 1 --2- 10.20.193.76:0/2858728914 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9fa806b850 0x7f9fa806bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:11.932 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7ff2ca9aa640 1 -- 10.20.193.76:0/4025673192 wait complete. 2026-02-25T17:21:11.932 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f055f086640 1 -- 10.20.193.76:0/48949652 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0558131600 msgr2=0x7f05581339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:11.932 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f055f086640 1 --2- 10.20.193.76:0/48949652 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0558131600 0x7f05581339f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f05400098a0 tx=0x7f054002ed80 comp rx=0 tx=0).stop 2026-02-25T17:21:11.933 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f055f086640 1 -- 10.20.193.76:0/48949652 shutdown_connections 2026-02-25T17:21:11.933 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f055f086640 1 --2- 10.20.193.76:0/48949652 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0558133f30 0x7f0558136320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.933 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f055f086640 1 --2- 10.20.193.76:0/48949652 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0558131600 0x7f05581339f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.933 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f055f086640 1 -- 10.20.193.76:0/48949652 >> 10.20.193.76:0/48949652 conn(0x7f055809f140 msgr2=0x7f055809f550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:11.933 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f055f086640 1 -- 10.20.193.76:0/48949652 shutdown_connections 2026-02-25T17:21:11.933 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f055f086640 1 -- 10.20.193.76:0/48949652 wait complete. 2026-02-25T17:21:11.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.916+0000 7f9fad352640 1 --2- 10.20.193.76:0/2858728914 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9fa806c170 0x7f9fa8097b70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009dc0 tx=0x7f9fa402f180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b5efb8b042d34e8 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:11.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f9f9f7fe640 1 -- 10.20.193.76:0/2858728914 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4006ea0 con 0x7f9fa806c170 2026-02-25T17:21:11.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f9f9f7fe640 1 -- 10.20.193.76:0/2858728914 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa402fdf0 con 0x7f9fa806c170 2026-02-25T17:21:11.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f9f9f7fe640 1 -- 10.20.193.76:0/2858728914 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4037660 con 0x7f9fa806c170 2026-02-25T17:21:11.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2ca9aa640 1 Processor -- start 2026-02-25T17:21:11.934 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2ca9aa640 1 -- start start 2026-02-25T17:21:11.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f055f086640 1 Processor -- start 2026-02-25T17:21:11.935 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f055f086640 1 -- start start 2026-02-25T17:21:11.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f9faeddc640 1 -- 10.20.193.76:0/2858728914 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9fa806c170 msgr2=0x7f9fa8097b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:11.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f9faeddc640 1 --2- 10.20.193.76:0/2858728914 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9fa806c170 0x7f9fa8097b70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009dc0 tx=0x7f9fa402f180 comp rx=0 tx=0).stop 2026-02-25T17:21:11.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f9faeddc640 1 -- 10.20.193.76:0/2858728914 shutdown_connections 2026-02-25T17:21:11.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f9faeddc640 1 --2- 10.20.193.76:0/2858728914 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9fa806c170 0x7f9fa8097b70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f9faeddc640 1 --2- 10.20.193.76:0/2858728914 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9fa806b850 0x7f9fa806bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f9faeddc640 1 -- 10.20.193.76:0/2858728914 >> 10.20.193.76:0/2858728914 conn(0x7f9fa809a8f0 msgr2=0x7f9fa809ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:11.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f9faeddc640 1 -- 10.20.193.76:0/2858728914 shutdown_connections 2026-02-25T17:21:11.936 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f9faeddc640 1 -- 10.20.193.76:0/2858728914 wait complete. 2026-02-25T17:21:11.937 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2ca9aa640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff2c412b080 0x7ff2c4124ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:11.937 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2ca9aa640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff2c412bb70 0x7ff2c4125020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:11.937 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2ca9aa640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff2c4130af0 0x7ff2c4125560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:11.937 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2ca9aa640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c4126690 con 0x7ff2c412b080 2026-02-25T17:21:11.937 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2ca9aa640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c4072180 con 0x7ff2c412bb70 2026-02-25T17:21:11.938 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2ca9aa640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c4127650 con 0x7ff2c4130af0 2026-02-25T17:21:11.938 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f055f086640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f055812b260 0x7f055812dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:11.938 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f055f086640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0558131600 0x7f055812e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:11.938 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f055f086640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0558133f30 0x7f055812e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:11.938 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f055f086640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0558127b40 con 0x7f0558133f30 2026-02-25T17:21:11.939 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f055f086640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0558126cd0 con 0x7f055812b260 2026-02-25T17:21:11.939 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f055f086640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0558128780 con 0x7f0558131600 2026-02-25T17:21:11.939 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2c37fe640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff2c412bb70 0x7ff2c4125020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:11.939 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2c3fff640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff2c412b080 0x7ff2c4124ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:11.939 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2c8f20640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff2c4130af0 0x7ff2c4125560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:11.940 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f055d5fc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0558133f30 0x7f055812e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:11.940 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2c37fe640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff2c412bb70 0x7ff2c4125020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:41978/0 (socket says 10.20.193.76:41978) 2026-02-25T17:21:11.940 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2c37fe640 1 -- 10.20.193.76:0/4206894757 learned_addr learned my addr 10.20.193.76:0/4206894757 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:11.941 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f055d5fc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0558133f30 0x7f055812e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:39364/0 (socket says 10.20.193.76:39364) 2026-02-25T17:21:11.941 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f055cdfb640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f055812b260 0x7f055812dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:11.941 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f055d5fc640 1 -- 10.20.193.76:0/3801790920 learned_addr learned my addr 10.20.193.76:0/3801790920 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:11.941 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f054ffff640 1 --2- 10.20.193.76:0/3801790920 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0558131600 0x7f055812e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:11.941 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f055d5fc640 1 -- 10.20.193.76:0/3801790920 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0558131600 msgr2=0x7f055812e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:11.941 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f055d5fc640 1 --2- 10.20.193.76:0/3801790920 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0558131600 0x7f055812e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.941 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f055d5fc640 1 -- 10.20.193.76:0/3801790920 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f055812b260 msgr2=0x7f055812dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:11.941 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f055d5fc640 1 --2- 10.20.193.76:0/3801790920 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f055812b260 0x7f055812dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.941 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f055d5fc640 1 -- 10.20.193.76:0/3801790920 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0540009500 con 0x7f0558133f30 2026-02-25T17:21:11.942 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2c8f20640 1 -- 10.20.193.76:0/4206894757 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff2c412bb70 msgr2=0x7ff2c4125020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:11.942 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2c8f20640 1 --2- 10.20.193.76:0/4206894757 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff2c412bb70 0x7ff2c4125020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.942 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2c8f20640 1 -- 10.20.193.76:0/4206894757 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff2c412b080 msgr2=0x7ff2c4124ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:11.942 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2c8f20640 1 --2- 10.20.193.76:0/4206894757 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff2c412b080 0x7ff2c4124ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.942 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2c8f20640 1 -- 10.20.193.76:0/4206894757 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b8009a70 con 0x7ff2c4130af0 2026-02-25T17:21:11.943 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2c37fe640 1 --2- 10.20.193.76:0/4206894757 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff2c412bb70 0x7ff2c4125020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:11.943 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f055d5fc640 1 --2- 10.20.193.76:0/3801790920 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0558133f30 0x7f055812e640 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0554009e30 tx=0x7f055400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:11.943 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f054d7fa640 1 -- 10.20.193.76:0/3801790920 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554006ea0 con 0x7f0558133f30 2026-02-25T17:21:11.943 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f054d7fa640 1 -- 10.20.193.76:0/3801790920 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055400f040 con 0x7f0558133f30 2026-02-25T17:21:11.943 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f055f086640 1 -- 10.20.193.76:0/3801790920 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05581264d0 con 0x7f0558133f30 2026-02-25T17:21:11.944 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2c8f20640 1 --2- 10.20.193.76:0/4206894757 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff2c4130af0 0x7ff2c4125560 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800ef90 tx=0x7ff2b800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:11.944 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f054d7fa640 1 -- 10.20.193.76:0/3801790920 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554009ca0 con 0x7f0558133f30 2026-02-25T17:21:11.944 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f055f086640 1 -- 10.20.193.76:0/3801790920 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0558125ba0 con 0x7f0558133f30 2026-02-25T17:21:11.945 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2c0ff9640 1 -- 10.20.193.76:0/4206894757 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8006ea0 con 0x7ff2c4130af0 2026-02-25T17:21:11.945 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2c0ff9640 1 -- 10.20.193.76:0/4206894757 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b800f040 con 0x7ff2c4130af0 2026-02-25T17:21:11.945 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7f9faeddc640 1 Processor -- start 2026-02-25T17:21:11.946 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2ca9aa640 1 -- 10.20.193.76:0/4206894757 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b40095d0 con 0x7ff2c4130af0 2026-02-25T17:21:11.946 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.917+0000 7ff2c0ff9640 1 -- 10.20.193.76:0/4206894757 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8003a90 con 0x7ff2c4130af0 2026-02-25T17:21:11.946 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7ff2ca9aa640 1 -- 10.20.193.76:0/4206894757 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c4098fa0 con 0x7ff2c4130af0 2026-02-25T17:21:11.947 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9faeddc640 1 -- start start 2026-02-25T17:21:11.947 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9faeddc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9fa806b850 0x7f9fa8122d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:11.947 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9faeddc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f9fa806c170 0x7f9fa8123260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:11.947 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9faeddc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9fa806fd70 0x7f9fa81237a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:11.947 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9faeddc640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8125230 con 0x7f9fa806c170 2026-02-25T17:21:11.947 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9faeddc640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8126500 con 0x7f9fa806fd70 2026-02-25T17:21:11.947 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9faeddc640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8124800 con 0x7f9fa806b850 2026-02-25T17:21:11.948 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f055f086640 1 -- 10.20.193.76:0/3801790920 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0558127930 con 0x7f0558133f30 2026-02-25T17:21:11.949 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9fad352640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9fa806fd70 0x7f9fa81237a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:11.949 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9f9ffff640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f9fa806c170 0x7f9fa8123260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:11.949 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9fad352640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9fa806fd70 0x7f9fa81237a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:41998/0 (socket says 10.20.193.76:41998) 2026-02-25T17:21:11.949 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9fad352640 1 -- 10.20.193.76:0/3176667054 learned_addr learned my addr 10.20.193.76:0/3176667054 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:11.949 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9facb51640 1 --2- 10.20.193.76:0/3176667054 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9fa806b850 0x7f9fa8122d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:11.949 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9fad352640 1 -- 10.20.193.76:0/3176667054 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9fa806b850 msgr2=0x7f9fa8122d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:11.949 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9fad352640 1 --2- 10.20.193.76:0/3176667054 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9fa806b850 0x7f9fa8122d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.949 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9fad352640 1 -- 10.20.193.76:0/3176667054 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f9fa806c170 msgr2=0x7f9fa8123260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:11.949 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9fad352640 1 --2- 10.20.193.76:0/3176667054 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f9fa806c170 0x7f9fa8123260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.949 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9fad352640 1 -- 10.20.193.76:0/3176667054 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f98009500 con 0x7f9fa806fd70 2026-02-25T17:21:11.950 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f054d7fa640 1 -- 10.20.193.76:0/3801790920 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 7) v1 ==== 61752+0+0 (secure 0 0 0) 0x7f0554024020 con 0x7f0558133f30 2026-02-25T17:21:11.950 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7ff2ca9aa640 1 -- 10.20.193.76:0/4206894757 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c412b460 con 0x7ff2c4130af0 2026-02-25T17:21:11.951 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9fad352640 1 --2- 10.20.193.76:0/3176667054 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9fa806fd70 0x7f9fa81237a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009dc0 tx=0x7f9fa4004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:11.951 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9f9d7fa640 1 -- 10.20.193.76:0/3176667054 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4006ea0 con 0x7f9fa806fd70 2026-02-25T17:21:11.951 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9f9d7fa640 1 -- 10.20.193.76:0/3176667054 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa4041620 con 0x7f9fa806fd70 2026-02-25T17:21:11.951 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9faeddc640 1 -- 10.20.193.76:0/3176667054 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa4009a70 con 0x7f9fa806fd70 2026-02-25T17:21:11.951 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9f9d7fa640 1 -- 10.20.193.76:0/3176667054 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa40419d0 con 0x7f9fa806fd70 2026-02-25T17:21:11.951 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f054d7fa640 1 -- 10.20.193.76:0/3801790920 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3021+0+0 (secure 0 0 0) 0x7f0554066fb0 con 0x7f0558133f30 2026-02-25T17:21:11.951 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7f9faeddc640 1 -- 10.20.193.76:0/3176667054 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa8097ca0 con 0x7f9fa806fd70 2026-02-25T17:21:11.952 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.918+0000 7ff2c0ff9640 1 -- 10.20.193.76:0/4206894757 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 7) v1 ==== 61752+0+0 (secure 0 0 0) 0x7ff2b8014480 con 0x7ff2c4130af0 2026-02-25T17:21:11.952 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.919+0000 7ff2c0ff9640 1 -- 10.20.193.76:0/4206894757 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3021+0+0 (secure 0 0 0) 0x7ff2b8066db0 con 0x7ff2c4130af0 2026-02-25T17:21:11.952 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.919+0000 7f9faeddc640 1 -- 10.20.193.76:0/3176667054 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa8125890 con 0x7f9fa806fd70 2026-02-25T17:21:11.953 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.919+0000 7f9f9d7fa640 1 -- 10.20.193.76:0/3176667054 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 7) v1 ==== 61752+0+0 (secure 0 0 0) 0x7f9fa4041b30 con 0x7f9fa806fd70 2026-02-25T17:21:11.953 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.919+0000 7f9f9d7fa640 1 -- 10.20.193.76:0/3176667054 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3021+0+0 (secure 0 0 0) 0x7f9fa408c040 con 0x7f9fa806fd70 2026-02-25T17:21:11.953 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.921+0000 7f054d7fa640 1 -- 10.20.193.76:0/3801790920 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143111 (secure 0 0 0) 0x7f0554041330 con 0x7f0558133f30 2026-02-25T17:21:11.953 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.921+0000 7ff2c0ff9640 1 -- 10.20.193.76:0/4206894757 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143111 (secure 0 0 0) 0x7ff2b806b070 con 0x7ff2c4130af0 2026-02-25T17:21:11.953 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.921+0000 7f9f9d7fa640 1 -- 10.20.193.76:0/3176667054 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143111 (secure 0 0 0) 0x7f9fa8125890 con 0x7f9fa806fd70 2026-02-25T17:21:11.959 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.957+0000 7ff354c2c640 1 Processor -- start 2026-02-25T17:21:11.959 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.957+0000 7ff354c2c640 1 -- start start 2026-02-25T17:21:11.961 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.957+0000 7ff354c2c640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff35006fff0 0x7ff350133b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:11.962 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.957+0000 7ff354c2c640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff350134050 0x7ff350136440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:11.962 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.957+0000 7ff354c2c640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff350070c00 con 0x7ff35006f500 2026-02-25T17:21:11.962 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.957+0000 7ff354c2c640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3500714d0 con 0x7ff35006fff0 2026-02-25T17:21:11.962 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.957+0000 7ff354c2c640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff35006bac0 con 0x7ff350134050 2026-02-25T17:21:11.962 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.957+0000 7ff34e575640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7ff35006f500 0x7ff35006f8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:46976/0 (socket says 10.20.193.76:46976) 2026-02-25T17:21:11.962 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.957+0000 7ff34e575640 1 -- 10.20.193.76:0/3645500966 learned_addr learned my addr 10.20.193.76:0/3645500966 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:11.962 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.958+0000 7ff34dd74640 1 --2- 10.20.193.76:0/3645500966 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff35006fff0 0x7ff350133b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:11.962 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.958+0000 7ff34ed76640 1 --2- 10.20.193.76:0/3645500966 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff350134050 0x7ff350136440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:11.962 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.958+0000 7ff34d573640 1 -- 10.20.193.76:0/3645500966 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629592849 0 0) 0x7ff350070c00 con 0x7ff35006f500 2026-02-25T17:21:11.962 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.958+0000 7ff34d573640 1 -- 10.20.193.76:0/3645500966 --> v1:10.20.193.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff33c003620 con 0x7ff35006f500 2026-02-25T17:21:11.962 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.958+0000 7ff34ed76640 1 -- 10.20.193.76:0/3645500966 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff35006fff0 msgr2=0x7ff350133b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:11.962 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.958+0000 7ff34ed76640 1 --2- 10.20.193.76:0/3645500966 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff35006fff0 0x7ff350133b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.962 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.958+0000 7ff34ed76640 1 -- 10.20.193.76:0/3645500966 >> v1:10.20.193.76:6789/0 conn(0x7ff35006f500 legacy=0x7ff35006f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:11.962 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.958+0000 7ff34ed76640 1 -- 10.20.193.76:0/3645500966 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35006bfb0 con 0x7ff350134050 2026-02-25T17:21:11.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.958+0000 7ff34dd74640 1 --2- 10.20.193.76:0/3645500966 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff35006fff0 0x7ff350133b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:11.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.958+0000 7ff34ed76640 1 --2- 10.20.193.76:0/3645500966 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff350134050 0x7ff350136440 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff340009dc0 tx=0x7ff34002f180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=268b7fb986af82f5 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:11.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.958+0000 7ff34d573640 1 -- 10.20.193.76:0/3645500966 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff340006ea0 con 0x7ff350134050 2026-02-25T17:21:11.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.958+0000 7ff34d573640 1 -- 10.20.193.76:0/3645500966 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34002fdf0 con 0x7ff350134050 2026-02-25T17:21:11.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.958+0000 7ff34d573640 1 -- 10.20.193.76:0/3645500966 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff340037660 con 0x7ff350134050 2026-02-25T17:21:11.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.959+0000 7ff354c2c640 1 -- 10.20.193.76:0/3645500966 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff350134050 msgr2=0x7ff350136440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:11.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.959+0000 7ff354c2c640 1 --2- 10.20.193.76:0/3645500966 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff350134050 0x7ff350136440 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff340009dc0 tx=0x7ff34002f180 comp rx=0 tx=0).stop 2026-02-25T17:21:11.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.959+0000 7ff354c2c640 1 -- 10.20.193.76:0/3645500966 shutdown_connections 2026-02-25T17:21:11.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.959+0000 7ff354c2c640 1 --2- 10.20.193.76:0/3645500966 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff350134050 0x7ff350136440 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.959+0000 7ff354c2c640 1 --2- 10.20.193.76:0/3645500966 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff35006fff0 0x7ff350133b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.959+0000 7ff354c2c640 1 -- 10.20.193.76:0/3645500966 >> 10.20.193.76:0/3645500966 conn(0x7ff35009ba70 msgr2=0x7ff35009be80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:11.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.959+0000 7ff354c2c640 1 -- 10.20.193.76:0/3645500966 shutdown_connections 2026-02-25T17:21:11.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.959+0000 7ff354c2c640 1 -- 10.20.193.76:0/3645500966 wait complete. 2026-02-25T17:21:11.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.959+0000 7ff354c2c640 1 Processor -- start 2026-02-25T17:21:11.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.959+0000 7ff354c2c640 1 -- start start 2026-02-25T17:21:11.965 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff354c2c640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff35006f500 0x7ff35011cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:11.965 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff354c2c640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff35006fff0 0x7ff35011d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:11.965 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff354c2c640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff350134050 0x7ff35011d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:11.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff354c2c640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35011f7a0 con 0x7ff350134050 2026-02-25T17:21:11.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff354c2c640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35011eee0 con 0x7ff35006fff0 2026-02-25T17:21:11.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff354c2c640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff350120350 con 0x7ff35006f500 2026-02-25T17:21:11.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff34e575640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff35006f500 0x7ff35011cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:11.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff34dd74640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff35006fff0 0x7ff35011d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:11.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff34dd74640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff35006fff0 0x7ff35011d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:42006/0 (socket says 10.20.193.76:42006) 2026-02-25T17:21:11.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff34e575640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff35006f500 0x7ff35011cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:48632/0 (socket says 10.20.193.76:48632) 2026-02-25T17:21:11.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff34dd74640 1 -- 10.20.193.76:0/1953874195 learned_addr learned my addr 10.20.193.76:0/1953874195 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:11.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff34ed76640 1 --2- 10.20.193.76:0/1953874195 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff350134050 0x7ff35011d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:11.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff34dd74640 1 -- 10.20.193.76:0/1953874195 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff35006f500 msgr2=0x7ff35011cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:11.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff34dd74640 1 --2- 10.20.193.76:0/1953874195 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff35006f500 0x7ff35011cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff34dd74640 1 -- 10.20.193.76:0/1953874195 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff350134050 msgr2=0x7ff35011d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:11.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff34dd74640 1 --2- 10.20.193.76:0/1953874195 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff350134050 0x7ff35011d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff34dd74640 1 -- 10.20.193.76:0/1953874195 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff338009500 con 0x7ff35006fff0 2026-02-25T17:21:11.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff34dd74640 1 --2- 10.20.193.76:0/1953874195 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff35006fff0 0x7ff35011d100 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff33800ebe0 tx=0x7ff33800c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:11.967 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff336ffd640 1 -- 10.20.193.76:0/1953874195 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33800cc40 con 0x7ff35006fff0 2026-02-25T17:21:11.967 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff336ffd640 1 -- 10.20.193.76:0/1953874195 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33800cda0 con 0x7ff35006fff0 2026-02-25T17:21:11.967 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff354c2c640 1 -- 10.20.193.76:0/1953874195 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff340009a70 con 0x7ff35006fff0 2026-02-25T17:21:11.967 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff336ffd640 1 -- 10.20.193.76:0/1953874195 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338013690 con 0x7ff35006fff0 2026-02-25T17:21:11.967 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.960+0000 7ff354c2c640 1 -- 10.20.193.76:0/1953874195 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35012f400 con 0x7ff35006fff0 2026-02-25T17:21:11.967 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.961+0000 7ff354c2c640 1 -- 10.20.193.76:0/1953874195 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35006f8e0 con 0x7ff35006fff0 2026-02-25T17:21:11.967 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.961+0000 7ff336ffd640 1 -- 10.20.193.76:0/1953874195 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 7) v1 ==== 61752+0+0 (secure 0 0 0) 0x7ff338011070 con 0x7ff35006fff0 2026-02-25T17:21:11.967 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.961+0000 7ff336ffd640 1 -- 10.20.193.76:0/1953874195 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3021+0+0 (secure 0 0 0) 0x7ff3380666b0 con 0x7ff35006fff0 2026-02-25T17:21:11.967 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.963+0000 7ff336ffd640 1 -- 10.20.193.76:0/1953874195 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143111 (secure 0 0 0) 0x7ff338040a30 con 0x7ff35006fff0 2026-02-25T17:21:11.987 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.984+0000 7f055f086640 1 -- 10.20.193.76:0/3801790920 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f055812b640 con 0x7f0558133f30 2026-02-25T17:21:11.987 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.985+0000 7f054d7fa640 1 -- 10.20.193.76:0/3801790920 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0554018030 con 0x7f0558133f30 2026-02-25T17:21:11.987 INFO:teuthology.orchestra.run.trial076.stdout:38654705755 2026-02-25T17:21:11.988 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.986+0000 7f055f086640 1 -- 10.20.193.76:0/3801790920 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0558133f30 msgr2=0x7f055812e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:11.988 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.986+0000 7f055f086640 1 --2- 10.20.193.76:0/3801790920 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0558133f30 0x7f055812e640 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0554009e30 tx=0x7f055400c490 comp rx=0 tx=0).stop 2026-02-25T17:21:11.988 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.986+0000 7f055f086640 1 -- 10.20.193.76:0/3801790920 shutdown_connections 2026-02-25T17:21:11.989 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.986+0000 7f055f086640 1 --2- 10.20.193.76:0/3801790920 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0558133f30 0x7f055812e640 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.989 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.986+0000 7f055f086640 1 --2- 10.20.193.76:0/3801790920 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0558131600 0x7f055812e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.989 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.986+0000 7f055f086640 1 --2- 10.20.193.76:0/3801790920 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f055812b260 0x7f055812dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.989 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.986+0000 7f055f086640 1 -- 10.20.193.76:0/3801790920 >> 10.20.193.76:0/3801790920 conn(0x7f055809f140 msgr2=0x7f055809bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:11.989 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.986+0000 7f055f086640 1 -- 10.20.193.76:0/3801790920 shutdown_connections 2026-02-25T17:21:11.989 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.986+0000 7f055f086640 1 -- 10.20.193.76:0/3801790920 wait complete. 2026-02-25T17:21:11.990 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.987+0000 7f9faeddc640 1 -- 10.20.193.76:0/3176667054 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9fa8125890 con 0x7f9fa806fd70 2026-02-25T17:21:11.990 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.987+0000 7f9f9d7fa640 1 -- 10.20.193.76:0/3176667054 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9fa8125890 con 0x7f9fa806fd70 2026-02-25T17:21:11.990 INFO:teuthology.orchestra.run.trial076.stdout:38654705754 2026-02-25T17:21:11.990 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.987+0000 7ff2ca9aa640 1 -- 10.20.193.76:0/4206894757 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff2c4061210 con 0x7ff2c4130af0 2026-02-25T17:21:11.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.988+0000 7ff2c0ff9640 1 -- 10.20.193.76:0/4206894757 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff2b8018020 con 0x7ff2c4130af0 2026-02-25T17:21:11.991 INFO:teuthology.orchestra.run.trial076.stdout:38654705754 2026-02-25T17:21:11.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.988+0000 7f9faeddc640 1 -- 10.20.193.76:0/3176667054 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9fa806fd70 msgr2=0x7f9fa81237a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:11.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.988+0000 7f9faeddc640 1 --2- 10.20.193.76:0/3176667054 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9fa806fd70 0x7f9fa81237a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009dc0 tx=0x7f9fa4004b40 comp rx=0 tx=0).stop 2026-02-25T17:21:11.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.989+0000 7f9faeddc640 1 -- 10.20.193.76:0/3176667054 shutdown_connections 2026-02-25T17:21:11.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.989+0000 7f9faeddc640 1 --2- 10.20.193.76:0/3176667054 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9fa806fd70 0x7f9fa81237a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.989+0000 7f9faeddc640 1 --2- 10.20.193.76:0/3176667054 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f9fa806c170 0x7f9fa8123260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.989+0000 7f9faeddc640 1 --2- 10.20.193.76:0/3176667054 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9fa806b850 0x7f9fa8122d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.989+0000 7f9faeddc640 1 -- 10.20.193.76:0/3176667054 >> 10.20.193.76:0/3176667054 conn(0x7f9fa809a8f0 msgr2=0x7f9fa8098680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:11.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.989+0000 7f9faeddc640 1 -- 10.20.193.76:0/3176667054 shutdown_connections 2026-02-25T17:21:11.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.989+0000 7f9faeddc640 1 -- 10.20.193.76:0/3176667054 wait complete. 2026-02-25T17:21:11.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.989+0000 7ff2ca9aa640 1 -- 10.20.193.76:0/4206894757 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff2c4130af0 msgr2=0x7ff2c4125560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:11.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.989+0000 7ff2ca9aa640 1 --2- 10.20.193.76:0/4206894757 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff2c4130af0 0x7ff2c4125560 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800ef90 tx=0x7ff2b800c490 comp rx=0 tx=0).stop 2026-02-25T17:21:11.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.989+0000 7ff2ca9aa640 1 -- 10.20.193.76:0/4206894757 shutdown_connections 2026-02-25T17:21:11.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.989+0000 7ff2ca9aa640 1 --2- 10.20.193.76:0/4206894757 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff2c4130af0 0x7ff2c4125560 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.989+0000 7ff2ca9aa640 1 --2- 10.20.193.76:0/4206894757 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff2c412bb70 0x7ff2c4125020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.989+0000 7ff2ca9aa640 1 --2- 10.20.193.76:0/4206894757 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff2c412b080 0x7ff2c4124ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:11.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.989+0000 7ff2ca9aa640 1 -- 10.20.193.76:0/4206894757 >> 10.20.193.76:0/4206894757 conn(0x7ff2c409a960 msgr2=0x7ff2c412c590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:11.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.989+0000 7ff2ca9aa640 1 -- 10.20.193.76:0/4206894757 shutdown_connections 2026-02-25T17:21:11.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:11.989+0000 7ff2ca9aa640 1 -- 10.20.193.76:0/4206894757 wait complete. 2026-02-25T17:21:11.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705756 got 38654705755 for osd.0 2026-02-25T17:21:11.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705755 got 38654705754 for osd.2 2026-02-25T17:21:12.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705755 got 38654705754 for osd.3 2026-02-25T17:21:12.031 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:12.028+0000 7ff354c2c640 1 -- 10.20.193.76:0/1953874195 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff350067910 con 0x7ff35006fff0 2026-02-25T17:21:12.031 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:12.029+0000 7ff336ffd640 1 -- 10.20.193.76:0/1953874195 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff338017030 con 0x7ff35006fff0 2026-02-25T17:21:12.031 INFO:teuthology.orchestra.run.trial076.stdout:38654705754 2026-02-25T17:21:12.032 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:12.030+0000 7ff354c2c640 1 -- 10.20.193.76:0/1953874195 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff35006fff0 msgr2=0x7ff35011d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:12.032 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:12.030+0000 7ff354c2c640 1 --2- 10.20.193.76:0/1953874195 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff35006fff0 0x7ff35011d100 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff33800ebe0 tx=0x7ff33800c520 comp rx=0 tx=0).stop 2026-02-25T17:21:12.032 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:12.030+0000 7ff354c2c640 1 -- 10.20.193.76:0/1953874195 shutdown_connections 2026-02-25T17:21:12.033 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:12.030+0000 7ff354c2c640 1 --2- 10.20.193.76:0/1953874195 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff350134050 0x7ff35011d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:12.033 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:12.030+0000 7ff354c2c640 1 --2- 10.20.193.76:0/1953874195 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff35006fff0 0x7ff35011d100 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:12.033 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:12.030+0000 7ff354c2c640 1 --2- 10.20.193.76:0/1953874195 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff35006f500 0x7ff35011cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:12.033 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:12.030+0000 7ff354c2c640 1 -- 10.20.193.76:0/1953874195 >> 10.20.193.76:0/1953874195 conn(0x7ff35009ba70 msgr2=0x7ff35006e890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:12.033 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:12.030+0000 7ff354c2c640 1 -- 10.20.193.76:0/1953874195 shutdown_connections 2026-02-25T17:21:12.033 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:12.030+0000 7ff354c2c640 1 -- 10.20.193.76:0/1953874195 wait complete. 2026-02-25T17:21:12.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705755 got 38654705754 for osd.1 2026-02-25T17:21:12.047 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:12.045+0000 7f1ac09f0640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-25T17:21:12.047 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:12.045+0000 7f1ac09f0640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-25T17:21:12.048 INFO:tasks.ceph.mgr.x.trial076.stderr:2026-02-25T17:21:12.045+0000 7f1ac09f0640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-25T17:21:12.999 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-25T17:21:13.000 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-25T17:21:13.000 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-25T17:21:13.041 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-25T17:21:13.073 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.069+0000 7feaa5611640 1 Processor -- start 2026-02-25T17:21:13.073 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.069+0000 7feaa5611640 1 -- start start 2026-02-25T17:21:13.073 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.069+0000 7feaa5611640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7feaa006c9a0 0x7feaa006cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.073 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.069+0000 7feaa5611640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7feaa006d9d0 0x7feaa0135fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.073 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.069+0000 7feaa5611640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa01364f0 con 0x7feaa00990e0 2026-02-25T17:21:13.073 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.069+0000 7feaa5611640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa006e8c0 con 0x7feaa006d9d0 2026-02-25T17:21:13.074 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.069+0000 7feaa5611640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feaa009ecc0 con 0x7feaa006c9a0 2026-02-25T17:21:13.074 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.069+0000 7fea9effd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7feaa006c9a0 0x7feaa006cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.074 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.069+0000 7fea9e7fc640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7feaa00990e0 0x7feaa006d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:46986/0 (socket says 10.20.193.76:46986) 2026-02-25T17:21:13.074 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.069+0000 7fea9e7fc640 1 -- 10.20.193.76:0/619802541 learned_addr learned my addr 10.20.193.76:0/619802541 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:13.074 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.069+0000 7fea9f7fe640 1 --2- 10.20.193.76:0/619802541 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7feaa006d9d0 0x7feaa0135fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.074 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7fea9dffb640 1 -- 10.20.193.76:0/619802541 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022431722 0 0) 0x7feaa01364f0 con 0x7feaa00990e0 2026-02-25T17:21:13.074 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7fea9dffb640 1 -- 10.20.193.76:0/619802541 --> v1:10.20.193.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea8c003620 con 0x7feaa00990e0 2026-02-25T17:21:13.074 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7fea9effd640 1 -- 10.20.193.76:0/619802541 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7feaa006d9d0 msgr2=0x7feaa0135fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:13.074 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7fea9effd640 1 --2- 10.20.193.76:0/619802541 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7feaa006d9d0 0x7feaa0135fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.074 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7fea9effd640 1 -- 10.20.193.76:0/619802541 >> v1:10.20.193.76:6789/0 conn(0x7feaa00990e0 legacy=0x7feaa006d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.075 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7fea9effd640 1 -- 10.20.193.76:0/619802541 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa0137690 con 0x7feaa006c9a0 2026-02-25T17:21:13.075 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7f5fb92c0640 1 Processor -- start 2026-02-25T17:21:13.075 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7f5fb92c0640 1 -- start start 2026-02-25T17:21:13.076 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7fea9effd640 1 --2- 10.20.193.76:0/619802541 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7feaa006c9a0 0x7feaa006cd80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fea940098d0 tx=0x7fea9402edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=934f50292af4897f server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:13.076 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7fea9dffb640 1 -- 10.20.193.76:0/619802541 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9402fa30 con 0x7feaa006c9a0 2026-02-25T17:21:13.076 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7fea9dffb640 1 -- 10.20.193.76:0/619802541 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9402fb90 con 0x7feaa006c9a0 2026-02-25T17:21:13.076 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7fea9dffb640 1 -- 10.20.193.76:0/619802541 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94037440 con 0x7feaa006c9a0 2026-02-25T17:21:13.078 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7f5fb92c0640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f5fb412e530 0x7f5fb412e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.078 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7f5fb92c0640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5fb409d390 0x7f5fb412ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.078 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7f5fb92c0640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5fb4097460 0x7f5fb40978d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.078 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7f5fb92c0640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb406d420 con 0x7f5fb412e530 2026-02-25T17:21:13.078 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7f5fb92c0640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb412f390 con 0x7f5fb4097460 2026-02-25T17:21:13.078 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7f5fb92c0640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb409b050 con 0x7f5fb409d390 2026-02-25T17:21:13.078 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7f5fb27fc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5fb409d390 0x7f5fb412ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.078 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7f5fb2ffd640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f5fb412e530 0x7f5fb412e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.078 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7f5fb37fe640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5fb4097460 0x7f5fb40978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.078 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7f5fb27fc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5fb409d390 0x7f5fb412ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:48672/0 (socket says 10.20.193.76:48672) 2026-02-25T17:21:13.078 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7f5fb2ffd640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f5fb412e530 0x7f5fb412e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:39382/0 (socket says 10.20.193.76:39382) 2026-02-25T17:21:13.079 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7f5fb27fc640 1 -- 10.20.193.76:0/1016061243 learned_addr learned my addr 10.20.193.76:0/1016061243 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:13.079 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7feaa5611640 1 -- 10.20.193.76:0/619802541 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7feaa006c9a0 msgr2=0x7feaa006cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.079 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.070+0000 7feaa5611640 1 --2- 10.20.193.76:0/619802541 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7feaa006c9a0 0x7feaa006cd80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fea940098d0 tx=0x7fea9402edc0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.079 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7f5fb37fe640 1 -- 10.20.193.76:0/1016061243 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5fb409d390 msgr2=0x7f5fb412ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:13.080 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7f5fb37fe640 1 --2- 10.20.193.76:0/1016061243 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5fb409d390 0x7f5fb412ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.080 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7f5fb37fe640 1 -- 10.20.193.76:0/1016061243 >> v2:10.20.193.76:3300/0 conn(0x7f5fb412e530 msgr2=0x7f5fb412e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:13.080 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7f5fb37fe640 1 --2- 10.20.193.76:0/1016061243 >> v2:10.20.193.76:3300/0 conn(0x7f5fb412e530 0x7f5fb412e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.080 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7f5fb37fe640 1 -- 10.20.193.76:0/1016061243 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb406da80 con 0x7f5fb4097460 2026-02-25T17:21:13.080 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7feaa5611640 1 -- 10.20.193.76:0/619802541 shutdown_connections 2026-02-25T17:21:13.081 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7feaa5611640 1 --2- 10.20.193.76:0/619802541 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7feaa006d9d0 0x7feaa0135fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.081 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7feaa5611640 1 --2- 10.20.193.76:0/619802541 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7feaa006c9a0 0x7feaa006cd80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.081 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7feaa5611640 1 -- 10.20.193.76:0/619802541 >> 10.20.193.76:0/619802541 conn(0x7feaa009d120 msgr2=0x7feaa009d530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:13.081 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7feaa5611640 1 -- 10.20.193.76:0/619802541 shutdown_connections 2026-02-25T17:21:13.081 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7feaa5611640 1 -- 10.20.193.76:0/619802541 wait complete. 2026-02-25T17:21:13.081 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7f5fb37fe640 1 --2- 10.20.193.76:0/1016061243 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5fb4097460 0x7f5fb40978d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009d90 tx=0x7f5fa402f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dacd6421599f871c server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:13.081 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7f5fb1ffb640 1 -- 10.20.193.76:0/1016061243 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4006ea0 con 0x7f5fb4097460 2026-02-25T17:21:13.082 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7f5fb1ffb640 1 -- 10.20.193.76:0/1016061243 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa402fdc0 con 0x7f5fb4097460 2026-02-25T17:21:13.082 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7f5fb1ffb640 1 -- 10.20.193.76:0/1016061243 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4037660 con 0x7f5fb4097460 2026-02-25T17:21:13.082 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7feaa5611640 1 Processor -- start 2026-02-25T17:21:13.082 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7feaa5611640 1 -- start start 2026-02-25T17:21:13.083 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7f5fb92c0640 1 -- 10.20.193.76:0/1016061243 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5fb4097460 msgr2=0x7f5fb40978d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.083 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7f5fb92c0640 1 --2- 10.20.193.76:0/1016061243 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5fb4097460 0x7f5fb40978d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009d90 tx=0x7f5fa402f190 comp rx=0 tx=0).stop 2026-02-25T17:21:13.083 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7f5fb92c0640 1 -- 10.20.193.76:0/1016061243 shutdown_connections 2026-02-25T17:21:13.083 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7f5fb92c0640 1 --2- 10.20.193.76:0/1016061243 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5fb4097460 0x7f5fb40978d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.083 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7f5fb92c0640 1 --2- 10.20.193.76:0/1016061243 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5fb409d390 0x7f5fb412ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.083 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7f5fb92c0640 1 --2- 10.20.193.76:0/1016061243 >> v2:10.20.193.76:3300/0 conn(0x7f5fb412e530 0x7f5fb412e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.084 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7f5fb92c0640 1 -- 10.20.193.76:0/1016061243 >> 10.20.193.76:0/1016061243 conn(0x7f5fb409e130 msgr2=0x7f5fb409ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:13.084 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7f5fb92c0640 1 -- 10.20.193.76:0/1016061243 shutdown_connections 2026-02-25T17:21:13.084 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.071+0000 7f5fb92c0640 1 -- 10.20.193.76:0/1016061243 wait complete. 2026-02-25T17:21:13.085 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7feaa5611640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7feaa006c9a0 0x7feaa0123ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.085 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7feaa5611640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7feaa006d9d0 0x7feaa0124400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.086 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7feaa5611640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7feaa00990e0 0x7feaa0124940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.086 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7feaa5611640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa0135980 con 0x7feaa006d9d0 2026-02-25T17:21:13.086 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7feaa5611640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa01364c0 con 0x7feaa00990e0 2026-02-25T17:21:13.086 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7feaa5611640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feaa0097930 con 0x7feaa006c9a0 2026-02-25T17:21:13.086 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7fea9e7fc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7feaa006d9d0 0x7feaa0124400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.086 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7fea9f7fe640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7feaa00990e0 0x7feaa0124940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.086 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7fea9effd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7feaa006c9a0 0x7feaa0123ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.086 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7fea9e7fc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7feaa006d9d0 0x7feaa0124400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:39386/0 (socket says 10.20.193.76:39386) 2026-02-25T17:21:13.086 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7fea9e7fc640 1 -- 10.20.193.76:0/383099594 learned_addr learned my addr 10.20.193.76:0/383099594 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:13.086 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7fea9effd640 1 -- 10.20.193.76:0/383099594 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7feaa00990e0 msgr2=0x7feaa0124940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.086 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7fea9effd640 1 --2- 10.20.193.76:0/383099594 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7feaa00990e0 0x7feaa0124940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.086 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7fea9effd640 1 -- 10.20.193.76:0/383099594 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7feaa006d9d0 msgr2=0x7feaa0124400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.086 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7fea9effd640 1 --2- 10.20.193.76:0/383099594 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7feaa006d9d0 0x7feaa0124400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.086 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7fea9effd640 1 -- 10.20.193.76:0/383099594 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea94009500 con 0x7feaa006c9a0 2026-02-25T17:21:13.086 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7fea9e7fc640 1 --2- 10.20.193.76:0/383099594 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7feaa006d9d0 0x7feaa0124400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:13.087 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7fea9f7fe640 1 --2- 10.20.193.76:0/383099594 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7feaa00990e0 0x7feaa0124940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:13.087 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7fea9effd640 1 --2- 10.20.193.76:0/383099594 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7feaa006c9a0 0x7feaa0123ec0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7feaa009b860 tx=0x7fea940047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:13.087 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7fea7f7fe640 1 -- 10.20.193.76:0/383099594 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94042620 con 0x7feaa006c9a0 2026-02-25T17:21:13.087 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7fea7f7fe640 1 -- 10.20.193.76:0/383099594 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea940427c0 con 0x7feaa006c9a0 2026-02-25T17:21:13.087 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7fea7f7fe640 1 -- 10.20.193.76:0/383099594 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea94042b70 con 0x7feaa006c9a0 2026-02-25T17:21:13.087 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7feaa5611640 1 -- 10.20.193.76:0/383099594 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa0125060 con 0x7feaa006c9a0 2026-02-25T17:21:13.087 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7f5fb92c0640 1 Processor -- start 2026-02-25T17:21:13.087 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7feaa5611640 1 -- 10.20.193.76:0/383099594 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa0125a70 con 0x7feaa006c9a0 2026-02-25T17:21:13.088 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7f5fb92c0640 1 -- start start 2026-02-25T17:21:13.088 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7f5fb92c0640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5fb4097460 0x7f5fb41260c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.089 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7f5fb92c0640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5fb409d390 0x7f5fb4126600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.089 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7f5fb92c0640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5fb412e530 0x7f5fb4126b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.089 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7f5fb92c0640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb4127b70 con 0x7f5fb4097460 2026-02-25T17:21:13.089 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7f5fb92c0640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb4128570 con 0x7f5fb412e530 2026-02-25T17:21:13.089 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.072+0000 7f5fb92c0640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb409b270 con 0x7f5fb409d390 2026-02-25T17:21:13.089 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7f5fb27fc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5fb409d390 0x7f5fb4126600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.089 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7f5fb2ffd640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5fb4097460 0x7f5fb41260c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.089 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7f5fb27fc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5fb409d390 0x7f5fb4126600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:48692/0 (socket says 10.20.193.76:48692) 2026-02-25T17:21:13.089 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7f5fb27fc640 1 -- 10.20.193.76:0/758639436 learned_addr learned my addr 10.20.193.76:0/758639436 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:13.089 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7f5fb37fe640 1 --2- 10.20.193.76:0/758639436 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5fb412e530 0x7f5fb4126b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.089 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7f5fb27fc640 1 -- 10.20.193.76:0/758639436 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5fb412e530 msgr2=0x7f5fb4126b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.089 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7f5fb27fc640 1 --2- 10.20.193.76:0/758639436 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5fb412e530 0x7f5fb4126b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.089 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7f5fb27fc640 1 -- 10.20.193.76:0/758639436 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5fb4097460 msgr2=0x7f5fb41260c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.089 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7f5fb27fc640 1 --2- 10.20.193.76:0/758639436 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5fb4097460 0x7f5fb41260c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.089 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7f5fb27fc640 1 -- 10.20.193.76:0/758639436 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa4009a70 con 0x7f5fb409d390 2026-02-25T17:21:13.090 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7feaa5611640 1 -- 10.20.193.76:0/383099594 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa0136ff0 con 0x7feaa006c9a0 2026-02-25T17:21:13.090 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7fc228122640 1 Processor -- start 2026-02-25T17:21:13.090 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7f5fb27fc640 1 --2- 10.20.193.76:0/758639436 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5fb409d390 0x7f5fb4126600 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c00e980 tx=0x7f5f9c00ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:13.090 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7fc228122640 1 -- start start 2026-02-25T17:21:13.091 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7f5f937fe640 1 -- 10.20.193.76:0/758639436 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c00ca00 con 0x7f5fb409d390 2026-02-25T17:21:13.091 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7f5f937fe640 1 -- 10.20.193.76:0/758639436 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9c00cb60 con 0x7f5fb409d390 2026-02-25T17:21:13.091 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7f5fb92c0640 1 -- 10.20.193.76:0/758639436 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb4128e30 con 0x7f5fb409d390 2026-02-25T17:21:13.091 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7f5f937fe640 1 -- 10.20.193.76:0/758639436 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c013470 con 0x7f5fb409d390 2026-02-25T17:21:13.091 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7f5fb92c0640 1 -- 10.20.193.76:0/758639436 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb4134080 con 0x7f5fb409d390 2026-02-25T17:21:13.091 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7fea7f7fe640 1 -- 10.20.193.76:0/383099594 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 8) v1 ==== 61844+0+0 (secure 0 0 0) 0x7fea94051020 con 0x7feaa006c9a0 2026-02-25T17:21:13.092 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7fc228122640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc22012e530 0x7fc22012e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.092 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7fc228122640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fc22009d390 0x7fc22012ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.092 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7fc228122640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc22006d420 con 0x7fc220097460 2026-02-25T17:21:13.092 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7fc228122640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc22012f390 con 0x7fc22009d390 2026-02-25T17:21:13.092 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7fc228122640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22009b050 con 0x7fc22012e530 2026-02-25T17:21:13.092 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7fea7f7fe640 1 -- 10.20.193.76:0/383099594 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3021+0+0 (secure 0 0 0) 0x7fea9408b7e0 con 0x7feaa006c9a0 2026-02-25T17:21:13.093 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7fc225e97640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc22012e530 0x7fc22012e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.093 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7fc225696640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fc22009d390 0x7fc22012ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.093 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7fc225e97640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc22012e530 0x7fc22012e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:42086/0 (socket says 10.20.193.76:42086) 2026-02-25T17:21:13.093 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7fc225e97640 1 -- 10.20.193.76:0/3542247146 learned_addr learned my addr 10.20.193.76:0/3542247146 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:13.093 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7fc226698640 1 --1- 10.20.193.76:0/3542247146 >> v1:10.20.193.76:6789/0 conn(0x7fc220097460 0x7fc220097890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:46992/0 (socket says 10.20.193.76:46992) 2026-02-25T17:21:13.093 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7fc225e97640 1 -- 10.20.193.76:0/3542247146 >> v2:10.20.193.76:3300/0 conn(0x7fc22009d390 msgr2=0x7fc22012ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:13.093 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7fc225e97640 1 --2- 10.20.193.76:0/3542247146 >> v2:10.20.193.76:3300/0 conn(0x7fc22009d390 0x7fc22012ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.093 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7fc225e97640 1 -- 10.20.193.76:0/3542247146 >> v1:10.20.193.76:6789/0 conn(0x7fc220097460 legacy=0x7fc220097890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.093 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7fc224e95640 1 -- 10.20.193.76:0/3542247146 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676899349 0 0) 0x7fc22006d420 con 0x7fc220097460 2026-02-25T17:21:13.093 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7fc225e97640 1 -- 10.20.193.76:0/3542247146 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22006da80 con 0x7fc22012e530 2026-02-25T17:21:13.093 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7fc225696640 1 --2- 10.20.193.76:0/3542247146 >> v2:10.20.193.76:3300/0 conn(0x7fc22009d390 0x7fc22012ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:13.094 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.073+0000 7f5fb92c0640 1 -- 10.20.193.76:0/758639436 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb40978d0 con 0x7f5fb409d390 2026-02-25T17:21:13.094 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.074+0000 7f5f937fe640 1 -- 10.20.193.76:0/758639436 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 8) v1 ==== 61844+0+0 (secure 0 0 0) 0x7f5f9c011070 con 0x7f5fb409d390 2026-02-25T17:21:13.095 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.074+0000 7fc225e97640 1 --2- 10.20.193.76:0/3542247146 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc22012e530 0x7fc22012e910 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc210009970 tx=0x7fc21002ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=164b88c018d02005 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:13.095 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.074+0000 7fc224e95640 1 -- 10.20.193.76:0/3542247146 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21002fb10 con 0x7fc22012e530 2026-02-25T17:21:13.095 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.074+0000 7fc224e95640 1 -- 10.20.193.76:0/3542247146 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21002fc70 con 0x7fc22012e530 2026-02-25T17:21:13.095 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.074+0000 7fc224e95640 1 -- 10.20.193.76:0/3542247146 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc210037440 con 0x7fc22012e530 2026-02-25T17:21:13.095 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.074+0000 7fc228122640 1 -- 10.20.193.76:0/3542247146 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc22012e530 msgr2=0x7fc22012e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.095 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.074+0000 7fc228122640 1 --2- 10.20.193.76:0/3542247146 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc22012e530 0x7fc22012e910 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc210009970 tx=0x7fc21002ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:13.095 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.074+0000 7fc228122640 1 -- 10.20.193.76:0/3542247146 shutdown_connections 2026-02-25T17:21:13.095 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.074+0000 7fc228122640 1 --2- 10.20.193.76:0/3542247146 >> v2:10.20.193.76:3300/0 conn(0x7fc22009d390 0x7fc22012ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.096 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.074+0000 7fc228122640 1 --2- 10.20.193.76:0/3542247146 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc22012e530 0x7fc22012e910 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.096 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.074+0000 7fc228122640 1 -- 10.20.193.76:0/3542247146 >> 10.20.193.76:0/3542247146 conn(0x7fc22009e130 msgr2=0x7fc22009ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:13.096 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.074+0000 7fc228122640 1 -- 10.20.193.76:0/3542247146 shutdown_connections 2026-02-25T17:21:13.096 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.074+0000 7fc228122640 1 -- 10.20.193.76:0/3542247146 wait complete. 2026-02-25T17:21:13.096 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc228122640 1 Processor -- start 2026-02-25T17:21:13.096 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc228122640 1 -- start start 2026-02-25T17:21:13.096 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc228122640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc220097460 0x7fc2201c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.096 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc228122640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc22009d390 0x7fc2201c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.096 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc228122640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc22012e530 0x7fc2201c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.096 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc228122640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22009b2e0 con 0x7fc22012e530 2026-02-25T17:21:13.096 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc228122640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc220126bd0 con 0x7fc22009d390 2026-02-25T17:21:13.096 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc228122640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc220127bd0 con 0x7fc220097460 2026-02-25T17:21:13.096 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc225696640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc22009d390 0x7fc2201c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.096 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc225696640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc22009d390 0x7fc2201c1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:42100/0 (socket says 10.20.193.76:42100) 2026-02-25T17:21:13.096 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc225e97640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc220097460 0x7fc2201c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.096 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc225696640 1 -- 10.20.193.76:0/2057464900 learned_addr learned my addr 10.20.193.76:0/2057464900 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:13.096 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc226698640 1 --2- 10.20.193.76:0/2057464900 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc22012e530 0x7fc2201c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.097 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7f5f937fe640 1 -- 10.20.193.76:0/758639436 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3021+0+0 (secure 0 0 0) 0x7f5f9c043c50 con 0x7f5fb409d390 2026-02-25T17:21:13.097 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fea7f7fe640 1 -- 10.20.193.76:0/383099594 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7fea940654c0 con 0x7feaa006c9a0 2026-02-25T17:21:13.097 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc225696640 1 -- 10.20.193.76:0/2057464900 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc220097460 msgr2=0x7fc2201c1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.098 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc225696640 1 --2- 10.20.193.76:0/2057464900 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc220097460 0x7fc2201c1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.098 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc225696640 1 -- 10.20.193.76:0/2057464900 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc22012e530 msgr2=0x7fc2201c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.098 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc225696640 1 --2- 10.20.193.76:0/2057464900 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc22012e530 0x7fc2201c24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.098 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc225696640 1 -- 10.20.193.76:0/2057464900 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc214009500 con 0x7fc22009d390 2026-02-25T17:21:13.098 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc225696640 1 --2- 10.20.193.76:0/2057464900 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc22009d390 0x7fc2201c1f80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc21400ebe0 tx=0x7fc21400c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:13.098 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc2067fc640 1 -- 10.20.193.76:0/2057464900 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21400cc40 con 0x7fc22009d390 2026-02-25T17:21:13.098 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc2067fc640 1 -- 10.20.193.76:0/2057464900 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21400cda0 con 0x7fc22009d390 2026-02-25T17:21:13.098 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc228122640 1 -- 10.20.193.76:0/2057464900 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2100095d0 con 0x7fc22009d390 2026-02-25T17:21:13.098 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc2067fc640 1 -- 10.20.193.76:0/2057464900 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc214013690 con 0x7fc22009d390 2026-02-25T17:21:13.098 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.075+0000 7fc228122640 1 -- 10.20.193.76:0/2057464900 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2201c4f40 con 0x7fc22009d390 2026-02-25T17:21:13.098 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.076+0000 7fc228122640 1 -- 10.20.193.76:0/2057464900 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc220097890 con 0x7fc22009d390 2026-02-25T17:21:13.098 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.076+0000 7fc2067fc640 1 -- 10.20.193.76:0/2057464900 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 8) v1 ==== 61844+0+0 (secure 0 0 0) 0x7fc214011070 con 0x7fc22009d390 2026-02-25T17:21:13.098 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.077+0000 7fc2067fc640 1 -- 10.20.193.76:0/2057464900 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3021+0+0 (secure 0 0 0) 0x7fc214066780 con 0x7fc22009d390 2026-02-25T17:21:13.098 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.077+0000 7f5f937fe640 1 -- 10.20.193.76:0/758639436 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f5f9c0400a0 con 0x7f5fb409d390 2026-02-25T17:21:13.098 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.078+0000 7fc2067fc640 1 -- 10.20.193.76:0/2057464900 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7fc214040280 con 0x7fc22009d390 2026-02-25T17:21:13.117 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.115+0000 7fc2f3852640 1 Processor -- start 2026-02-25T17:21:13.117 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.115+0000 7fc2f3852640 1 -- start start 2026-02-25T17:21:13.118 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.116+0000 7fc2f3852640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fc2ec06eac0 0x7fc2ec1316f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.118 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.116+0000 7fc2f3852640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc2ec131c30 0x7fc2ec134020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.118 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.116+0000 7fc2f3852640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ec09d9a0 con 0x7fc2ec06dfd0 2026-02-25T17:21:13.118 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.116+0000 7fc2f3852640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ec06eea0 con 0x7fc2ec06eac0 2026-02-25T17:21:13.118 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.116+0000 7fc2f3852640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec099190 con 0x7fc2ec131c30 2026-02-25T17:21:13.118 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.116+0000 7fc2f0dc6640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fc2ec06eac0 0x7fc2ec1316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.118 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.116+0000 7fc2f15c7640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7fc2ec06dfd0 0x7fc2ec06e3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:46994/0 (socket says 10.20.193.76:46994) 2026-02-25T17:21:13.118 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.116+0000 7fc2f15c7640 1 -- 10.20.193.76:0/1426548449 learned_addr learned my addr 10.20.193.76:0/1426548449 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:13.118 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.116+0000 7fc2f1dc8640 1 --2- 10.20.193.76:0/1426548449 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc2ec131c30 0x7fc2ec134020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.118 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.116+0000 7fc2f0dc6640 1 -- 10.20.193.76:0/1426548449 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc2ec131c30 msgr2=0x7fc2ec134020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:13.118 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.116+0000 7fc2f0dc6640 1 --2- 10.20.193.76:0/1426548449 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc2ec131c30 0x7fc2ec134020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.118 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.116+0000 7fc2f0dc6640 1 -- 10.20.193.76:0/1426548449 >> v1:10.20.193.76:6789/0 conn(0x7fc2ec06dfd0 legacy=0x7fc2ec06e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.118 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.116+0000 7fc2f0dc6640 1 -- 10.20.193.76:0/1426548449 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ec072260 con 0x7fc2ec06eac0 2026-02-25T17:21:13.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.116+0000 7fc2f0dc6640 1 --2- 10.20.193.76:0/1426548449 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc2ec06eac0 0x7fc2ec1316f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00098a0 tx=0x7fc2e002ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a88817145c7c29 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:13.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.117+0000 7fc2dbfff640 1 -- 10.20.193.76:0/1426548449 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e002fad0 con 0x7fc2ec06eac0 2026-02-25T17:21:13.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.117+0000 7fc2dbfff640 1 -- 10.20.193.76:0/1426548449 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e002fc30 con 0x7fc2ec06eac0 2026-02-25T17:21:13.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.117+0000 7fc2dbfff640 1 -- 10.20.193.76:0/1426548449 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0037440 con 0x7fc2ec06eac0 2026-02-25T17:21:13.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.117+0000 7fc2f3852640 1 -- 10.20.193.76:0/1426548449 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc2ec06eac0 msgr2=0x7fc2ec1316f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.117+0000 7fc2f3852640 1 --2- 10.20.193.76:0/1426548449 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc2ec06eac0 0x7fc2ec1316f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00098a0 tx=0x7fc2e002ee10 comp rx=0 tx=0).stop 2026-02-25T17:21:13.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.117+0000 7fc2f3852640 1 -- 10.20.193.76:0/1426548449 shutdown_connections 2026-02-25T17:21:13.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.117+0000 7fc2f3852640 1 --2- 10.20.193.76:0/1426548449 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc2ec131c30 0x7fc2ec134020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.117+0000 7fc2f3852640 1 --2- 10.20.193.76:0/1426548449 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc2ec06eac0 0x7fc2ec1316f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.117+0000 7fc2f3852640 1 -- 10.20.193.76:0/1426548449 >> 10.20.193.76:0/1426548449 conn(0x7fc2ec09a960 msgr2=0x7fc2ec09ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:13.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.117+0000 7fc2f3852640 1 -- 10.20.193.76:0/1426548449 shutdown_connections 2026-02-25T17:21:13.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.117+0000 7fc2f3852640 1 -- 10.20.193.76:0/1426548449 wait complete. 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.117+0000 7fc2f3852640 1 Processor -- start 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.117+0000 7fc2f3852640 1 -- start start 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f3852640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc2ec06dfd0 0x7fc2ec12f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f3852640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc2ec06eac0 0x7fc2ec12f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f3852640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc2ec131c30 0x7fc2ec12fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f3852640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec122750 con 0x7fc2ec131c30 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f3852640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec122b20 con 0x7fc2ec06eac0 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f3852640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec121f70 con 0x7fc2ec06dfd0 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f0dc6640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc2ec06eac0 0x7fc2ec12f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f1dc8640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc2ec131c30 0x7fc2ec12fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f15c7640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc2ec06dfd0 0x7fc2ec12f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f0dc6640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc2ec06eac0 0x7fc2ec12f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:42124/0 (socket says 10.20.193.76:42124) 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f0dc6640 1 -- 10.20.193.76:0/1836088679 learned_addr learned my addr 10.20.193.76:0/1836088679 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f1dc8640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc2ec131c30 0x7fc2ec12fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:39414/0 (socket says 10.20.193.76:39414) 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f0dc6640 1 -- 10.20.193.76:0/1836088679 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc2ec06dfd0 msgr2=0x7fc2ec12f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f0dc6640 1 --2- 10.20.193.76:0/1836088679 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc2ec06dfd0 0x7fc2ec12f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f0dc6640 1 -- 10.20.193.76:0/1836088679 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc2ec131c30 msgr2=0x7fc2ec12fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f0dc6640 1 --2- 10.20.193.76:0/1836088679 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc2ec131c30 0x7fc2ec12fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f0dc6640 1 -- 10.20.193.76:0/1836088679 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e0009500 con 0x7fc2ec06eac0 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f1dc8640 1 --2- 10.20.193.76:0/1836088679 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc2ec131c30 0x7fc2ec12fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:13.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f0dc6640 1 --2- 10.20.193.76:0/1836088679 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc2ec06eac0 0x7fc2ec12f570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009130 tx=0x7fc2e00047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:13.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2d9ffb640 1 -- 10.20.193.76:0/1836088679 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0042650 con 0x7fc2ec06eac0 2026-02-25T17:21:13.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2d9ffb640 1 -- 10.20.193.76:0/1836088679 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e00427d0 con 0x7fc2ec06eac0 2026-02-25T17:21:13.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f3852640 1 -- 10.20.193.76:0/1836088679 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ec1313f0 con 0x7fc2ec06eac0 2026-02-25T17:21:13.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2d9ffb640 1 -- 10.20.193.76:0/1836088679 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0042b80 con 0x7fc2ec06eac0 2026-02-25T17:21:13.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.118+0000 7fc2f3852640 1 -- 10.20.193.76:0/1836088679 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ec1268e0 con 0x7fc2ec06eac0 2026-02-25T17:21:13.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.119+0000 7fc2f3852640 1 -- 10.20.193.76:0/1836088679 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ec06e3b0 con 0x7fc2ec06eac0 2026-02-25T17:21:13.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.119+0000 7fc2d9ffb640 1 -- 10.20.193.76:0/1836088679 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 8) v1 ==== 61844+0+0 (secure 0 0 0) 0x7fc2e0052020 con 0x7fc2ec06eac0 2026-02-25T17:21:13.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.119+0000 7fc2d9ffb640 1 -- 10.20.193.76:0/1836088679 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3021+0+0 (secure 0 0 0) 0x7fc2e008bea0 con 0x7fc2ec06eac0 2026-02-25T17:21:13.123 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.121+0000 7fc2d9ffb640 1 -- 10.20.193.76:0/1836088679 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7fc2e0065b00 con 0x7fc2ec06eac0 2026-02-25T17:21:13.144 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.141+0000 7feaa5611640 1 -- 10.20.193.76:0/383099594 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7feaa0068300 con 0x7feaa006c9a0 2026-02-25T17:21:13.144 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.142+0000 7fea7f7fe640 1 -- 10.20.193.76:0/383099594 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea9403c070 con 0x7feaa006c9a0 2026-02-25T17:21:13.144 INFO:teuthology.orchestra.run.trial076.stdout:38654705756 2026-02-25T17:21:13.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.143+0000 7feaa5611640 1 -- 10.20.193.76:0/383099594 >> v1:10.20.193.76:6800/1563581135 conn(0x7fea6c04f6d0 legacy=0x7fea6c051b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.143+0000 7feaa5611640 1 -- 10.20.193.76:0/383099594 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7feaa006c9a0 msgr2=0x7feaa0123ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.143+0000 7feaa5611640 1 --2- 10.20.193.76:0/383099594 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7feaa006c9a0 0x7feaa0123ec0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7feaa009b860 tx=0x7fea940047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.143+0000 7feaa5611640 1 -- 10.20.193.76:0/383099594 shutdown_connections 2026-02-25T17:21:13.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.143+0000 7feaa5611640 1 --2- 10.20.193.76:0/383099594 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7feaa00990e0 0x7feaa0124940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.143+0000 7feaa5611640 1 --2- 10.20.193.76:0/383099594 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7feaa006d9d0 0x7feaa0124400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.143+0000 7feaa5611640 1 --2- 10.20.193.76:0/383099594 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7feaa006c9a0 0x7feaa0123ec0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.143+0000 7feaa5611640 1 -- 10.20.193.76:0/383099594 >> 10.20.193.76:0/383099594 conn(0x7feaa009d120 msgr2=0x7feaa00908c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:13.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.143+0000 7feaa5611640 1 -- 10.20.193.76:0/383099594 shutdown_connections 2026-02-25T17:21:13.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.143+0000 7feaa5611640 1 -- 10.20.193.76:0/383099594 wait complete. 2026-02-25T17:21:13.147 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.144+0000 7f5fb92c0640 1 -- 10.20.193.76:0/758639436 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5fb41342d0 con 0x7f5fb409d390 2026-02-25T17:21:13.147 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.144+0000 7f5f937fe640 1 -- 10.20.193.76:0/758639436 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f9c017030 con 0x7f5fb409d390 2026-02-25T17:21:13.148 INFO:teuthology.orchestra.run.trial076.stdout:38654705757 2026-02-25T17:21:13.148 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.145+0000 7fc228122640 1 -- 10.20.193.76:0/2057464900 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc2200681d0 con 0x7fc22009d390 2026-02-25T17:21:13.149 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.145+0000 7f5fb92c0640 1 -- 10.20.193.76:0/758639436 >> v1:10.20.193.76:6800/1563581135 conn(0x7f5f8004f6d0 legacy=0x7f5f80051b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.149 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.145+0000 7f5fb92c0640 1 -- 10.20.193.76:0/758639436 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5fb409d390 msgr2=0x7f5fb4126600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.149 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.145+0000 7f5fb92c0640 1 --2- 10.20.193.76:0/758639436 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5fb409d390 0x7f5fb4126600 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c00e980 tx=0x7f5f9c00ee50 comp rx=0 tx=0).stop 2026-02-25T17:21:13.149 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.145+0000 7f5fb92c0640 1 -- 10.20.193.76:0/758639436 shutdown_connections 2026-02-25T17:21:13.149 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.145+0000 7f5fb92c0640 1 --2- 10.20.193.76:0/758639436 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5fb412e530 0x7f5fb4126b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.149 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.145+0000 7f5fb92c0640 1 --2- 10.20.193.76:0/758639436 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5fb409d390 0x7f5fb4126600 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.149 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.145+0000 7f5fb92c0640 1 --2- 10.20.193.76:0/758639436 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5fb4097460 0x7f5fb41260c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.149 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.146+0000 7f5fb92c0640 1 -- 10.20.193.76:0/758639436 >> 10.20.193.76:0/758639436 conn(0x7f5fb409e130 msgr2=0x7f5fb4134f30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:13.149 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.146+0000 7f5fb92c0640 1 -- 10.20.193.76:0/758639436 shutdown_connections 2026-02-25T17:21:13.149 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.146+0000 7f5fb92c0640 1 -- 10.20.193.76:0/758639436 wait complete. 2026-02-25T17:21:13.150 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.146+0000 7fc2067fc640 1 -- 10.20.193.76:0/2057464900 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc214017030 con 0x7fc22009d390 2026-02-25T17:21:13.150 INFO:teuthology.orchestra.run.trial076.stdout:38654705756 2026-02-25T17:21:13.151 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.147+0000 7fc228122640 1 -- 10.20.193.76:0/2057464900 >> v1:10.20.193.76:6800/1563581135 conn(0x7fc1f004f6d0 legacy=0x7fc1f0051b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.151 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.147+0000 7fc228122640 1 -- 10.20.193.76:0/2057464900 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc22009d390 msgr2=0x7fc2201c1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.151 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.147+0000 7fc228122640 1 --2- 10.20.193.76:0/2057464900 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc22009d390 0x7fc2201c1f80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc21400ebe0 tx=0x7fc21400c520 comp rx=0 tx=0).stop 2026-02-25T17:21:13.151 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.147+0000 7fc228122640 1 -- 10.20.193.76:0/2057464900 shutdown_connections 2026-02-25T17:21:13.151 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.147+0000 7fc228122640 1 --2- 10.20.193.76:0/2057464900 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc22012e530 0x7fc2201c24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.151 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.147+0000 7fc228122640 1 --2- 10.20.193.76:0/2057464900 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc22009d390 0x7fc2201c1f80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.151 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.147+0000 7fc228122640 1 --2- 10.20.193.76:0/2057464900 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc220097460 0x7fc2201c1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.152 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.147+0000 7fc228122640 1 -- 10.20.193.76:0/2057464900 >> 10.20.193.76:0/2057464900 conn(0x7fc22009e130 msgr2=0x7fc220135ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:13.152 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.147+0000 7fc228122640 1 -- 10.20.193.76:0/2057464900 shutdown_connections 2026-02-25T17:21:13.152 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.147+0000 7fc228122640 1 -- 10.20.193.76:0/2057464900 wait complete. 2026-02-25T17:21:13.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705755 got 38654705756 for osd.3 2026-02-25T17:21:13.155 DEBUG:teuthology.parallel:result is None 2026-02-25T17:21:13.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705756 got 38654705757 for osd.0 2026-02-25T17:21:13.156 DEBUG:teuthology.parallel:result is None 2026-02-25T17:21:13.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705755 got 38654705756 for osd.2 2026-02-25T17:21:13.158 DEBUG:teuthology.parallel:result is None 2026-02-25T17:21:13.172 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.170+0000 7fc2d9ffb640 1 -- 10.20.193.76:0/1836088679 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mgrmap(e 9) v1 ==== 61950+0+0 (secure 0 0 0) 0x7fc2e0042ce0 con 0x7fc2ec06eac0 2026-02-25T17:21:13.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.188+0000 7fc2f3852640 1 -- 10.20.193.76:0/1836088679 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc2ec068270 con 0x7fc2ec06eac0 2026-02-25T17:21:13.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.188+0000 7fc2d9ffb640 1 -- 10.20.193.76:0/1836088679 <== mon.1 v2:10.20.193.76:3301/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc2e0046020 con 0x7fc2ec06eac0 2026-02-25T17:21:13.191 INFO:teuthology.orchestra.run.trial076.stdout:38654705756 2026-02-25T17:21:13.192 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.190+0000 7fc2f3852640 1 -- 10.20.193.76:0/1836088679 >> v1:10.20.193.76:6800/1563581135 conn(0x7fc2bc04f6d0 legacy=0x7fc2bc051b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.192 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.190+0000 7fc2f3852640 1 -- 10.20.193.76:0/1836088679 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc2ec06eac0 msgr2=0x7fc2ec12f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.190+0000 7fc2f3852640 1 --2- 10.20.193.76:0/1836088679 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc2ec06eac0 0x7fc2ec12f570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009130 tx=0x7fc2e00047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.190+0000 7fc2f3852640 1 -- 10.20.193.76:0/1836088679 shutdown_connections 2026-02-25T17:21:13.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.190+0000 7fc2f3852640 1 --2- 10.20.193.76:0/1836088679 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc2ec131c30 0x7fc2ec12fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.190+0000 7fc2f3852640 1 --2- 10.20.193.76:0/1836088679 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc2ec06eac0 0x7fc2ec12f570 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.190+0000 7fc2f3852640 1 --2- 10.20.193.76:0/1836088679 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc2ec06dfd0 0x7fc2ec12f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.190+0000 7fc2f3852640 1 -- 10.20.193.76:0/1836088679 >> 10.20.193.76:0/1836088679 conn(0x7fc2ec09a960 msgr2=0x7fc2ec09ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:13.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.190+0000 7fc2f3852640 1 -- 10.20.193.76:0/1836088679 shutdown_connections 2026-02-25T17:21:13.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.190+0000 7fc2f3852640 1 -- 10.20.193.76:0/1836088679 wait complete. 2026-02-25T17:21:13.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705755 got 38654705756 for osd.1 2026-02-25T17:21:13.201 DEBUG:teuthology.parallel:result is None 2026-02-25T17:21:13.201 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-25T17:21:13.201 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T17:21:13.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.305+0000 7f275a327640 1 Processor -- start 2026-02-25T17:21:13.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.305+0000 7f275a327640 1 -- start start 2026-02-25T17:21:13.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.305+0000 7f275a327640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f275406f210 0x7f2754070b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.305+0000 7f275a327640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f2754133c20 0x7f2754136010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.306+0000 7f275a327640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f275409d9a0 con 0x7f275406fcc0 2026-02-25T17:21:13.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.306+0000 7f275a327640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2754070560 con 0x7f2754133c20 2026-02-25T17:21:13.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.306+0000 7f275a327640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27540992e0 con 0x7f275406f210 2026-02-25T17:21:13.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.306+0000 7f2753fff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f275406f210 0x7f2754070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.306+0000 7f2753fff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f275406f210 0x7f2754070b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:42130/0 (socket says 10.20.193.76:42130) 2026-02-25T17:21:13.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.306+0000 7f2753fff640 1 -- 10.20.193.76:0/1467568272 learned_addr learned my addr 10.20.193.76:0/1467568272 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:13.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.306+0000 7f275889d640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f2754133c20 0x7f2754136010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.306+0000 7f27537fe640 1 --1- 10.20.193.76:0/1467568272 >> v1:10.20.193.76:6789/0 conn(0x7f275406fcc0 0x7f2754071070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:47004/0 (socket says 10.20.193.76:47004) 2026-02-25T17:21:13.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.306+0000 7f2752ffd640 1 -- 10.20.193.76:0/1467568272 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195460440 0 0) 0x7f275409d9a0 con 0x7f275406fcc0 2026-02-25T17:21:13.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.306+0000 7f2753fff640 1 -- 10.20.193.76:0/1467568272 >> v2:10.20.193.76:3300/0 conn(0x7f2754133c20 msgr2=0x7f2754136010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:13.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.306+0000 7f2753fff640 1 --2- 10.20.193.76:0/1467568272 >> v2:10.20.193.76:3300/0 conn(0x7f2754133c20 0x7f2754136010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.306+0000 7f2753fff640 1 -- 10.20.193.76:0/1467568272 >> v1:10.20.193.76:6789/0 conn(0x7f275406fcc0 legacy=0x7f2754071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.306+0000 7f2753fff640 1 -- 10.20.193.76:0/1467568272 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2754070870 con 0x7f275406f210 2026-02-25T17:21:13.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.306+0000 7f2753fff640 1 --2- 10.20.193.76:0/1467568272 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f275406f210 0x7f2754070b30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2740009970 tx=0x7f274002ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4f29469501357bc server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:13.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.306+0000 7f2752ffd640 1 -- 10.20.193.76:0/1467568272 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274002fb10 con 0x7f275406f210 2026-02-25T17:21:13.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.306+0000 7f2752ffd640 1 -- 10.20.193.76:0/1467568272 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274002fc70 con 0x7f275406f210 2026-02-25T17:21:13.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.306+0000 7f2752ffd640 1 -- 10.20.193.76:0/1467568272 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740037440 con 0x7f275406f210 2026-02-25T17:21:13.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.307+0000 7f275a327640 1 -- 10.20.193.76:0/1467568272 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f275406f210 msgr2=0x7f2754070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.307+0000 7f275a327640 1 --2- 10.20.193.76:0/1467568272 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f275406f210 0x7f2754070b30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2740009970 tx=0x7f274002ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:13.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.307+0000 7f275a327640 1 -- 10.20.193.76:0/1467568272 shutdown_connections 2026-02-25T17:21:13.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.307+0000 7f275a327640 1 --2- 10.20.193.76:0/1467568272 >> v2:10.20.193.76:3300/0 conn(0x7f2754133c20 0x7f2754136010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.307+0000 7f275a327640 1 --2- 10.20.193.76:0/1467568272 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f275406f210 0x7f2754070b30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.307+0000 7f275a327640 1 -- 10.20.193.76:0/1467568272 >> 10.20.193.76:0/1467568272 conn(0x7f275409a960 msgr2=0x7f275409ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:13.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.307+0000 7f275a327640 1 -- 10.20.193.76:0/1467568272 shutdown_connections 2026-02-25T17:21:13.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.307+0000 7f275a327640 1 -- 10.20.193.76:0/1467568272 wait complete. 2026-02-25T17:21:13.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f275a327640 1 Processor -- start 2026-02-25T17:21:13.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f275a327640 1 -- start start 2026-02-25T17:21:13.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f275a327640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f275406f210 0x7f2754090fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f275a327640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f275406fcc0 0x7f27540914f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f275a327640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2754133c20 0x7f2754091a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f275a327640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2754094370 con 0x7f275406fcc0 2026-02-25T17:21:13.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f275a327640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2754094680 con 0x7f2754133c20 2026-02-25T17:21:13.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f275a327640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2754092980 con 0x7f275406f210 2026-02-25T17:21:13.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f27537fe640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f275406fcc0 0x7f27540914f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f275889d640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2754133c20 0x7f2754091a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f27537fe640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f275406fcc0 0x7f27540914f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:39444/0 (socket says 10.20.193.76:39444) 2026-02-25T17:21:13.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f27537fe640 1 -- 10.20.193.76:0/921901097 learned_addr learned my addr 10.20.193.76:0/921901097 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:13.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f2753fff640 1 --2- 10.20.193.76:0/921901097 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f275406f210 0x7f2754090fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f275889d640 1 -- 10.20.193.76:0/921901097 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f275406f210 msgr2=0x7f2754090fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f275889d640 1 --2- 10.20.193.76:0/921901097 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f275406f210 0x7f2754090fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f275889d640 1 -- 10.20.193.76:0/921901097 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f275406fcc0 msgr2=0x7f27540914f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f275889d640 1 --2- 10.20.193.76:0/921901097 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f275406fcc0 0x7f27540914f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f275889d640 1 -- 10.20.193.76:0/921901097 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27400095d0 con 0x7f2754133c20 2026-02-25T17:21:13.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f27537fe640 1 --2- 10.20.193.76:0/921901097 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f275406fcc0 0x7f27540914f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:13.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f275889d640 1 --2- 10.20.193.76:0/921901097 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2754133c20 0x7f2754091a30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f274800efc0 tx=0x7f274800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:13.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f2750ff9640 1 -- 10.20.193.76:0/921901097 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748006ea0 con 0x7f2754133c20 2026-02-25T17:21:13.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f2750ff9640 1 -- 10.20.193.76:0/921901097 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274800f040 con 0x7f2754133c20 2026-02-25T17:21:13.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f275a327640 1 -- 10.20.193.76:0/921901097 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2754093260 con 0x7f2754133c20 2026-02-25T17:21:13.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f2750ff9640 1 -- 10.20.193.76:0/921901097 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27480146c0 con 0x7f2754133c20 2026-02-25T17:21:13.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.308+0000 7f275a327640 1 -- 10.20.193.76:0/921901097 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2754098410 con 0x7f2754133c20 2026-02-25T17:21:13.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.309+0000 7f275a327640 1 -- 10.20.193.76:0/921901097 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2754098630 con 0x7f2754133c20 2026-02-25T17:21:13.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.309+0000 7f2750ff9640 1 -- 10.20.193.76:0/921901097 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 9) v1 ==== 61950+0+0 (secure 0 0 0) 0x7f2748024020 con 0x7f2754133c20 2026-02-25T17:21:13.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.309+0000 7f2750ff9640 1 -- 10.20.193.76:0/921901097 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3021+0+0 (secure 0 0 0) 0x7f2748067190 con 0x7f2754133c20 2026-02-25T17:21:13.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.311+0000 7f2750ff9640 1 -- 10.20.193.76:0/921901097 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f2748040b90 con 0x7f2754133c20 2026-02-25T17:21:13.376 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.374+0000 7f275a327640 1 -- 10.20.193.76:0/921901097 --> v1:10.20.193.76:6800/1563581135 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2754071990 con 0x7f272404f7f0 2026-02-25T17:21:13.377 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.375+0000 7f2750ff9640 1 -- 10.20.193.76:0/921901097 <== mgr.14104 v1:10.20.193.76:6800/1563581135 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+39662 (unknown 2965378022 0 2204392836) 0x7f274002f910 con 0x7f272404f7f0 2026-02-25T17:21:13.378 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:13.378 INFO:teuthology.orchestra.run.trial076.stderr:dumped all 2026-02-25T17:21:13.378 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.376+0000 7f275a327640 1 -- 10.20.193.76:0/921901097 >> v1:10.20.193.76:6800/1563581135 conn(0x7f272404f7f0 legacy=0x7f2724051cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.378 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.376+0000 7f275a327640 1 -- 10.20.193.76:0/921901097 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2754133c20 msgr2=0x7f2754091a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.378 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.376+0000 7f275a327640 1 --2- 10.20.193.76:0/921901097 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2754133c20 0x7f2754091a30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f274800efc0 tx=0x7f274800c490 comp rx=0 tx=0).stop 2026-02-25T17:21:13.378 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.376+0000 7f275a327640 1 -- 10.20.193.76:0/921901097 shutdown_connections 2026-02-25T17:21:13.378 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.376+0000 7f275a327640 1 --2- 10.20.193.76:0/921901097 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2754133c20 0x7f2754091a30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.378 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.376+0000 7f275a327640 1 --2- 10.20.193.76:0/921901097 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f275406fcc0 0x7f27540914f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.378 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.376+0000 7f275a327640 1 --2- 10.20.193.76:0/921901097 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f275406f210 0x7f2754090fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.378 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.376+0000 7f275a327640 1 -- 10.20.193.76:0/921901097 >> 10.20.193.76:0/921901097 conn(0x7f275409a960 msgr2=0x7f275406cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:13.378 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.376+0000 7f275a327640 1 -- 10.20.193.76:0/921901097 shutdown_connections 2026-02-25T17:21:13.378 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.376+0000 7f275a327640 1 -- 10.20.193.76:0/921901097 wait complete. 2026-02-25T17:21:13.386 INFO:teuthology.orchestra.run.trial076.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2026-02-25T17:21:13.045682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1191116,"kb_used_data":1692,"kb_used_omap":6,"kb_used_meta":1189369,"kb_avail":376296244,"statfs":{"total":386547056640,"available":385327353856,"internally_reserved":0,"allocated":1732608,"data_stored":1334145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6812,"internal_metadata":1217914212},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.999183"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-25T17:13:48.773082+0000","last_change":"2026-02-25T17:13:46.024572+0000","last_active":"2026-02-25T17:13:48.773082+0000","last_peered":"2026-02-25T17:13:48.773082+0000","last_clean":"2026-02-25T17:13:48.773082+0000","last_became_active":"2026-02-25T17:13:44.018312+0000","last_became_peered":"2026-02-25T17:13:44.018312+0000","last_unstale":"2026-02-25T17:13:48.773082+0000","last_undegraded":"2026-02-25T17:13:48.773082+0000","last_fullsized":"2026-02-25T17:13:48.773082+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:41:46.767654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031831399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T17:13:56.997618+0000","last_change":"2026-02-25T17:13:46.024490+0000","last_active":"2026-02-25T17:13:56.997618+0000","last_peered":"2026-02-25T17:13:56.997618+0000","last_clean":"2026-02-25T17:13:56.997618+0000","last_became_active":"2026-02-25T17:13:44.019254+0000","last_became_peered":"2026-02-25T17:13:44.019254+0000","last_unstale":"2026-02-25T17:13:56.997618+0000","last_undegraded":"2026-02-25T17:13:56.997618+0000","last_fullsized":"2026-02-25T17:13:56.997618+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:48:23.306312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000395898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-25T17:13:48.855292+0000","last_change":"2026-02-25T17:13:46.576458+0000","last_active":"2026-02-25T17:13:48.855292+0000","last_peered":"2026-02-25T17:13:48.855292+0000","last_clean":"2026-02-25T17:13:48.855292+0000","last_became_active":"2026-02-25T17:13:44.018968+0000","last_became_peered":"2026-02-25T17:13:44.018968+0000","last_unstale":"2026-02-25T17:13:48.855292+0000","last_undegraded":"2026-02-25T17:13:48.855292+0000","last_fullsized":"2026-02-25T17:13:48.855292+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:15:44.166699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026897200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T17:13:56.997628+0000","last_change":"2026-02-25T17:13:46.024416+0000","last_active":"2026-02-25T17:13:56.997628+0000","last_peered":"2026-02-25T17:13:56.997628+0000","last_clean":"2026-02-25T17:13:56.997628+0000","last_became_active":"2026-02-25T17:13:44.019416+0000","last_became_peered":"2026-02-25T17:13:44.019416+0000","last_unstale":"2026-02-25T17:13:56.997628+0000","last_undegraded":"2026-02-25T17:13:56.997628+0000","last_fullsized":"2026-02-25T17:13:56.997628+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:16:00.062278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038440700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"11'72","reported_seq":103,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T17:13:56.997606+0000","last_change":"2026-02-25T17:13:44.018232+0000","last_active":"2026-02-25T17:13:56.997606+0000","last_peered":"2026-02-25T17:13:56.997606+0000","last_clean":"2026-02-25T17:13:56.997606+0000","last_became_active":"2026-02-25T17:13:44.018033+0000","last_became_peered":"2026-02-25T17:13:44.018033+0000","last_unstale":"2026-02-25T17:13:56.997606+0000","last_undegraded":"2026-02-25T17:13:56.997606+0000","last_fullsized":"2026-02-25T17:13:56.997606+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:10:56.453439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":18,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-25T17:13:48.773130+0000","last_change":"2026-02-25T17:13:46.024573+0000","last_active":"2026-02-25T17:13:48.773130+0000","last_peered":"2026-02-25T17:13:48.773130+0000","last_clean":"2026-02-25T17:13:48.773130+0000","last_became_active":"2026-02-25T17:13:44.018918+0000","last_became_peered":"2026-02-25T17:13:44.018918+0000","last_unstale":"2026-02-25T17:13:48.773130+0000","last_undegraded":"2026-02-25T17:13:48.773130+0000","last_fullsized":"2026-02-25T17:13:48.773130+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:19:18.292757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033429400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T17:13:56.778503+0000","last_change":"2026-02-25T17:13:46.028392+0000","last_active":"2026-02-25T17:13:56.778503+0000","last_peered":"2026-02-25T17:13:56.778503+0000","last_clean":"2026-02-25T17:13:56.778503+0000","last_became_active":"2026-02-25T17:13:44.019411+0000","last_became_peered":"2026-02-25T17:13:44.019411+0000","last_unstale":"2026-02-25T17:13:56.778503+0000","last_undegraded":"2026-02-25T17:13:56.778503+0000","last_fullsized":"2026-02-25T17:13:56.778503+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:09:30.409157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083336499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T17:13:56.997627+0000","last_change":"2026-02-25T17:13:46.024608+0000","last_active":"2026-02-25T17:13:56.997627+0000","last_peered":"2026-02-25T17:13:56.997627+0000","last_clean":"2026-02-25T17:13:56.997627+0000","last_became_active":"2026-02-25T17:13:44.019272+0000","last_became_peered":"2026-02-25T17:13:44.019272+0000","last_unstale":"2026-02-25T17:13:56.997627+0000","last_undegraded":"2026-02-25T17:13:56.997627+0000","last_fullsized":"2026-02-25T17:13:56.997627+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:15:11.987772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054556799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-25T17:13:48.773069+0000","last_change":"2026-02-25T17:13:46.024834+0000","last_active":"2026-02-25T17:13:48.773069+0000","last_peered":"2026-02-25T17:13:48.773069+0000","last_clean":"2026-02-25T17:13:48.773069+0000","last_became_active":"2026-02-25T17:13:44.019210+0000","last_became_peered":"2026-02-25T17:13:44.019210+0000","last_unstale":"2026-02-25T17:13:48.773069+0000","last_undegraded":"2026-02-25T17:13:48.773069+0000","last_fullsized":"2026-02-25T17:13:48.773069+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:39:00.658143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056038500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705756,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":733184,"data_stored":630663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":304478553},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 25 17:20:58 2026","interfaces":[{"interface":"back","average":{"1min":0.11700000000000001,"5min":0.109,"15min":0.13},"min":{"1min":0.090999999999999998,"5min":0.074999999999999997,"15min":0.074999999999999997},"max":{"1min":0.21099999999999999,"5min":0.23899999999999999,"15min":0.27300000000000002},"last":0.14799999999999999},{"interface":"front","average":{"1min":0.13100000000000001,"5min":0.128,"15min":0.153},"min":{"1min":0.105,"5min":0.085000000000000006,"15min":0.085000000000000006},"max":{"1min":0.193,"5min":0.26500000000000001,"15min":0.29899999999999999},"last":0.159}]},{"osd":1,"last update":"Wed Feb 25 17:20:58 2026","interfaces":[{"interface":"back","average":{"1min":0.154,"5min":0.14799999999999999,"15min":0.16600000000000001},"min":{"1min":0.115,"5min":0.098000000000000004,"15min":0.098000000000000004},"max":{"1min":0.23699999999999999,"5min":0.28499999999999998,"15min":0.33700000000000002},"last":0.13700000000000001},{"interface":"front","average":{"1min":0.157,"5min":0.14299999999999999,"15min":0.16800000000000001},"min":{"1min":0.11899999999999999,"5min":0.085999999999999993,"15min":0.085999999999999993},"max":{"1min":0.22,"5min":0.26100000000000001,"15min":0.30599999999999999},"last":0.19}]},{"osd":2,"last update":"Wed Feb 25 17:20:58 2026","interfaces":[{"interface":"back","average":{"1min":0.17199999999999999,"5min":0.161,"15min":0.184},"min":{"1min":0.12,"5min":0.11600000000000001,"15min":0.11600000000000001},"max":{"1min":0.246,"5min":0.27600000000000002,"15min":0.34899999999999998},"last":0.16900000000000001},{"interface":"front","average":{"1min":0.158,"5min":0.14799999999999999,"15min":0.17699999999999999},"min":{"1min":0.123,"5min":0.10299999999999999,"15min":0.10299999999999999},"max":{"1min":0.252,"5min":0.26000000000000001,"15min":0.32200000000000001},"last":0.20100000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705756,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":131072,"data_stored":36867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":304478553},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 25 17:20:57 2026","interfaces":[{"interface":"back","average":{"1min":0.11700000000000001,"5min":0.109,"15min":0.122},"min":{"1min":0.060999999999999999,"5min":0.059999999999999998,"15min":0.059999999999999998},"max":{"1min":0.183,"5min":0.23400000000000001,"15min":0.23400000000000001},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.12,"5min":0.124,"15min":0.13800000000000001},"min":{"1min":0.079000000000000001,"5min":0.079000000000000001,"15min":0.079000000000000001},"max":{"1min":0.14799999999999999,"5min":0.187,"15min":0.22500000000000001},"last":0.11700000000000001}]},{"osd":1,"last update":"Wed Feb 25 17:20:57 2026","interfaces":[{"interface":"back","average":{"1min":0.13600000000000001,"5min":0.13400000000000001,"15min":0.156},"min":{"1min":0.106,"5min":0.096000000000000002,"15min":0.096000000000000002},"max":{"1min":0.19600000000000001,"5min":0.21299999999999999,"15min":0.30099999999999999},"last":0.157},{"interface":"front","average":{"1min":0.14699999999999999,"5min":0.13300000000000001,"15min":0.14899999999999999},"min":{"1min":0.092999999999999999,"5min":0.086999999999999994,"15min":0.086999999999999994},"max":{"1min":0.20499999999999999,"5min":0.20799999999999999,"15min":0.27400000000000002},"last":0.188}]},{"osd":3,"last update":"Wed Feb 25 17:20:57 2026","interfaces":[{"interface":"back","average":{"1min":0.153,"5min":0.14599999999999999,"15min":0.158},"min":{"1min":0.11899999999999999,"5min":0.090999999999999998,"15min":0.090999999999999998},"max":{"1min":0.19600000000000001,"5min":0.23899999999999999,"15min":0.28100000000000003},"last":0.14399999999999999},{"interface":"front","average":{"1min":0.159,"5min":0.152,"15min":0.17199999999999999},"min":{"1min":0.129,"5min":0.106,"15min":0.106},"max":{"1min":0.191,"5min":0.245,"15min":0.34699999999999998},"last":0.17100000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705756,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":729088,"data_stored":627254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":304478553},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 25 17:20:59 2026","interfaces":[{"interface":"back","average":{"1min":0.112,"5min":0.114,"15min":0.11899999999999999},"min":{"1min":0.064000000000000001,"5min":0.064000000000000001,"15min":0.064000000000000001},"max":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.13800000000000001,"5min":0.13,"15min":0.13300000000000001},"min":{"1min":0.096000000000000002,"5min":0.073999999999999996,"15min":0.073999999999999996},"max":{"1min":0.318,"5min":0.318,"15min":0.318},"last":0.20000000000000001}]},{"osd":2,"last update":"Wed Feb 25 17:20:59 2026","interfaces":[{"interface":"back","average":{"1min":0.14099999999999999,"5min":0.13300000000000001,"15min":0.14199999999999999},"min":{"1min":0.091999999999999998,"5min":0.083000000000000004,"15min":0.083000000000000004},"max":{"1min":0.31,"5min":0.31,"15min":0.31},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.14199999999999999,"5min":0.14099999999999999,"15min":0.14699999999999999},"min":{"1min":0.096000000000000002,"5min":0.096000000000000002,"15min":0.095000000000000001},"max":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"last":0.223}]},{"osd":3,"last update":"Wed Feb 25 17:20:59 2026","interfaces":[{"interface":"back","average":{"1min":0.161,"5min":0.151,"15min":0.16200000000000001},"min":{"1min":0.122,"5min":0.088999999999999996,"15min":0.088999999999999996},"max":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.16300000000000001,"5min":0.155,"15min":0.17599999999999999},"min":{"1min":0.128,"5min":0.096000000000000002,"15min":0.096000000000000002},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.36899999999999999},"last":0.252}]}]},{"osd":0,"up_from":9,"seq":38654705757,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":139264,"data_stored":39361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":304478553},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 25 17:21:03 2026","interfaces":[{"interface":"back","average":{"1min":0.13400000000000001,"5min":0.113,"15min":0.124},"min":{"1min":0.078,"5min":0.073999999999999996,"15min":0.073999999999999996},"max":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"last":0.153},{"interface":"front","average":{"1min":0.13600000000000001,"5min":0.129,"15min":0.14499999999999999},"min":{"1min":0.090999999999999998,"5min":0.081000000000000003,"15min":0.072999999999999995},"max":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"last":0.16800000000000001}]},{"osd":2,"last update":"Wed Feb 25 17:21:03 2026","interfaces":[{"interface":"back","average":{"1min":0.151,"5min":0.14399999999999999,"15min":0.159},"min":{"1min":0.106,"5min":0.083000000000000004,"15min":0.083000000000000004},"max":{"1min":0.377,"5min":0.377,"15min":0.377},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.155,"5min":0.14000000000000001,"15min":0.154},"min":{"1min":0.073999999999999996,"5min":0.073999999999999996,"15min":0.073999999999999996},"max":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"last":0.20000000000000001}]},{"osd":3,"last update":"Wed Feb 25 17:21:03 2026","interfaces":[{"interface":"back","average":{"1min":0.17100000000000001,"5min":0.155,"15min":0.17399999999999999},"min":{"1min":0.085999999999999993,"5min":0.085999999999999993,"15min":0.085999999999999993},"max":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"last":0.219},{"interface":"front","average":{"1min":0.155,"5min":0.14599999999999999,"15min":0.16600000000000001},"min":{"1min":0.081000000000000003,"5min":0.081000000000000003,"15min":0.081000000000000003},"max":{"1min":0.37,"5min":0.37,"15min":0.37},"last":0.23200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T17:21:13.388 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T17:21:13.458 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.451+0000 7f3b37db1640 1 Processor -- start 2026-02-25T17:21:13.458 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.452+0000 7f3b37db1640 1 -- start start 2026-02-25T17:21:13.458 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.452+0000 7f3b37db1640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f3b3006dfd0 0x7f3b3006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.459 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.452+0000 7f3b37db1640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3b3006e8f0 0x7f3b300980d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.459 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.452+0000 7f3b37db1640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3b30098610 0x7f3b30098ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.459 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.452+0000 7f3b37db1640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b30099190 con 0x7f3b3006dfd0 2026-02-25T17:21:13.459 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.452+0000 7f3b37db1640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3008c910 con 0x7f3b3006e8f0 2026-02-25T17:21:13.459 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.452+0000 7f3b37db1640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3008c700 con 0x7f3b30098610 2026-02-25T17:21:13.459 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.452+0000 7f3b35325640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3b3006e8f0 0x7f3b300980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.459 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.452+0000 7f3b35b26640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f3b3006dfd0 0x7f3b3006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.459 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.452+0000 7f3b35325640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3b3006e8f0 0x7f3b300980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:42140/0 (socket says 10.20.193.76:42140) 2026-02-25T17:21:13.459 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.452+0000 7f3b35325640 1 -- 10.20.193.76:0/1083361737 learned_addr learned my addr 10.20.193.76:0/1083361737 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:13.459 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.452+0000 7f3b36327640 1 --2- 10.20.193.76:0/1083361737 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3b30098610 0x7f3b30098ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.459 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.452+0000 7f3b35325640 1 -- 10.20.193.76:0/1083361737 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3b30098610 msgr2=0x7f3b30098ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:13.459 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.452+0000 7f3b35325640 1 --2- 10.20.193.76:0/1083361737 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3b30098610 0x7f3b30098ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.460 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.452+0000 7f3b35325640 1 -- 10.20.193.76:0/1083361737 >> v2:10.20.193.76:3300/0 conn(0x7f3b3006dfd0 msgr2=0x7f3b3006e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:13.460 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.452+0000 7f3b35325640 1 --2- 10.20.193.76:0/1083361737 >> v2:10.20.193.76:3300/0 conn(0x7f3b3006dfd0 0x7f3b3006e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.460 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.452+0000 7f3b35325640 1 -- 10.20.193.76:0/1083361737 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3009d9a0 con 0x7f3b3006e8f0 2026-02-25T17:21:13.460 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.452+0000 7f3b35325640 1 --2- 10.20.193.76:0/1083361737 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3b3006e8f0 0x7f3b300980d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3b24009970 tx=0x7f3b2402eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f288d74b21bd6798 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:13.460 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.453+0000 7f3b34b24640 1 -- 10.20.193.76:0/1083361737 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2402fb60 con 0x7f3b3006e8f0 2026-02-25T17:21:13.460 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.453+0000 7f3b34b24640 1 -- 10.20.193.76:0/1083361737 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2402fcc0 con 0x7f3b3006e8f0 2026-02-25T17:21:13.460 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.453+0000 7f3b34b24640 1 -- 10.20.193.76:0/1083361737 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24037660 con 0x7f3b3006e8f0 2026-02-25T17:21:13.460 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.453+0000 7f3b37db1640 1 -- 10.20.193.76:0/1083361737 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3b3006e8f0 msgr2=0x7f3b300980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.460 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.453+0000 7f3b37db1640 1 --2- 10.20.193.76:0/1083361737 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3b3006e8f0 0x7f3b300980d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3b24009970 tx=0x7f3b2402eef0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.460 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.453+0000 7f3b37db1640 1 -- 10.20.193.76:0/1083361737 shutdown_connections 2026-02-25T17:21:13.460 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.453+0000 7f3b37db1640 1 --2- 10.20.193.76:0/1083361737 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3b30098610 0x7f3b30098ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.461 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.453+0000 7f3b37db1640 1 --2- 10.20.193.76:0/1083361737 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3b3006e8f0 0x7f3b300980d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.461 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.453+0000 7f3b37db1640 1 --2- 10.20.193.76:0/1083361737 >> v2:10.20.193.76:3300/0 conn(0x7f3b3006dfd0 0x7f3b3006e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.461 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.453+0000 7f3b37db1640 1 -- 10.20.193.76:0/1083361737 >> 10.20.193.76:0/1083361737 conn(0x7f3b3009a960 msgr2=0x7f3b3009ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:13.461 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.453+0000 7f3b37db1640 1 -- 10.20.193.76:0/1083361737 shutdown_connections 2026-02-25T17:21:13.461 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.453+0000 7f3b37db1640 1 -- 10.20.193.76:0/1083361737 wait complete. 2026-02-25T17:21:13.461 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.453+0000 7f3b37db1640 1 Processor -- start 2026-02-25T17:21:13.461 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.453+0000 7f3b37db1640 1 -- start start 2026-02-25T17:21:13.461 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b37db1640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3b3006dfd0 0x7f3b301c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.461 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b37db1640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3b3006e8f0 0x7f3b301c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.461 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b37db1640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3b30098610 0x7f3b30131c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.461 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b37db1640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b300713d0 con 0x7f3b3006dfd0 2026-02-25T17:21:13.461 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b37db1640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3006ffb0 con 0x7f3b30098610 2026-02-25T17:21:13.462 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b37db1640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3b301c6260 con 0x7f3b3006e8f0 2026-02-25T17:21:13.462 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b35325640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3b3006e8f0 0x7f3b301c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.462 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b35b26640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3b3006dfd0 0x7f3b301c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.462 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b35325640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3b3006e8f0 0x7f3b301c5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:48742/0 (socket says 10.20.193.76:48742) 2026-02-25T17:21:13.462 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b35325640 1 -- 10.20.193.76:0/2750492140 learned_addr learned my addr 10.20.193.76:0/2750492140 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:13.462 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b36327640 1 --2- 10.20.193.76:0/2750492140 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3b30098610 0x7f3b30131c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.462 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b35325640 1 -- 10.20.193.76:0/2750492140 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3b30098610 msgr2=0x7f3b30131c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.462 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b35325640 1 --2- 10.20.193.76:0/2750492140 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3b30098610 0x7f3b30131c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.462 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b35325640 1 -- 10.20.193.76:0/2750492140 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3b3006dfd0 msgr2=0x7f3b301c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.462 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b35325640 1 --2- 10.20.193.76:0/2750492140 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3b3006dfd0 0x7f3b301c57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.462 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b35325640 1 -- 10.20.193.76:0/2750492140 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b240095d0 con 0x7f3b3006e8f0 2026-02-25T17:21:13.462 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b35325640 1 --2- 10.20.193.76:0/2750492140 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3b3006e8f0 0x7f3b301c5d20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3b2402f400 tx=0x7f3b240047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:13.463 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b1e7fc640 1 -- 10.20.193.76:0/2750492140 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24040660 con 0x7f3b3006e8f0 2026-02-25T17:21:13.463 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b1e7fc640 1 -- 10.20.193.76:0/2750492140 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b240407c0 con 0x7f3b3006e8f0 2026-02-25T17:21:13.463 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b37db1640 1 -- 10.20.193.76:0/2750492140 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b300701f0 con 0x7f3b3006e8f0 2026-02-25T17:21:13.463 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b1e7fc640 1 -- 10.20.193.76:0/2750492140 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24040b70 con 0x7f3b3006e8f0 2026-02-25T17:21:13.463 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b37db1640 1 -- 10.20.193.76:0/2750492140 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b30070f10 con 0x7f3b3006e8f0 2026-02-25T17:21:13.463 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.454+0000 7f3b37db1640 1 -- 10.20.193.76:0/2750492140 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b300718c0 con 0x7f3b3006e8f0 2026-02-25T17:21:13.463 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.455+0000 7f3b1e7fc640 1 -- 10.20.193.76:0/2750492140 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 9) v1 ==== 61950+0+0 (secure 0 0 0) 0x7f3b24049020 con 0x7f3b3006e8f0 2026-02-25T17:21:13.463 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.455+0000 7f3b1e7fc640 1 -- 10.20.193.76:0/2750492140 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3021+0+0 (secure 0 0 0) 0x7f3b2408bb50 con 0x7f3b3006e8f0 2026-02-25T17:21:13.464 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.457+0000 7f3b1e7fc640 1 -- 10.20.193.76:0/2750492140 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f3b300718c0 con 0x7f3b3006e8f0 2026-02-25T17:21:13.523 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.521+0000 7f3b37db1640 1 -- 10.20.193.76:0/2750492140 --> v1:10.20.193.76:6800/1563581135 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b30071ed0 con 0x7f3b0004f820 2026-02-25T17:21:13.524 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.521+0000 7f3b1e7fc640 1 -- 10.20.193.76:0/2750492140 <== mgr.14104 v1:10.20.193.76:6800/1563581135 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+39662 (unknown 2965378022 0 2204392836) 0x7f3b20009840 con 0x7f3b0004f820 2026-02-25T17:21:13.524 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:13.526 INFO:teuthology.orchestra.run.trial076.stderr:dumped all 2026-02-25T17:21:13.526 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.522+0000 7f3b37db1640 1 -- 10.20.193.76:0/2750492140 >> v1:10.20.193.76:6800/1563581135 conn(0x7f3b0004f820 legacy=0x7f3b00051ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.526 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.522+0000 7f3b37db1640 1 -- 10.20.193.76:0/2750492140 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3b3006e8f0 msgr2=0x7f3b301c5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.526 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.522+0000 7f3b37db1640 1 --2- 10.20.193.76:0/2750492140 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3b3006e8f0 0x7f3b301c5d20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3b2402f400 tx=0x7f3b240047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.526 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.522+0000 7f3b37db1640 1 -- 10.20.193.76:0/2750492140 shutdown_connections 2026-02-25T17:21:13.526 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.522+0000 7f3b37db1640 1 --2- 10.20.193.76:0/2750492140 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3b30098610 0x7f3b30131c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.526 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.522+0000 7f3b37db1640 1 --2- 10.20.193.76:0/2750492140 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3b3006e8f0 0x7f3b301c5d20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.526 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.522+0000 7f3b37db1640 1 --2- 10.20.193.76:0/2750492140 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3b3006dfd0 0x7f3b301c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.526 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.522+0000 7f3b37db1640 1 -- 10.20.193.76:0/2750492140 >> 10.20.193.76:0/2750492140 conn(0x7f3b3009a960 msgr2=0x7f3b3006c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:13.526 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.522+0000 7f3b37db1640 1 -- 10.20.193.76:0/2750492140 shutdown_connections 2026-02-25T17:21:13.527 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.522+0000 7f3b37db1640 1 -- 10.20.193.76:0/2750492140 wait complete. 2026-02-25T17:21:13.532 INFO:teuthology.orchestra.run.trial076.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2026-02-25T17:21:13.045682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1191116,"kb_used_data":1692,"kb_used_omap":6,"kb_used_meta":1189369,"kb_avail":376296244,"statfs":{"total":386547056640,"available":385327353856,"internally_reserved":0,"allocated":1732608,"data_stored":1334145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6812,"internal_metadata":1217914212},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.999183"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-25T17:13:48.773082+0000","last_change":"2026-02-25T17:13:46.024572+0000","last_active":"2026-02-25T17:13:48.773082+0000","last_peered":"2026-02-25T17:13:48.773082+0000","last_clean":"2026-02-25T17:13:48.773082+0000","last_became_active":"2026-02-25T17:13:44.018312+0000","last_became_peered":"2026-02-25T17:13:44.018312+0000","last_unstale":"2026-02-25T17:13:48.773082+0000","last_undegraded":"2026-02-25T17:13:48.773082+0000","last_fullsized":"2026-02-25T17:13:48.773082+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:41:46.767654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031831399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T17:13:56.997618+0000","last_change":"2026-02-25T17:13:46.024490+0000","last_active":"2026-02-25T17:13:56.997618+0000","last_peered":"2026-02-25T17:13:56.997618+0000","last_clean":"2026-02-25T17:13:56.997618+0000","last_became_active":"2026-02-25T17:13:44.019254+0000","last_became_peered":"2026-02-25T17:13:44.019254+0000","last_unstale":"2026-02-25T17:13:56.997618+0000","last_undegraded":"2026-02-25T17:13:56.997618+0000","last_fullsized":"2026-02-25T17:13:56.997618+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:48:23.306312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000395898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-25T17:13:48.855292+0000","last_change":"2026-02-25T17:13:46.576458+0000","last_active":"2026-02-25T17:13:48.855292+0000","last_peered":"2026-02-25T17:13:48.855292+0000","last_clean":"2026-02-25T17:13:48.855292+0000","last_became_active":"2026-02-25T17:13:44.018968+0000","last_became_peered":"2026-02-25T17:13:44.018968+0000","last_unstale":"2026-02-25T17:13:48.855292+0000","last_undegraded":"2026-02-25T17:13:48.855292+0000","last_fullsized":"2026-02-25T17:13:48.855292+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:15:44.166699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026897200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T17:13:56.997628+0000","last_change":"2026-02-25T17:13:46.024416+0000","last_active":"2026-02-25T17:13:56.997628+0000","last_peered":"2026-02-25T17:13:56.997628+0000","last_clean":"2026-02-25T17:13:56.997628+0000","last_became_active":"2026-02-25T17:13:44.019416+0000","last_became_peered":"2026-02-25T17:13:44.019416+0000","last_unstale":"2026-02-25T17:13:56.997628+0000","last_undegraded":"2026-02-25T17:13:56.997628+0000","last_fullsized":"2026-02-25T17:13:56.997628+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:16:00.062278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038440700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"11'72","reported_seq":103,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T17:13:56.997606+0000","last_change":"2026-02-25T17:13:44.018232+0000","last_active":"2026-02-25T17:13:56.997606+0000","last_peered":"2026-02-25T17:13:56.997606+0000","last_clean":"2026-02-25T17:13:56.997606+0000","last_became_active":"2026-02-25T17:13:44.018033+0000","last_became_peered":"2026-02-25T17:13:44.018033+0000","last_unstale":"2026-02-25T17:13:56.997606+0000","last_undegraded":"2026-02-25T17:13:56.997606+0000","last_fullsized":"2026-02-25T17:13:56.997606+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:10:56.453439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":18,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-25T17:13:48.773130+0000","last_change":"2026-02-25T17:13:46.024573+0000","last_active":"2026-02-25T17:13:48.773130+0000","last_peered":"2026-02-25T17:13:48.773130+0000","last_clean":"2026-02-25T17:13:48.773130+0000","last_became_active":"2026-02-25T17:13:44.018918+0000","last_became_peered":"2026-02-25T17:13:44.018918+0000","last_unstale":"2026-02-25T17:13:48.773130+0000","last_undegraded":"2026-02-25T17:13:48.773130+0000","last_fullsized":"2026-02-25T17:13:48.773130+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T03:19:18.292757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033429400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":20,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T17:13:56.778503+0000","last_change":"2026-02-25T17:13:46.028392+0000","last_active":"2026-02-25T17:13:56.778503+0000","last_peered":"2026-02-25T17:13:56.778503+0000","last_clean":"2026-02-25T17:13:56.778503+0000","last_became_active":"2026-02-25T17:13:44.019411+0000","last_became_peered":"2026-02-25T17:13:44.019411+0000","last_unstale":"2026-02-25T17:13:56.778503+0000","last_undegraded":"2026-02-25T17:13:56.778503+0000","last_fullsized":"2026-02-25T17:13:56.778503+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:09:30.409157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083336499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-25T17:13:56.997627+0000","last_change":"2026-02-25T17:13:46.024608+0000","last_active":"2026-02-25T17:13:56.997627+0000","last_peered":"2026-02-25T17:13:56.997627+0000","last_clean":"2026-02-25T17:13:56.997627+0000","last_became_active":"2026-02-25T17:13:44.019272+0000","last_became_peered":"2026-02-25T17:13:44.019272+0000","last_unstale":"2026-02-25T17:13:56.997627+0000","last_undegraded":"2026-02-25T17:13:56.997627+0000","last_fullsized":"2026-02-25T17:13:56.997627+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:15:11.987772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054556799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2026-02-25T17:13:48.773069+0000","last_change":"2026-02-25T17:13:46.024834+0000","last_active":"2026-02-25T17:13:48.773069+0000","last_peered":"2026-02-25T17:13:48.773069+0000","last_clean":"2026-02-25T17:13:48.773069+0000","last_became_active":"2026-02-25T17:13:44.019210+0000","last_became_peered":"2026-02-25T17:13:44.019210+0000","last_unstale":"2026-02-25T17:13:48.773069+0000","last_undegraded":"2026-02-25T17:13:48.773069+0000","last_fullsized":"2026-02-25T17:13:48.773069+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:39:00.658143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056038500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705756,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":733184,"data_stored":630663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":304478553},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 25 17:20:58 2026","interfaces":[{"interface":"back","average":{"1min":0.11700000000000001,"5min":0.109,"15min":0.13},"min":{"1min":0.090999999999999998,"5min":0.074999999999999997,"15min":0.074999999999999997},"max":{"1min":0.21099999999999999,"5min":0.23899999999999999,"15min":0.27300000000000002},"last":0.14799999999999999},{"interface":"front","average":{"1min":0.13100000000000001,"5min":0.128,"15min":0.153},"min":{"1min":0.105,"5min":0.085000000000000006,"15min":0.085000000000000006},"max":{"1min":0.193,"5min":0.26500000000000001,"15min":0.29899999999999999},"last":0.159}]},{"osd":1,"last update":"Wed Feb 25 17:20:58 2026","interfaces":[{"interface":"back","average":{"1min":0.154,"5min":0.14799999999999999,"15min":0.16600000000000001},"min":{"1min":0.115,"5min":0.098000000000000004,"15min":0.098000000000000004},"max":{"1min":0.23699999999999999,"5min":0.28499999999999998,"15min":0.33700000000000002},"last":0.13700000000000001},{"interface":"front","average":{"1min":0.157,"5min":0.14299999999999999,"15min":0.16800000000000001},"min":{"1min":0.11899999999999999,"5min":0.085999999999999993,"15min":0.085999999999999993},"max":{"1min":0.22,"5min":0.26100000000000001,"15min":0.30599999999999999},"last":0.19}]},{"osd":2,"last update":"Wed Feb 25 17:20:58 2026","interfaces":[{"interface":"back","average":{"1min":0.17199999999999999,"5min":0.161,"15min":0.184},"min":{"1min":0.12,"5min":0.11600000000000001,"15min":0.11600000000000001},"max":{"1min":0.246,"5min":0.27600000000000002,"15min":0.34899999999999998},"last":0.16900000000000001},{"interface":"front","average":{"1min":0.158,"5min":0.14799999999999999,"15min":0.17699999999999999},"min":{"1min":0.123,"5min":0.10299999999999999,"15min":0.10299999999999999},"max":{"1min":0.252,"5min":0.26000000000000001,"15min":0.32200000000000001},"last":0.20100000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705756,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":131072,"data_stored":36867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":304478553},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 25 17:20:57 2026","interfaces":[{"interface":"back","average":{"1min":0.11700000000000001,"5min":0.109,"15min":0.122},"min":{"1min":0.060999999999999999,"5min":0.059999999999999998,"15min":0.059999999999999998},"max":{"1min":0.183,"5min":0.23400000000000001,"15min":0.23400000000000001},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.12,"5min":0.124,"15min":0.13800000000000001},"min":{"1min":0.079000000000000001,"5min":0.079000000000000001,"15min":0.079000000000000001},"max":{"1min":0.14799999999999999,"5min":0.187,"15min":0.22500000000000001},"last":0.11700000000000001}]},{"osd":1,"last update":"Wed Feb 25 17:20:57 2026","interfaces":[{"interface":"back","average":{"1min":0.13600000000000001,"5min":0.13400000000000001,"15min":0.156},"min":{"1min":0.106,"5min":0.096000000000000002,"15min":0.096000000000000002},"max":{"1min":0.19600000000000001,"5min":0.21299999999999999,"15min":0.30099999999999999},"last":0.157},{"interface":"front","average":{"1min":0.14699999999999999,"5min":0.13300000000000001,"15min":0.14899999999999999},"min":{"1min":0.092999999999999999,"5min":0.086999999999999994,"15min":0.086999999999999994},"max":{"1min":0.20499999999999999,"5min":0.20799999999999999,"15min":0.27400000000000002},"last":0.188}]},{"osd":3,"last update":"Wed Feb 25 17:20:57 2026","interfaces":[{"interface":"back","average":{"1min":0.153,"5min":0.14599999999999999,"15min":0.158},"min":{"1min":0.11899999999999999,"5min":0.090999999999999998,"15min":0.090999999999999998},"max":{"1min":0.19600000000000001,"5min":0.23899999999999999,"15min":0.28100000000000003},"last":0.14399999999999999},{"interface":"front","average":{"1min":0.159,"5min":0.152,"15min":0.17199999999999999},"min":{"1min":0.129,"5min":0.106,"15min":0.106},"max":{"1min":0.191,"5min":0.245,"15min":0.34699999999999998},"last":0.17100000000000001}]}]},{"osd":1,"up_from":9,"seq":38654705756,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":729088,"data_stored":627254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":304478553},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 25 17:20:59 2026","interfaces":[{"interface":"back","average":{"1min":0.112,"5min":0.114,"15min":0.11899999999999999},"min":{"1min":0.064000000000000001,"5min":0.064000000000000001,"15min":0.064000000000000001},"max":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.13800000000000001,"5min":0.13,"15min":0.13300000000000001},"min":{"1min":0.096000000000000002,"5min":0.073999999999999996,"15min":0.073999999999999996},"max":{"1min":0.318,"5min":0.318,"15min":0.318},"last":0.20000000000000001}]},{"osd":2,"last update":"Wed Feb 25 17:20:59 2026","interfaces":[{"interface":"back","average":{"1min":0.14099999999999999,"5min":0.13300000000000001,"15min":0.14199999999999999},"min":{"1min":0.091999999999999998,"5min":0.083000000000000004,"15min":0.083000000000000004},"max":{"1min":0.31,"5min":0.31,"15min":0.31},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.14199999999999999,"5min":0.14099999999999999,"15min":0.14699999999999999},"min":{"1min":0.096000000000000002,"5min":0.096000000000000002,"15min":0.095000000000000001},"max":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"last":0.223}]},{"osd":3,"last update":"Wed Feb 25 17:20:59 2026","interfaces":[{"interface":"back","average":{"1min":0.161,"5min":0.151,"15min":0.16200000000000001},"min":{"1min":0.122,"5min":0.088999999999999996,"15min":0.088999999999999996},"max":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.16300000000000001,"5min":0.155,"15min":0.17599999999999999},"min":{"1min":0.128,"5min":0.096000000000000002,"15min":0.096000000000000002},"max":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.36899999999999999},"last":0.252}]}]},{"osd":0,"up_from":9,"seq":38654705757,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":139264,"data_stored":39361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":304478553},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 25 17:21:03 2026","interfaces":[{"interface":"back","average":{"1min":0.13400000000000001,"5min":0.113,"15min":0.124},"min":{"1min":0.078,"5min":0.073999999999999996,"15min":0.073999999999999996},"max":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"last":0.153},{"interface":"front","average":{"1min":0.13600000000000001,"5min":0.129,"15min":0.14499999999999999},"min":{"1min":0.090999999999999998,"5min":0.081000000000000003,"15min":0.072999999999999995},"max":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"last":0.16800000000000001}]},{"osd":2,"last update":"Wed Feb 25 17:21:03 2026","interfaces":[{"interface":"back","average":{"1min":0.151,"5min":0.14399999999999999,"15min":0.159},"min":{"1min":0.106,"5min":0.083000000000000004,"15min":0.083000000000000004},"max":{"1min":0.377,"5min":0.377,"15min":0.377},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.155,"5min":0.14000000000000001,"15min":0.154},"min":{"1min":0.073999999999999996,"5min":0.073999999999999996,"15min":0.073999999999999996},"max":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"last":0.20000000000000001}]},{"osd":3,"last update":"Wed Feb 25 17:21:03 2026","interfaces":[{"interface":"back","average":{"1min":0.17100000000000001,"5min":0.155,"15min":0.17399999999999999},"min":{"1min":0.085999999999999993,"5min":0.085999999999999993,"15min":0.085999999999999993},"max":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"last":0.219},{"interface":"front","average":{"1min":0.155,"5min":0.14599999999999999,"15min":0.16600000000000001},"min":{"1min":0.081000000000000003,"5min":0.081000000000000003,"15min":0.081000000000000003},"max":{"1min":0.37,"5min":0.37,"15min":0.37},"last":0.23200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T17:21:13.533 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-25T17:21:13.534 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-25T17:21:13.534 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-25T17:21:13.534 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-25T17:21:13.604 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.598+0000 7ff650cc0640 1 Processor -- start 2026-02-25T17:21:13.604 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.598+0000 7ff650cc0640 1 -- start start 2026-02-25T17:21:13.604 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.598+0000 7ff650cc0640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff64c06dfd0 0x7ff64c06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.605 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.598+0000 7ff650cc0640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff64c06e8f0 0x7ff64c0980d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.605 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.598+0000 7ff650cc0640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7ff64c098610 0x7ff64c098aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.605 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.598+0000 7ff650cc0640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64c099190 con 0x7ff64c098610 2026-02-25T17:21:13.605 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.598+0000 7ff650cc0640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c08c910 con 0x7ff64c06e8f0 2026-02-25T17:21:13.605 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.598+0000 7ff650cc0640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c08c700 con 0x7ff64c06dfd0 2026-02-25T17:21:13.605 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.598+0000 7ff649d74640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff64c06e8f0 0x7ff64c0980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.605 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.598+0000 7ff64a575640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff64c06dfd0 0x7ff64c06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.605 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.598+0000 7ff64ad76640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7ff64c098610 0x7ff64c098aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.605 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.598+0000 7ff649d74640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff64c06e8f0 0x7ff64c0980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:42152/0 (socket says 10.20.193.76:42152) 2026-02-25T17:21:13.605 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.598+0000 7ff649d74640 1 -- 10.20.193.76:0/4279432438 learned_addr learned my addr 10.20.193.76:0/4279432438 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:13.605 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.598+0000 7ff649d74640 1 -- 10.20.193.76:0/4279432438 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff64c06dfd0 msgr2=0x7ff64c06e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:13.606 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.598+0000 7ff649d74640 1 --2- 10.20.193.76:0/4279432438 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff64c06dfd0 0x7ff64c06e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.606 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.598+0000 7ff649d74640 1 -- 10.20.193.76:0/4279432438 >> v2:10.20.193.76:3300/0 conn(0x7ff64c098610 msgr2=0x7ff64c098aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:13.606 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.598+0000 7ff649d74640 1 --2- 10.20.193.76:0/4279432438 >> v2:10.20.193.76:3300/0 conn(0x7ff64c098610 0x7ff64c098aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.606 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.598+0000 7ff649d74640 1 -- 10.20.193.76:0/4279432438 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c09d9a0 con 0x7ff64c06e8f0 2026-02-25T17:21:13.606 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.599+0000 7ff649d74640 1 --2- 10.20.193.76:0/4279432438 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff64c06e8f0 0x7ff64c0980d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff634009970 tx=0x7ff63402eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebd6320f478be961 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:13.606 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.599+0000 7ff649573640 1 -- 10.20.193.76:0/4279432438 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63402fb60 con 0x7ff64c06e8f0 2026-02-25T17:21:13.606 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.599+0000 7ff649573640 1 -- 10.20.193.76:0/4279432438 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63402fcc0 con 0x7ff64c06e8f0 2026-02-25T17:21:13.606 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.599+0000 7ff649573640 1 -- 10.20.193.76:0/4279432438 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff634037660 con 0x7ff64c06e8f0 2026-02-25T17:21:13.606 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.599+0000 7ff650cc0640 1 -- 10.20.193.76:0/4279432438 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff64c06e8f0 msgr2=0x7ff64c0980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.606 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.599+0000 7ff650cc0640 1 --2- 10.20.193.76:0/4279432438 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff64c06e8f0 0x7ff64c0980d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff634009970 tx=0x7ff63402eef0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.606 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.599+0000 7ff650cc0640 1 -- 10.20.193.76:0/4279432438 shutdown_connections 2026-02-25T17:21:13.606 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.599+0000 7ff650cc0640 1 --2- 10.20.193.76:0/4279432438 >> v2:10.20.193.76:3300/0 conn(0x7ff64c098610 0x7ff64c098aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.607 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.599+0000 7ff650cc0640 1 --2- 10.20.193.76:0/4279432438 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff64c06e8f0 0x7ff64c0980d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.607 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.599+0000 7ff650cc0640 1 --2- 10.20.193.76:0/4279432438 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff64c06dfd0 0x7ff64c06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.607 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.599+0000 7ff650cc0640 1 -- 10.20.193.76:0/4279432438 >> 10.20.193.76:0/4279432438 conn(0x7ff64c09a960 msgr2=0x7ff64c09ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:13.607 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.599+0000 7ff650cc0640 1 -- 10.20.193.76:0/4279432438 shutdown_connections 2026-02-25T17:21:13.607 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.599+0000 7ff650cc0640 1 -- 10.20.193.76:0/4279432438 wait complete. 2026-02-25T17:21:13.607 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff650cc0640 1 Processor -- start 2026-02-25T17:21:13.607 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff650cc0640 1 -- start start 2026-02-25T17:21:13.607 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff650cc0640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff64c06dfd0 0x7ff64c1c3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.607 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff650cc0640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff64c06e8f0 0x7ff64c1c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.607 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff650cc0640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff64c098610 0x7ff64c1247f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.607 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff650cc0640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c12d8b0 con 0x7ff64c098610 2026-02-25T17:21:13.607 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff650cc0640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c12e630 con 0x7ff64c06e8f0 2026-02-25T17:21:13.608 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff650cc0640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c12de50 con 0x7ff64c06dfd0 2026-02-25T17:21:13.608 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff649d74640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff64c06e8f0 0x7ff64c1c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.608 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff64a575640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff64c06dfd0 0x7ff64c1c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.608 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff649d74640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff64c06e8f0 0x7ff64c1c3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:42156/0 (socket says 10.20.193.76:42156) 2026-02-25T17:21:13.608 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff649d74640 1 -- 10.20.193.76:0/2334276996 learned_addr learned my addr 10.20.193.76:0/2334276996 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:13.608 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff64ad76640 1 --2- 10.20.193.76:0/2334276996 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff64c098610 0x7ff64c1247f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.608 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff649d74640 1 -- 10.20.193.76:0/2334276996 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff64c06dfd0 msgr2=0x7ff64c1c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.608 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff649d74640 1 --2- 10.20.193.76:0/2334276996 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff64c06dfd0 0x7ff64c1c3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.608 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff649d74640 1 -- 10.20.193.76:0/2334276996 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff64c098610 msgr2=0x7ff64c1247f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.608 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff649d74640 1 --2- 10.20.193.76:0/2334276996 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff64c098610 0x7ff64c1247f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.608 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff649d74640 1 -- 10.20.193.76:0/2334276996 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6340095d0 con 0x7ff64c06e8f0 2026-02-25T17:21:13.608 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff649d74640 1 --2- 10.20.193.76:0/2334276996 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff64c06e8f0 0x7ff64c1c3cb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff634009aa0 tx=0x7ff6340047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:13.609 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff632ffd640 1 -- 10.20.193.76:0/2334276996 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff634040660 con 0x7ff64c06e8f0 2026-02-25T17:21:13.609 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff632ffd640 1 -- 10.20.193.76:0/2334276996 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6340407c0 con 0x7ff64c06e8f0 2026-02-25T17:21:13.609 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff650cc0640 1 -- 10.20.193.76:0/2334276996 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff64c12ea00 con 0x7ff64c06e8f0 2026-02-25T17:21:13.609 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff632ffd640 1 -- 10.20.193.76:0/2334276996 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff634040b70 con 0x7ff64c06e8f0 2026-02-25T17:21:13.609 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.600+0000 7ff650cc0640 1 -- 10.20.193.76:0/2334276996 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64c1c41f0 con 0x7ff64c06e8f0 2026-02-25T17:21:13.609 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.601+0000 7ff650cc0640 1 -- 10.20.193.76:0/2334276996 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff64c04ebc0 con 0x7ff64c06e8f0 2026-02-25T17:21:13.609 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.601+0000 7ff632ffd640 1 -- 10.20.193.76:0/2334276996 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 9) v1 ==== 61950+0+0 (secure 0 0 0) 0x7ff634049020 con 0x7ff64c06e8f0 2026-02-25T17:21:13.609 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.601+0000 7ff632ffd640 1 -- 10.20.193.76:0/2334276996 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3021+0+0 (secure 0 0 0) 0x7ff63408bc70 con 0x7ff64c06e8f0 2026-02-25T17:21:13.610 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.603+0000 7ff632ffd640 1 -- 10.20.193.76:0/2334276996 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7ff64c04ebc0 con 0x7ff64c06e8f0 2026-02-25T17:21:13.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.679+0000 7ff650cc0640 1 -- 10.20.193.76:0/2334276996 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff64c04ebc0 con 0x7ff64c06e8f0 2026-02-25T17:21:13.682 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.680+0000 7ff632ffd640 1 -- 10.20.193.76:0/2334276996 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff64c04ebc0 con 0x7ff64c06e8f0 2026-02-25T17:21:13.682 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:13.682 INFO:teuthology.orchestra.run.trial076.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-25T17:21:13.683 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.680+0000 7ff650cc0640 1 -- 10.20.193.76:0/2334276996 >> v1:10.20.193.76:6800/1563581135 conn(0x7ff61804f7f0 legacy=0x7ff618051cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.680+0000 7ff650cc0640 1 -- 10.20.193.76:0/2334276996 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff64c06e8f0 msgr2=0x7ff64c1c3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.680+0000 7ff650cc0640 1 --2- 10.20.193.76:0/2334276996 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff64c06e8f0 0x7ff64c1c3cb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff634009aa0 tx=0x7ff6340047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.680+0000 7ff650cc0640 1 -- 10.20.193.76:0/2334276996 shutdown_connections 2026-02-25T17:21:13.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.680+0000 7ff650cc0640 1 --2- 10.20.193.76:0/2334276996 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff64c098610 0x7ff64c1247f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.680+0000 7ff650cc0640 1 --2- 10.20.193.76:0/2334276996 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff64c06e8f0 0x7ff64c1c3cb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.680+0000 7ff650cc0640 1 --2- 10.20.193.76:0/2334276996 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff64c06dfd0 0x7ff64c1c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.680+0000 7ff650cc0640 1 -- 10.20.193.76:0/2334276996 >> 10.20.193.76:0/2334276996 conn(0x7ff64c09a960 msgr2=0x7ff64c06c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:13.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.681+0000 7ff650cc0640 1 -- 10.20.193.76:0/2334276996 shutdown_connections 2026-02-25T17:21:13.684 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.681+0000 7ff650cc0640 1 -- 10.20.193.76:0/2334276996 wait complete. 2026-02-25T17:21:13.690 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-25T17:21:13.690 INFO:teuthology.run_tasks:Running task ceph.restart... 2026-02-25T17:21:13.708 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-25T17:21:13.708 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T17:21:13.749 INFO:tasks.ceph.osd.0:Stopped 2026-02-25T17:21:13.749 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2026-02-25T17:21:13.820 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.814+0000 7efc9c127640 1 Processor -- start 2026-02-25T17:21:13.821 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.814+0000 7efc9c127640 1 -- start start 2026-02-25T17:21:13.821 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.814+0000 7efc9c127640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7efc9412bb70 0x7efc941305b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.821 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.814+0000 7efc9c127640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7efc94130af0 0x7efc94132ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.821 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.814+0000 7efc9c127640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc940719c0 con 0x7efc9412b080 2026-02-25T17:21:13.821 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.814+0000 7efc9c127640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9406e580 con 0x7efc9412bb70 2026-02-25T17:21:13.821 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.814+0000 7efc9c127640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9406e2a0 con 0x7efc94130af0 2026-02-25T17:21:13.821 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.814+0000 7efc9969b640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7efc9412bb70 0x7efc941305b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.821 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.814+0000 7efc99e9c640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7efc9412b080 0x7efc9412b460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:47006/0 (socket says 10.20.193.76:47006) 2026-02-25T17:21:13.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.814+0000 7efc99e9c640 1 -- 10.20.193.76:0/288967504 learned_addr learned my addr 10.20.193.76:0/288967504 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:13.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.814+0000 7efc9a69d640 1 --2- 10.20.193.76:0/288967504 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7efc94130af0 0x7efc94132ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.814+0000 7efc98e9a640 1 -- 10.20.193.76:0/288967504 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799226481 0 0) 0x7efc940719c0 con 0x7efc9412b080 2026-02-25T17:21:13.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.814+0000 7efc9969b640 1 -- 10.20.193.76:0/288967504 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7efc94130af0 msgr2=0x7efc94132ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:13.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.814+0000 7efc9969b640 1 --2- 10.20.193.76:0/288967504 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7efc94130af0 0x7efc94132ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.814+0000 7efc9969b640 1 -- 10.20.193.76:0/288967504 >> v1:10.20.193.76:6789/0 conn(0x7efc9412b080 legacy=0x7efc9412b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.814+0000 7efc9969b640 1 -- 10.20.193.76:0/288967504 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9409d9a0 con 0x7efc9412bb70 2026-02-25T17:21:13.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.815+0000 7efc9969b640 1 --2- 10.20.193.76:0/288967504 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7efc9412bb70 0x7efc941305b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efc8800bbc0 tx=0x7efc88031560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66930eeee763091 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:13.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.815+0000 7efc98e9a640 1 -- 10.20.193.76:0/288967504 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc88036710 con 0x7efc9412bb70 2026-02-25T17:21:13.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.815+0000 7efc98e9a640 1 -- 10.20.193.76:0/288967504 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc88034050 con 0x7efc9412bb70 2026-02-25T17:21:13.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.815+0000 7efc98e9a640 1 -- 10.20.193.76:0/288967504 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc88036a90 con 0x7efc9412bb70 2026-02-25T17:21:13.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.815+0000 7efc9c127640 1 -- 10.20.193.76:0/288967504 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7efc9412bb70 msgr2=0x7efc941305b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.823 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.815+0000 7efc9c127640 1 --2- 10.20.193.76:0/288967504 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7efc9412bb70 0x7efc941305b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efc8800bbc0 tx=0x7efc88031560 comp rx=0 tx=0).stop 2026-02-25T17:21:13.823 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.815+0000 7efc9c127640 1 -- 10.20.193.76:0/288967504 shutdown_connections 2026-02-25T17:21:13.823 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.815+0000 7efc9c127640 1 --2- 10.20.193.76:0/288967504 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7efc94130af0 0x7efc94132ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.823 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.815+0000 7efc9c127640 1 --2- 10.20.193.76:0/288967504 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7efc9412bb70 0x7efc941305b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.823 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.815+0000 7efc9c127640 1 -- 10.20.193.76:0/288967504 >> 10.20.193.76:0/288967504 conn(0x7efc9409a960 msgr2=0x7efc9409ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:13.823 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.815+0000 7efc9c127640 1 -- 10.20.193.76:0/288967504 shutdown_connections 2026-02-25T17:21:13.823 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.815+0000 7efc9c127640 1 -- 10.20.193.76:0/288967504 wait complete. 2026-02-25T17:21:13.823 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.816+0000 7efc9c127640 1 Processor -- start 2026-02-25T17:21:13.823 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.816+0000 7efc9c127640 1 -- start start 2026-02-25T17:21:13.823 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.816+0000 7efc9c127640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7efc9412b080 0x7efc941c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.823 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.816+0000 7efc9c127640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7efc9412bb70 0x7efc941c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.823 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.816+0000 7efc9c127640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7efc94130af0 0x7efc941c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:13.823 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.816+0000 7efc9c127640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9408e0e0 con 0x7efc94130af0 2026-02-25T17:21:13.824 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.816+0000 7efc9c127640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9408fa10 con 0x7efc9412bb70 2026-02-25T17:21:13.824 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.816+0000 7efc9c127640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc9408f2c0 con 0x7efc9412b080 2026-02-25T17:21:13.824 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.816+0000 7efc9a69d640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7efc94130af0 0x7efc941c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.824 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.816+0000 7efc9969b640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7efc9412bb70 0x7efc941c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.824 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.816+0000 7efc99e9c640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7efc9412b080 0x7efc941c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:13.824 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.816+0000 7efc9a69d640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7efc94130af0 0x7efc941c5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:39506/0 (socket says 10.20.193.76:39506) 2026-02-25T17:21:13.824 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.816+0000 7efc9969b640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7efc9412bb70 0x7efc941c5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:42178/0 (socket says 10.20.193.76:42178) 2026-02-25T17:21:13.824 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.816+0000 7efc9a69d640 1 -- 10.20.193.76:0/1894071715 learned_addr learned my addr 10.20.193.76:0/1894071715 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:13.824 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.816+0000 7efc9a69d640 1 -- 10.20.193.76:0/1894071715 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7efc9412b080 msgr2=0x7efc941c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.824 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.816+0000 7efc9a69d640 1 --2- 10.20.193.76:0/1894071715 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7efc9412b080 0x7efc941c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.824 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.816+0000 7efc9a69d640 1 -- 10.20.193.76:0/1894071715 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7efc9412bb70 msgr2=0x7efc941c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:13.824 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.816+0000 7efc9a69d640 1 --2- 10.20.193.76:0/1894071715 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7efc9412bb70 0x7efc941c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:13.825 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.816+0000 7efc9a69d640 1 -- 10.20.193.76:0/1894071715 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8800b820 con 0x7efc94130af0 2026-02-25T17:21:13.825 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.816+0000 7efc9a69d640 1 --2- 10.20.193.76:0/1894071715 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7efc94130af0 0x7efc941c5ad0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efc9000efc0 tx=0x7efc9000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:13.825 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.817+0000 7efc827fc640 1 -- 10.20.193.76:0/1894071715 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90006ea0 con 0x7efc94130af0 2026-02-25T17:21:13.825 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.817+0000 7efc827fc640 1 -- 10.20.193.76:0/1894071715 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9000f040 con 0x7efc94130af0 2026-02-25T17:21:13.825 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.817+0000 7efc9c127640 1 -- 10.20.193.76:0/1894071715 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9408e9f0 con 0x7efc94130af0 2026-02-25T17:21:13.825 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.817+0000 7efc827fc640 1 -- 10.20.193.76:0/1894071715 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc90014480 con 0x7efc94130af0 2026-02-25T17:21:13.825 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.817+0000 7efc9c127640 1 -- 10.20.193.76:0/1894071715 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9408c9d0 con 0x7efc94130af0 2026-02-25T17:21:13.825 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.817+0000 7efc9c127640 1 -- 10.20.193.76:0/1894071715 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9408f4e0 con 0x7efc94130af0 2026-02-25T17:21:13.825 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.817+0000 7efc827fc640 1 -- 10.20.193.76:0/1894071715 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 9) v1 ==== 61950+0+0 (secure 0 0 0) 0x7efc90024020 con 0x7efc94130af0 2026-02-25T17:21:13.825 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.818+0000 7efc827fc640 1 -- 10.20.193.76:0/1894071715 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3021+0+0 (secure 0 0 0) 0x7efc90067140 con 0x7efc94130af0 2026-02-25T17:21:13.826 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.819+0000 7efc827fc640 1 -- 10.20.193.76:0/1894071715 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7efc9408f4e0 con 0x7efc94130af0 2026-02-25T17:21:13.889 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:13.887+0000 7efc9c127640 1 -- 10.20.193.76:0/1894071715 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7efc940611c0 con 0x7efc94130af0 2026-02-25T17:21:13.890 INFO:tasks.ceph.mon.a.trial076.stderr:2026-02-25T17:21:13.887+0000 7f27d35e4640 -1 mon.a@0(leader).osd e16 definitely_dead 0 2026-02-25T17:21:14.171 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.169+0000 7efc827fc640 1 -- 10.20.193.76:0/1894071715 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0. v17) v1 ==== 89+0+0 (secure 0 0 0) 0x7efc90018070 con 0x7efc94130af0 2026-02-25T17:21:14.172 INFO:teuthology.orchestra.run.trial076.stderr:marked down osd.0. 2026-02-25T17:21:14.173 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.170+0000 7efc9c127640 1 -- 10.20.193.76:0/1894071715 >> v1:10.20.193.76:6800/1563581135 conn(0x7efc6404f7f0 legacy=0x7efc64051cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:14.173 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.170+0000 7efc9c127640 1 -- 10.20.193.76:0/1894071715 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7efc94130af0 msgr2=0x7efc941c5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:14.173 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.170+0000 7efc9c127640 1 --2- 10.20.193.76:0/1894071715 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7efc94130af0 0x7efc941c5ad0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efc9000efc0 tx=0x7efc9000c490 comp rx=0 tx=0).stop 2026-02-25T17:21:14.173 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.170+0000 7efc9c127640 1 -- 10.20.193.76:0/1894071715 shutdown_connections 2026-02-25T17:21:14.173 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.170+0000 7efc9c127640 1 --2- 10.20.193.76:0/1894071715 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7efc94130af0 0x7efc941c5ad0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:14.173 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.170+0000 7efc9c127640 1 --2- 10.20.193.76:0/1894071715 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7efc9412bb70 0x7efc941c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:14.173 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.170+0000 7efc9c127640 1 --2- 10.20.193.76:0/1894071715 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7efc9412b080 0x7efc941c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:14.173 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.170+0000 7efc9c127640 1 -- 10.20.193.76:0/1894071715 >> 10.20.193.76:0/1894071715 conn(0x7efc9409a960 msgr2=0x7efc94126030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:14.173 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.170+0000 7efc9c127640 1 -- 10.20.193.76:0/1894071715 shutdown_connections 2026-02-25T17:21:14.173 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.170+0000 7efc9c127640 1 -- 10.20.193.76:0/1894071715 wait complete. 2026-02-25T17:21:14.181 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-25T17:21:14.181 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-25T17:21:14.184 INFO:tasks.ceph.osd.0:Started 2026-02-25T17:21:14.184 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-25T17:21:14.185 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T17:21:14.236 INFO:tasks.ceph.osd.1:Stopped 2026-02-25T17:21:14.236 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2026-02-25T17:21:14.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.302+0000 7f65db127640 1 Processor -- start 2026-02-25T17:21:14.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.302+0000 7f65db127640 1 -- start start 2026-02-25T17:21:14.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.303+0000 7f65db127640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f65d406fcc0 0x7f65d4071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:14.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.303+0000 7f65db127640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f65d4133c20 0x7f65d4136010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:14.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.303+0000 7f65db127640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d409d9a0 con 0x7f65d406f210 2026-02-25T17:21:14.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.303+0000 7f65db127640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d4070560 con 0x7f65d406fcc0 2026-02-25T17:21:14.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.303+0000 7f65db127640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40992e0 con 0x7f65d4133c20 2026-02-25T17:21:14.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.303+0000 7f65cbfff640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f65d406fcc0 0x7f65d4071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:14.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.303+0000 7f65d8e9c640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f65d406f210 0x7f65d4070b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:47032/0 (socket says 10.20.193.76:47032) 2026-02-25T17:21:14.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.303+0000 7f65d8e9c640 1 -- 10.20.193.76:0/2685731121 learned_addr learned my addr 10.20.193.76:0/2685731121 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:14.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.303+0000 7f65d969d640 1 --2- 10.20.193.76:0/2685731121 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f65d4133c20 0x7f65d4136010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:14.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.303+0000 7f65cbfff640 1 -- 10.20.193.76:0/2685731121 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f65d4133c20 msgr2=0x7f65d4136010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:14.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.303+0000 7f65cbfff640 1 --2- 10.20.193.76:0/2685731121 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f65d4133c20 0x7f65d4136010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:14.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.303+0000 7f65cbfff640 1 -- 10.20.193.76:0/2685731121 >> v1:10.20.193.76:6789/0 conn(0x7f65d406f210 legacy=0x7f65d4070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:14.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.303+0000 7f65cb7fe640 1 -- 10.20.193.76:0/2685731121 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 235278595 0 0) 0x7f65d409d9a0 con 0x7f65d406f210 2026-02-25T17:21:14.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.303+0000 7f65cbfff640 1 -- 10.20.193.76:0/2685731121 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d4070870 con 0x7f65d406fcc0 2026-02-25T17:21:14.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.303+0000 7f65cbfff640 1 --2- 10.20.193.76:0/2685731121 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f65d406fcc0 0x7f65d4071240 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0098a0 tx=0x7f65bc02ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129cca941cfc9f86 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:14.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.303+0000 7f65cb7fe640 1 -- 10.20.193.76:0/2685731121 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc02fa40 con 0x7f65d406fcc0 2026-02-25T17:21:14.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.303+0000 7f65cb7fe640 1 -- 10.20.193.76:0/2685731121 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65bc02fba0 con 0x7f65d406fcc0 2026-02-25T17:21:14.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.303+0000 7f65cb7fe640 1 -- 10.20.193.76:0/2685731121 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc037440 con 0x7f65d406fcc0 2026-02-25T17:21:14.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.304+0000 7f65db127640 1 -- 10.20.193.76:0/2685731121 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f65d406fcc0 msgr2=0x7f65d4071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:14.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.304+0000 7f65db127640 1 --2- 10.20.193.76:0/2685731121 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f65d406fcc0 0x7f65d4071240 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0098a0 tx=0x7f65bc02ed80 comp rx=0 tx=0).stop 2026-02-25T17:21:14.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.304+0000 7f65db127640 1 -- 10.20.193.76:0/2685731121 shutdown_connections 2026-02-25T17:21:14.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.304+0000 7f65db127640 1 --2- 10.20.193.76:0/2685731121 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f65d4133c20 0x7f65d4136010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:14.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.304+0000 7f65db127640 1 --2- 10.20.193.76:0/2685731121 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f65d406fcc0 0x7f65d4071240 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:14.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.304+0000 7f65db127640 1 -- 10.20.193.76:0/2685731121 >> 10.20.193.76:0/2685731121 conn(0x7f65d409a960 msgr2=0x7f65d409ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:14.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.304+0000 7f65db127640 1 -- 10.20.193.76:0/2685731121 shutdown_connections 2026-02-25T17:21:14.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.304+0000 7f65db127640 1 -- 10.20.193.76:0/2685731121 wait complete. 2026-02-25T17:21:14.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.304+0000 7f65db127640 1 Processor -- start 2026-02-25T17:21:14.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.304+0000 7f65db127640 1 -- start start 2026-02-25T17:21:14.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65db127640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f65d406f210 0x7f65d4096980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:14.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65db127640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f65d406fcc0 0x7f65d4096ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:14.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65db127640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f65d4133c20 0x7f65d4097400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:14.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65db127640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d4095310 con 0x7f65d406f210 2026-02-25T17:21:14.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65db127640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d4097940 con 0x7f65d4133c20 2026-02-25T17:21:14.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65db127640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40966c0 con 0x7f65d406fcc0 2026-02-25T17:21:14.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65d8e9c640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f65d406f210 0x7f65d4096980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:14.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65cbfff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f65d406fcc0 0x7f65d4096ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:14.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65d8e9c640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f65d406f210 0x7f65d4096980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:39530/0 (socket says 10.20.193.76:39530) 2026-02-25T17:21:14.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65d8e9c640 1 -- 10.20.193.76:0/1601199906 learned_addr learned my addr 10.20.193.76:0/1601199906 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:14.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65d969d640 1 --2- 10.20.193.76:0/1601199906 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f65d4133c20 0x7f65d4097400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:14.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65d8e9c640 1 -- 10.20.193.76:0/1601199906 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f65d406fcc0 msgr2=0x7f65d4096ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:14.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65d8e9c640 1 --2- 10.20.193.76:0/1601199906 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f65d406fcc0 0x7f65d4096ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:14.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65d8e9c640 1 -- 10.20.193.76:0/1601199906 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f65d4133c20 msgr2=0x7f65d4097400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:14.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65d8e9c640 1 --2- 10.20.193.76:0/1601199906 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f65d4133c20 0x7f65d4097400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:14.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65d8e9c640 1 -- 10.20.193.76:0/1601199906 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc009500 con 0x7f65d406f210 2026-02-25T17:21:14.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65d969d640 1 --2- 10.20.193.76:0/1601199906 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f65d4133c20 0x7f65d4097400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:14.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65d8e9c640 1 --2- 10.20.193.76:0/1601199906 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f65d406f210 0x7f65d4096980 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f65c400c700 tx=0x7f65c400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:14.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65c97fa640 1 -- 10.20.193.76:0/1601199906 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4004ae0 con 0x7f65d406f210 2026-02-25T17:21:14.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65c97fa640 1 -- 10.20.193.76:0/1601199906 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c4004c40 con 0x7f65d406f210 2026-02-25T17:21:14.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65db127640 1 -- 10.20.193.76:0/1601199906 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d40949c0 con 0x7f65d406f210 2026-02-25T17:21:14.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65c97fa640 1 -- 10.20.193.76:0/1601199906 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c40070d0 con 0x7f65d406f210 2026-02-25T17:21:14.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.305+0000 7f65db127640 1 -- 10.20.193.76:0/1601199906 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d40983a0 con 0x7f65d406f210 2026-02-25T17:21:14.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.306+0000 7f65db127640 1 -- 10.20.193.76:0/1601199906 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d4098650 con 0x7f65d406f210 2026-02-25T17:21:14.314 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.306+0000 7f65c97fa640 1 -- 10.20.193.76:0/1601199906 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 9) v1 ==== 61950+0+0 (secure 0 0 0) 0x7f65c4007250 con 0x7f65d406f210 2026-02-25T17:21:14.314 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.306+0000 7f65c97fa640 1 -- 10.20.193.76:0/1601199906 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3021+0+0 (secure 0 0 0) 0x7f65c4065ed0 con 0x7f65d406f210 2026-02-25T17:21:14.314 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.308+0000 7f65c97fa640 1 -- 10.20.193.76:0/1601199906 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f65c403f7d0 con 0x7f65d406f210 2026-02-25T17:21:14.378 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:14.376+0000 7f65db127640 1 -- 10.20.193.76:0/1601199906 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7f65d4068270 con 0x7f65d406f210 2026-02-25T17:21:14.379 INFO:tasks.ceph.mon.a.trial076.stderr:2026-02-25T17:21:14.376+0000 7f27d35e4640 -1 mon.a@0(leader).osd e17 definitely_dead 0 2026-02-25T17:21:14.752 INFO:tasks.ceph.osd.0.trial076.stderr:2026-02-25T17:21:14.749+0000 7f62a7614780 -1 Falling back to public interface 2026-02-25T17:21:15.175 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.172+0000 7f65c97fa640 1 -- 10.20.193.76:0/1601199906 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v18) v1 ==== 89+0+0 (secure 0 0 0) 0x7f65c4067070 con 0x7f65d406f210 2026-02-25T17:21:15.175 INFO:teuthology.orchestra.run.trial076.stderr:marked down osd.1. 2026-02-25T17:21:15.176 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.174+0000 7f65c97fa640 1 -- 10.20.193.76:0/1601199906 <== mon.0 v2:10.20.193.76:3300/0 8 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f65c4064aa0 con 0x7f65d406f210 2026-02-25T17:21:15.177 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.175+0000 7f65db127640 1 -- 10.20.193.76:0/1601199906 >> v1:10.20.193.76:6800/1563581135 conn(0x7f65a404f7f0 legacy=0x7f65a4051cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:15.177 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.175+0000 7f65db127640 1 -- 10.20.193.76:0/1601199906 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f65d406f210 msgr2=0x7f65d4096980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:15.177 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.175+0000 7f65db127640 1 --2- 10.20.193.76:0/1601199906 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f65d406f210 0x7f65d4096980 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f65c400c700 tx=0x7f65c400cbd0 comp rx=0 tx=0).stop 2026-02-25T17:21:15.177 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.175+0000 7f65db127640 1 -- 10.20.193.76:0/1601199906 shutdown_connections 2026-02-25T17:21:15.178 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.175+0000 7f65db127640 1 --2- 10.20.193.76:0/1601199906 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f65d4133c20 0x7f65d4097400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:15.178 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.175+0000 7f65db127640 1 --2- 10.20.193.76:0/1601199906 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f65d406fcc0 0x7f65d4096ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:15.178 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.175+0000 7f65db127640 1 --2- 10.20.193.76:0/1601199906 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f65d406f210 0x7f65d4096980 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:15.178 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.175+0000 7f65db127640 1 -- 10.20.193.76:0/1601199906 >> 10.20.193.76:0/1601199906 conn(0x7f65d409a960 msgr2=0x7f65d406ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:15.178 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.175+0000 7f65db127640 1 -- 10.20.193.76:0/1601199906 shutdown_connections 2026-02-25T17:21:15.178 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.175+0000 7f65db127640 1 -- 10.20.193.76:0/1601199906 wait complete. 2026-02-25T17:21:15.186 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-25T17:21:15.186 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-25T17:21:15.187 INFO:tasks.ceph.osd.1:Started 2026-02-25T17:21:15.187 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-25T17:21:15.188 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T17:21:15.223 INFO:tasks.ceph.osd.2:Stopped 2026-02-25T17:21:15.224 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2026-02-25T17:21:15.334 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.327+0000 7f015e274640 1 Processor -- start 2026-02-25T17:21:15.334 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.327+0000 7f015e274640 1 -- start start 2026-02-25T17:21:15.334 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.327+0000 7f015e274640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f015806dfd0 0x7f015806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:15.334 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.327+0000 7f015e274640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f015806e8f0 0x7f01580980d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:15.334 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.327+0000 7f015e274640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0158098610 0x7f0158098ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:15.335 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.327+0000 7f015e274640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0158099190 con 0x7f015806dfd0 2026-02-25T17:21:15.335 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.327+0000 7f015e274640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015808c910 con 0x7f0158098610 2026-02-25T17:21:15.335 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.327+0000 7f015e274640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f015808c700 con 0x7f015806e8f0 2026-02-25T17:21:15.335 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.327+0000 7f01577fe640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f015806dfd0 0x7f015806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:15.335 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.327+0000 7f0156ffd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f015806e8f0 0x7f01580980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:15.335 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.327+0000 7f0157fff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0158098610 0x7f0158098ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:15.335 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.327+0000 7f01577fe640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f015806dfd0 0x7f015806e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:39552/0 (socket says 10.20.193.76:39552) 2026-02-25T17:21:15.335 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.327+0000 7f0156ffd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f015806e8f0 0x7f01580980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:48788/0 (socket says 10.20.193.76:48788) 2026-02-25T17:21:15.335 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.327+0000 7f01577fe640 1 -- 10.20.193.76:0/1719109607 learned_addr learned my addr 10.20.193.76:0/1719109607 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:15.335 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.327+0000 7f0156ffd640 1 -- 10.20.193.76:0/1719109607 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0158098610 msgr2=0x7f0158098ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:15.335 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.327+0000 7f0156ffd640 1 --2- 10.20.193.76:0/1719109607 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0158098610 0x7f0158098ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:15.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.327+0000 7f0156ffd640 1 -- 10.20.193.76:0/1719109607 >> v2:10.20.193.76:3300/0 conn(0x7f015806dfd0 msgr2=0x7f015806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:15.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.327+0000 7f0156ffd640 1 --2- 10.20.193.76:0/1719109607 >> v2:10.20.193.76:3300/0 conn(0x7f015806dfd0 0x7f015806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:15.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.327+0000 7f0156ffd640 1 -- 10.20.193.76:0/1719109607 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015809d9a0 con 0x7f015806e8f0 2026-02-25T17:21:15.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.327+0000 7f01577fe640 1 --2- 10.20.193.76:0/1719109607 >> v2:10.20.193.76:3300/0 conn(0x7f015806dfd0 0x7f015806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:15.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.328+0000 7f0156ffd640 1 --2- 10.20.193.76:0/1719109607 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f015806e8f0 0x7f01580980d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f01480098a0 tx=0x7f014802ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4b16e8446da659 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:15.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.328+0000 7f01567fc640 1 -- 10.20.193.76:0/1719109607 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014802fa80 con 0x7f015806e8f0 2026-02-25T17:21:15.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.328+0000 7f01567fc640 1 -- 10.20.193.76:0/1719109607 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014802fbe0 con 0x7f015806e8f0 2026-02-25T17:21:15.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.328+0000 7f01567fc640 1 -- 10.20.193.76:0/1719109607 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148037440 con 0x7f015806e8f0 2026-02-25T17:21:15.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.328+0000 7f015e274640 1 -- 10.20.193.76:0/1719109607 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f015806e8f0 msgr2=0x7f01580980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:15.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.328+0000 7f015e274640 1 --2- 10.20.193.76:0/1719109607 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f015806e8f0 0x7f01580980d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f01480098a0 tx=0x7f014802ee10 comp rx=0 tx=0).stop 2026-02-25T17:21:15.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.328+0000 7f015e274640 1 -- 10.20.193.76:0/1719109607 shutdown_connections 2026-02-25T17:21:15.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.328+0000 7f015e274640 1 --2- 10.20.193.76:0/1719109607 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0158098610 0x7f0158098ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:15.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.328+0000 7f015e274640 1 --2- 10.20.193.76:0/1719109607 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f015806e8f0 0x7f01580980d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:15.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.328+0000 7f015e274640 1 --2- 10.20.193.76:0/1719109607 >> v2:10.20.193.76:3300/0 conn(0x7f015806dfd0 0x7f015806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:15.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.328+0000 7f015e274640 1 -- 10.20.193.76:0/1719109607 >> 10.20.193.76:0/1719109607 conn(0x7f015809a960 msgr2=0x7f015809ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:15.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.328+0000 7f015e274640 1 -- 10.20.193.76:0/1719109607 shutdown_connections 2026-02-25T17:21:15.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.328+0000 7f015e274640 1 -- 10.20.193.76:0/1719109607 wait complete. 2026-02-25T17:21:15.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f015e274640 1 Processor -- start 2026-02-25T17:21:15.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f015e274640 1 -- start start 2026-02-25T17:21:15.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f015e274640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f015806dfd0 0x7f01581247c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:15.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f015e274640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f015806e8f0 0x7f0158124d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:15.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f015e274640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0158098610 0x7f0158125240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:15.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f015e274640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0158132c60 con 0x7f015806e8f0 2026-02-25T17:21:15.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f015e274640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0158126120 con 0x7f0158098610 2026-02-25T17:21:15.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f015e274640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0158133480 con 0x7f015806dfd0 2026-02-25T17:21:15.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f01577fe640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f015806dfd0 0x7f01581247c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:15.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f0156ffd640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f015806e8f0 0x7f0158124d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:15.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f01577fe640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f015806dfd0 0x7f01581247c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:48792/0 (socket says 10.20.193.76:48792) 2026-02-25T17:21:15.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f01577fe640 1 -- 10.20.193.76:0/2617773944 learned_addr learned my addr 10.20.193.76:0/2617773944 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:15.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f0156ffd640 1 --2- 10.20.193.76:0/2617773944 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f015806e8f0 0x7f0158124d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:39554/0 (socket says 10.20.193.76:39554) 2026-02-25T17:21:15.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f0157fff640 1 --2- 10.20.193.76:0/2617773944 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0158098610 0x7f0158125240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:15.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f0156ffd640 1 -- 10.20.193.76:0/2617773944 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f015806dfd0 msgr2=0x7f01581247c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:15.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f0156ffd640 1 --2- 10.20.193.76:0/2617773944 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f015806dfd0 0x7f01581247c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:15.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f0156ffd640 1 -- 10.20.193.76:0/2617773944 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0158098610 msgr2=0x7f0158125240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:15.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f0156ffd640 1 --2- 10.20.193.76:0/2617773944 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0158098610 0x7f0158125240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:15.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f0156ffd640 1 -- 10.20.193.76:0/2617773944 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01440095d0 con 0x7f015806e8f0 2026-02-25T17:21:15.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f0156ffd640 1 --2- 10.20.193.76:0/2617773944 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f015806e8f0 0x7f0158124d00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f015808c840 tx=0x7f01480047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:15.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f0133fff640 1 -- 10.20.193.76:0/2617773944 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148042670 con 0x7f015806e8f0 2026-02-25T17:21:15.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f0133fff640 1 -- 10.20.193.76:0/2617773944 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01480427f0 con 0x7f015806e8f0 2026-02-25T17:21:15.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f015e274640 1 -- 10.20.193.76:0/2617773944 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0148009500 con 0x7f015806e8f0 2026-02-25T17:21:15.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f0133fff640 1 -- 10.20.193.76:0/2617773944 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148042ba0 con 0x7f015806e8f0 2026-02-25T17:21:15.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.329+0000 7f015e274640 1 -- 10.20.193.76:0/2617773944 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0158125830 con 0x7f015806e8f0 2026-02-25T17:21:15.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.330+0000 7f015e274640 1 -- 10.20.193.76:0/2617773944 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015804ebc0 con 0x7f015806e8f0 2026-02-25T17:21:15.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.330+0000 7f0133fff640 1 -- 10.20.193.76:0/2617773944 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f0148040420 con 0x7f015806e8f0 2026-02-25T17:21:15.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.330+0000 7f0133fff640 1 -- 10.20.193.76:0/2617773944 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3021+0+0 (secure 0 0 0) 0x7f014808b930 con 0x7f015806e8f0 2026-02-25T17:21:15.340 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.332+0000 7f0133fff640 1 -- 10.20.193.76:0/2617773944 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f015804ebc0 con 0x7f015806e8f0 2026-02-25T17:21:15.403 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:15.401+0000 7f015e274640 1 -- 10.20.193.76:0/2617773944 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7f0158125830 con 0x7f015806e8f0 2026-02-25T17:21:15.404 INFO:tasks.ceph.mon.a.trial076.stderr:2026-02-25T17:21:15.401+0000 7f27d35e4640 -1 mon.a@0(leader).osd e18 definitely_dead 0 2026-02-25T17:21:15.753 INFO:tasks.ceph.osd.1.trial076.stderr:2026-02-25T17:21:15.751+0000 7f09aa00d780 -1 Falling back to public interface 2026-02-25T17:21:16.175 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.173+0000 7f0133fff640 1 -- 10.20.193.76:0/2617773944 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v19) v1 ==== 89+0+0 (secure 0 0 0) 0x7f0158125830 con 0x7f015806e8f0 2026-02-25T17:21:16.175 INFO:teuthology.orchestra.run.trial076.stderr:marked down osd.2. 2026-02-25T17:21:16.177 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.174+0000 7f015e274640 1 -- 10.20.193.76:0/2617773944 >> v1:10.20.193.76:6800/1563581135 conn(0x7f012804f880 legacy=0x7f0128051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:16.177 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.174+0000 7f015e274640 1 -- 10.20.193.76:0/2617773944 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f015806e8f0 msgr2=0x7f0158124d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:16.177 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.174+0000 7f015e274640 1 --2- 10.20.193.76:0/2617773944 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f015806e8f0 0x7f0158124d00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f015808c840 tx=0x7f01480047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:16.178 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.174+0000 7f015e274640 1 -- 10.20.193.76:0/2617773944 shutdown_connections 2026-02-25T17:21:16.178 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.174+0000 7f015e274640 1 --2- 10.20.193.76:0/2617773944 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0158098610 0x7f0158125240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:16.178 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.174+0000 7f015e274640 1 --2- 10.20.193.76:0/2617773944 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f015806e8f0 0x7f0158124d00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:16.178 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.174+0000 7f015e274640 1 --2- 10.20.193.76:0/2617773944 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f015806dfd0 0x7f01581247c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:16.178 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.174+0000 7f015e274640 1 -- 10.20.193.76:0/2617773944 >> 10.20.193.76:0/2617773944 conn(0x7f015809a960 msgr2=0x7f01580961e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:16.178 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.174+0000 7f015e274640 1 -- 10.20.193.76:0/2617773944 shutdown_connections 2026-02-25T17:21:16.178 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.174+0000 7f015e274640 1 -- 10.20.193.76:0/2617773944 wait complete. 2026-02-25T17:21:16.186 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-25T17:21:16.186 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-25T17:21:16.189 INFO:tasks.ceph.osd.2:Started 2026-02-25T17:21:16.189 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-25T17:21:16.189 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T17:21:16.236 INFO:tasks.ceph.osd.3:Stopped 2026-02-25T17:21:16.236 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2026-02-25T17:21:16.305 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.299+0000 7fc653e72640 1 Processor -- start 2026-02-25T17:21:16.305 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.299+0000 7fc653e72640 1 -- start start 2026-02-25T17:21:16.305 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.299+0000 7fc653e72640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc64c06f210 0x7fc64c070b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:16.305 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.299+0000 7fc653e72640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc64c06fcc0 0x7fc64c071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:16.305 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.299+0000 7fc653e72640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fc64c0715b0 0x7fc64c134c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:16.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.299+0000 7fc653e72640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64c09d9a0 con 0x7fc64c0715b0 2026-02-25T17:21:16.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.299+0000 7fc653e72640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c070560 con 0x7fc64c06fcc0 2026-02-25T17:21:16.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.299+0000 7fc653e72640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0992e0 con 0x7fc64c06f210 2026-02-25T17:21:16.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.299+0000 7fc651be7640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc64c06f210 0x7fc64c070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:16.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.299+0000 7fc6523e8640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fc64c0715b0 0x7fc64c134c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:16.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.299+0000 7fc6513e6640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc64c06fcc0 0x7fc64c071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:16.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.299+0000 7fc6523e8640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fc64c0715b0 0x7fc64c134c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:39572/0 (socket says 10.20.193.76:39572) 2026-02-25T17:21:16.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.299+0000 7fc651be7640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc64c06f210 0x7fc64c070b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:48808/0 (socket says 10.20.193.76:48808) 2026-02-25T17:21:16.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.299+0000 7fc6523e8640 1 -- 10.20.193.76:0/2930318665 learned_addr learned my addr 10.20.193.76:0/2930318665 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:16.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.299+0000 7fc6523e8640 1 -- 10.20.193.76:0/2930318665 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc64c06f210 msgr2=0x7fc64c070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:16.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.299+0000 7fc6523e8640 1 --2- 10.20.193.76:0/2930318665 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc64c06f210 0x7fc64c070b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:16.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.299+0000 7fc6523e8640 1 -- 10.20.193.76:0/2930318665 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc64c06fcc0 msgr2=0x7fc64c071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:16.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.299+0000 7fc6523e8640 1 --2- 10.20.193.76:0/2930318665 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc64c06fcc0 0x7fc64c071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:16.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.299+0000 7fc6523e8640 1 -- 10.20.193.76:0/2930318665 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c070870 con 0x7fc64c0715b0 2026-02-25T17:21:16.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.300+0000 7fc6523e8640 1 --2- 10.20.193.76:0/2930318665 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc64c0715b0 0x7fc64c134c20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc648009e50 tx=0x7fc64802f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34cd7c766a175737 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:16.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.300+0000 7fc650be5640 1 -- 10.20.193.76:0/2930318665 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc648006ea0 con 0x7fc64c0715b0 2026-02-25T17:21:16.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.300+0000 7fc650be5640 1 -- 10.20.193.76:0/2930318665 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64802fc70 con 0x7fc64c0715b0 2026-02-25T17:21:16.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.300+0000 7fc650be5640 1 -- 10.20.193.76:0/2930318665 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6480373f0 con 0x7fc64c0715b0 2026-02-25T17:21:16.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.300+0000 7fc653e72640 1 -- 10.20.193.76:0/2930318665 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc64c0715b0 msgr2=0x7fc64c134c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:16.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.300+0000 7fc653e72640 1 --2- 10.20.193.76:0/2930318665 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc64c0715b0 0x7fc64c134c20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc648009e50 tx=0x7fc64802f210 comp rx=0 tx=0).stop 2026-02-25T17:21:16.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.300+0000 7fc653e72640 1 -- 10.20.193.76:0/2930318665 shutdown_connections 2026-02-25T17:21:16.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.300+0000 7fc653e72640 1 --2- 10.20.193.76:0/2930318665 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc64c0715b0 0x7fc64c134c20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:16.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.300+0000 7fc653e72640 1 --2- 10.20.193.76:0/2930318665 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc64c06fcc0 0x7fc64c071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:16.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.300+0000 7fc653e72640 1 --2- 10.20.193.76:0/2930318665 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc64c06f210 0x7fc64c070b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:16.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.300+0000 7fc653e72640 1 -- 10.20.193.76:0/2930318665 >> 10.20.193.76:0/2930318665 conn(0x7fc64c09a960 msgr2=0x7fc64c09ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:16.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.300+0000 7fc653e72640 1 -- 10.20.193.76:0/2930318665 shutdown_connections 2026-02-25T17:21:16.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.300+0000 7fc653e72640 1 -- 10.20.193.76:0/2930318665 wait complete. 2026-02-25T17:21:16.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc653e72640 1 Processor -- start 2026-02-25T17:21:16.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc653e72640 1 -- start start 2026-02-25T17:21:16.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc653e72640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc64c06f210 0x7fc64c123880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:16.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc653e72640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc64c06fcc0 0x7fc64c123dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:16.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc653e72640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc64c0715b0 0x7fc64c124300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:16.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc653e72640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c125cd0 con 0x7fc64c0715b0 2026-02-25T17:21:16.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc653e72640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c1265b0 con 0x7fc64c06f210 2026-02-25T17:21:16.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc653e72640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c071f90 con 0x7fc64c06fcc0 2026-02-25T17:21:16.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc6513e6640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc64c06fcc0 0x7fc64c123dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:16.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc651be7640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc64c06f210 0x7fc64c123880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:16.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc6513e6640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc64c06fcc0 0x7fc64c123dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:48820/0 (socket says 10.20.193.76:48820) 2026-02-25T17:21:16.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc6523e8640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc64c0715b0 0x7fc64c124300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:16.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc6513e6640 1 -- 10.20.193.76:0/908321438 learned_addr learned my addr 10.20.193.76:0/908321438 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:16.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc6513e6640 1 -- 10.20.193.76:0/908321438 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc64c06f210 msgr2=0x7fc64c123880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:16.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc6513e6640 1 --2- 10.20.193.76:0/908321438 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc64c06f210 0x7fc64c123880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:16.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc6513e6640 1 -- 10.20.193.76:0/908321438 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc64c0715b0 msgr2=0x7fc64c124300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:16.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc6513e6640 1 --2- 10.20.193.76:0/908321438 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc64c0715b0 0x7fc64c124300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:16.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc6513e6640 1 -- 10.20.193.76:0/908321438 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc648009b30 con 0x7fc64c06fcc0 2026-02-25T17:21:16.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc651be7640 1 --2- 10.20.193.76:0/908321438 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc64c06f210 0x7fc64c123880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:16.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc6513e6640 1 --2- 10.20.193.76:0/908321438 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc64c06fcc0 0x7fc64c123dc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc64000ebb0 tx=0x7fc64000c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:16.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc63a7fc640 1 -- 10.20.193.76:0/908321438 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc640009770 con 0x7fc64c06fcc0 2026-02-25T17:21:16.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc63a7fc640 1 -- 10.20.193.76:0/908321438 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64000eec0 con 0x7fc64c06fcc0 2026-02-25T17:21:16.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc653e72640 1 -- 10.20.193.76:0/908321438 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c1270f0 con 0x7fc64c06fcc0 2026-02-25T17:21:16.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.301+0000 7fc63a7fc640 1 -- 10.20.193.76:0/908321438 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64000ce60 con 0x7fc64c06fcc0 2026-02-25T17:21:16.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.302+0000 7fc653e72640 1 -- 10.20.193.76:0/908321438 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64c124a20 con 0x7fc64c06fcc0 2026-02-25T17:21:16.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.302+0000 7fc653e72640 1 -- 10.20.193.76:0/908321438 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64c0008d0 con 0x7fc64c06fcc0 2026-02-25T17:21:16.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.302+0000 7fc63a7fc640 1 -- 10.20.193.76:0/908321438 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fc640011070 con 0x7fc64c06fcc0 2026-02-25T17:21:16.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.302+0000 7fc63a7fc640 1 -- 10.20.193.76:0/908321438 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3021+0+0 (secure 0 0 0) 0x7fc640066880 con 0x7fc64c06fcc0 2026-02-25T17:21:16.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.304+0000 7fc63a7fc640 1 -- 10.20.193.76:0/908321438 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7fc640040210 con 0x7fc64c06fcc0 2026-02-25T17:21:16.376 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:16.374+0000 7fc653e72640 1 -- 10.20.193.76:0/908321438 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7fc64c070a90 con 0x7fc64c06fcc0 2026-02-25T17:21:16.377 INFO:tasks.ceph.mon.a.trial076.stderr:2026-02-25T17:21:16.374+0000 7f27d35e4640 -1 mon.a@0(leader).osd e19 definitely_dead 0 2026-02-25T17:21:16.756 INFO:tasks.ceph.osd.2.trial076.stderr:2026-02-25T17:21:16.753+0000 7f6fe872e780 -1 Falling back to public interface 2026-02-25T17:21:17.179 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.176+0000 7fc63a7fc640 1 -- 10.20.193.76:0/908321438 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v20) v1 ==== 89+0+0 (secure 0 0 0) 0x7fc640017030 con 0x7fc64c06fcc0 2026-02-25T17:21:17.179 INFO:teuthology.orchestra.run.trial076.stderr:marked down osd.3. 2026-02-25T17:21:17.181 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.178+0000 7fc653e72640 1 -- 10.20.193.76:0/908321438 >> v1:10.20.193.76:6800/1563581135 conn(0x7fc61c04f880 legacy=0x7fc61c051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:17.181 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.178+0000 7fc653e72640 1 -- 10.20.193.76:0/908321438 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc64c06fcc0 msgr2=0x7fc64c123dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:17.181 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.178+0000 7fc653e72640 1 --2- 10.20.193.76:0/908321438 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc64c06fcc0 0x7fc64c123dc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc64000ebb0 tx=0x7fc64000c520 comp rx=0 tx=0).stop 2026-02-25T17:21:17.181 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.178+0000 7fc653e72640 1 -- 10.20.193.76:0/908321438 shutdown_connections 2026-02-25T17:21:17.181 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.178+0000 7fc653e72640 1 --2- 10.20.193.76:0/908321438 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fc64c0715b0 0x7fc64c124300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:17.181 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.178+0000 7fc653e72640 1 --2- 10.20.193.76:0/908321438 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fc64c06fcc0 0x7fc64c123dc0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:17.182 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.178+0000 7fc653e72640 1 --2- 10.20.193.76:0/908321438 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fc64c06f210 0x7fc64c123880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:17.182 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.178+0000 7fc653e72640 1 -- 10.20.193.76:0/908321438 >> 10.20.193.76:0/908321438 conn(0x7fc64c09a960 msgr2=0x7fc64c092f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:17.182 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.178+0000 7fc653e72640 1 -- 10.20.193.76:0/908321438 shutdown_connections 2026-02-25T17:21:17.182 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.178+0000 7fc653e72640 1 -- 10.20.193.76:0/908321438 wait complete. 2026-02-25T17:21:17.189 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-25T17:21:17.190 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-25T17:21:17.192 INFO:tasks.ceph.osd.3:Started 2026-02-25T17:21:17.192 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-25T17:21:17.192 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T17:21:17.264 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.258+0000 7f8fcd7b1640 1 Processor -- start 2026-02-25T17:21:17.264 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.258+0000 7f8fcd7b1640 1 -- start start 2026-02-25T17:21:17.264 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.258+0000 7f8fcd7b1640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f8fc806dfd0 0x7f8fc806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:17.264 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.258+0000 7f8fcd7b1640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8fc806e8f0 0x7f8fc8070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:17.265 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.258+0000 7f8fcd7b1640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc80722a0 con 0x7f8fc8070ed0 2026-02-25T17:21:17.265 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.258+0000 7f8fcd7b1640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc8071a70 con 0x7f8fc806dfd0 2026-02-25T17:21:17.265 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.258+0000 7f8fcd7b1640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc806fe00 con 0x7f8fc806e8f0 2026-02-25T17:21:17.265 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.258+0000 7f8fc67fc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8fc806e8f0 0x7f8fc8070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:17.265 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.258+0000 7f8fc6ffd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f8fc806dfd0 0x7f8fc806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:17.265 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.258+0000 7f8fc67fc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8fc806e8f0 0x7f8fc8070990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:58314/0 (socket says 10.20.193.76:58314) 2026-02-25T17:21:17.265 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.258+0000 7f8fc67fc640 1 -- 10.20.193.76:0/1898432096 learned_addr learned my addr 10.20.193.76:0/1898432096 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:17.265 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.258+0000 7f8fc77fe640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f8fc8070ed0 0x7f8fc8071360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:35314/0 (socket says 10.20.193.76:35314) 2026-02-25T17:21:17.265 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.258+0000 7f8fc67fc640 1 -- 10.20.193.76:0/1898432096 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f8fc806dfd0 msgr2=0x7f8fc806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:17.265 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.258+0000 7f8fc67fc640 1 --2- 10.20.193.76:0/1898432096 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f8fc806dfd0 0x7f8fc806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:17.265 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.258+0000 7f8fc67fc640 1 -- 10.20.193.76:0/1898432096 >> v1:10.20.193.76:6789/0 conn(0x7f8fc8070ed0 legacy=0x7f8fc8071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:17.266 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.258+0000 7f8fc67fc640 1 -- 10.20.193.76:0/1898432096 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc8061380 con 0x7f8fc806e8f0 2026-02-25T17:21:17.266 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.259+0000 7f8fc67fc640 1 --2- 10.20.193.76:0/1898432096 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8fc806e8f0 0x7f8fc8070990 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00099d0 tx=0x7f8fb002eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5229542ce63d97b server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:17.266 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.259+0000 7f8fc5ffb640 1 -- 10.20.193.76:0/1898432096 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb002fb00 con 0x7f8fc806e8f0 2026-02-25T17:21:17.266 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.259+0000 7f8fc5ffb640 1 -- 10.20.193.76:0/1898432096 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb002fc60 con 0x7f8fc806e8f0 2026-02-25T17:21:17.266 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.259+0000 7f8fc5ffb640 1 -- 10.20.193.76:0/1898432096 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0037440 con 0x7f8fc806e8f0 2026-02-25T17:21:17.266 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.259+0000 7f8fcd7b1640 1 -- 10.20.193.76:0/1898432096 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8fc806e8f0 msgr2=0x7f8fc8070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:17.266 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.259+0000 7f8fcd7b1640 1 --2- 10.20.193.76:0/1898432096 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8fc806e8f0 0x7f8fc8070990 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00099d0 tx=0x7f8fb002eed0 comp rx=0 tx=0).stop 2026-02-25T17:21:17.266 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.259+0000 7f8fcd7b1640 1 -- 10.20.193.76:0/1898432096 shutdown_connections 2026-02-25T17:21:17.266 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.259+0000 7f8fcd7b1640 1 --2- 10.20.193.76:0/1898432096 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8fc806e8f0 0x7f8fc8070990 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:17.266 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.259+0000 7f8fcd7b1640 1 --2- 10.20.193.76:0/1898432096 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f8fc806dfd0 0x7f8fc806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:17.266 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.259+0000 7f8fcd7b1640 1 -- 10.20.193.76:0/1898432096 >> 10.20.193.76:0/1898432096 conn(0x7f8fc809a960 msgr2=0x7f8fc809ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:17.267 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.259+0000 7f8fcd7b1640 1 -- 10.20.193.76:0/1898432096 shutdown_connections 2026-02-25T17:21:17.267 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.259+0000 7f8fcd7b1640 1 -- 10.20.193.76:0/1898432096 wait complete. 2026-02-25T17:21:17.267 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fcd7b1640 1 Processor -- start 2026-02-25T17:21:17.267 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fcd7b1640 1 -- start start 2026-02-25T17:21:17.267 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fcd7b1640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f8fc806dfd0 0x7f8fc8128450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:17.267 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fcd7b1640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8fc806e8f0 0x7f8fc8128990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:17.267 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fcd7b1640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f8fc8070ed0 0x7f8fc8128ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:17.267 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fcd7b1640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc813ad40 con 0x7f8fc806dfd0 2026-02-25T17:21:17.267 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fcd7b1640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc812aa10 con 0x7f8fc8070ed0 2026-02-25T17:21:17.267 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fcd7b1640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc812b460 con 0x7f8fc806e8f0 2026-02-25T17:21:17.267 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fc67fc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8fc806e8f0 0x7f8fc8128990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:17.267 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fc6ffd640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f8fc806dfd0 0x7f8fc8128450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:17.267 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fc67fc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8fc806e8f0 0x7f8fc8128990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:58328/0 (socket says 10.20.193.76:58328) 2026-02-25T17:21:17.268 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fc67fc640 1 -- 10.20.193.76:0/2163415895 learned_addr learned my addr 10.20.193.76:0/2163415895 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:17.268 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fc77fe640 1 --2- 10.20.193.76:0/2163415895 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f8fc8070ed0 0x7f8fc8128ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:17.268 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fc67fc640 1 -- 10.20.193.76:0/2163415895 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f8fc8070ed0 msgr2=0x7f8fc8128ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:17.268 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fc67fc640 1 --2- 10.20.193.76:0/2163415895 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f8fc8070ed0 0x7f8fc8128ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:17.268 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fc67fc640 1 -- 10.20.193.76:0/2163415895 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f8fc806dfd0 msgr2=0x7f8fc8128450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:17.268 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fc67fc640 1 --2- 10.20.193.76:0/2163415895 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f8fc806dfd0 0x7f8fc8128450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:17.268 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fc67fc640 1 -- 10.20.193.76:0/2163415895 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb00095d0 con 0x7f8fc806e8f0 2026-02-25T17:21:17.268 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fc67fc640 1 --2- 10.20.193.76:0/2163415895 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8fc806e8f0 0x7f8fc8128990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009b00 tx=0x7f8fb00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:17.268 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fa77fe640 1 -- 10.20.193.76:0/2163415895 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0040660 con 0x7f8fc806e8f0 2026-02-25T17:21:17.268 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fa77fe640 1 -- 10.20.193.76:0/2163415895 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb00407c0 con 0x7f8fc806e8f0 2026-02-25T17:21:17.268 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fcd7b1640 1 -- 10.20.193.76:0/2163415895 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc806ee50 con 0x7f8fc806e8f0 2026-02-25T17:21:17.268 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fa77fe640 1 -- 10.20.193.76:0/2163415895 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0040b70 con 0x7f8fc806e8f0 2026-02-25T17:21:17.269 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.260+0000 7f8fcd7b1640 1 -- 10.20.193.76:0/2163415895 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc8129410 con 0x7f8fc806e8f0 2026-02-25T17:21:17.269 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.261+0000 7f8fcd7b1640 1 -- 10.20.193.76:0/2163415895 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc812bd20 con 0x7f8fc806e8f0 2026-02-25T17:21:17.269 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.261+0000 7f8fa77fe640 1 -- 10.20.193.76:0/2163415895 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f8fb0049020 con 0x7f8fc806e8f0 2026-02-25T17:21:17.269 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.261+0000 7f8fa77fe640 1 -- 10.20.193.76:0/2163415895 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3021+0+0 (secure 0 0 0) 0x7f8fb008bdb0 con 0x7f8fc806e8f0 2026-02-25T17:21:17.269 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.263+0000 7f8fa77fe640 1 -- 10.20.193.76:0/2163415895 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f8fb0065850 con 0x7f8fc806e8f0 2026-02-25T17:21:17.330 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.328+0000 7f8fcd7b1640 1 -- 10.20.193.76:0/2163415895 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8fc806e3b0 con 0x7f8fc806e8f0 2026-02-25T17:21:17.330 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.328+0000 7f8fa77fe640 1 -- 10.20.193.76:0/2163415895 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+8490 (secure 0 0 0) 0x7f8fb003c030 con 0x7f8fc806e8f0 2026-02-25T17:21:17.330 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:17.331 INFO:teuthology.orchestra.run.trial076.stdout:{"epoch":20,"fsid":"0648ee30-4e19-4268-91ad-07b0e65a8518","created":"2026-02-25T17:13:33.780133+0000","modified":"2026-02-25T17:21:17.173929+0000","last_up_change":"2026-02-25T17:21:17.173929+0000","last_in_change":"2026-02-25T17:13:34.859194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-25T17:13:42.208987+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-25T17:13:42.832027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"85909bd3-2540-48a9-a649-33709fa74613","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":17,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6806","nonce":43127}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6808","nonce":43127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6812","nonce":43127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6810","nonce":43127}]},"public_addr":"10.20.193.76:6806/43127","cluster_addr":"10.20.193.76:6808/43127","heartbeat_back_addr":"10.20.193.76:6812/43127","heartbeat_front_addr":"10.20.193.76:6810/43127","state":["exists"]},{"osd":1,"uuid":"f0a0a51c-d629-464e-bc04-dacbaaf78efa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6805","nonce":43126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6807","nonce":43126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6811","nonce":43126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6809","nonce":43126}]},"public_addr":"10.20.193.76:6805/43126","cluster_addr":"10.20.193.76:6807/43126","heartbeat_back_addr":"10.20.193.76:6811/43126","heartbeat_front_addr":"10.20.193.76:6809/43126","state":["exists"]},{"osd":2,"uuid":"9633000b-764d-457a-b560-539dc5830e9e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6813","nonce":43128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6814","nonce":43128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6816","nonce":43128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6815","nonce":43128}]},"public_addr":"10.20.193.76:6813/43128","cluster_addr":"10.20.193.76:6814/43128","heartbeat_back_addr":"10.20.193.76:6816/43128","heartbeat_front_addr":"10.20.193.76:6815/43128","state":["exists"]},{"osd":3,"uuid":"fc098e34-48a8-4414-ad41-60abdf7388a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6801","nonce":43129}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6802","nonce":43129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6804","nonce":43129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6803","nonce":43129}]},"public_addr":"10.20.193.76:6801/43129","cluster_addr":"10.20.193.76:6802/43129","heartbeat_back_addr":"10.20.193.76:6804/43129","heartbeat_front_addr":"10.20.193.76:6803/43129","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.998715+0000","dead_epoch":17},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.974454+0000","dead_epoch":18},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:40.020834+0000","dead_epoch":19},{"osd":3,"down_stamp":"2026-02-25T17:21:17.173929+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.943932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.76:0/94912213":"2026-02-26T17:21:11.039698+0000","10.20.193.76:6800/42442":"2026-02-26T17:21:11.039698+0000","10.20.193.76:0/1432153956":"2026-02-26T17:21:11.039698+0000","10.20.193.76:0/1754372634":"2026-02-26T17:21:11.039698+0000","10.20.193.76:0/599075350":"2026-02-26T17:21:11.039698+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T17:21:17.331 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.329+0000 7f8fcd7b1640 1 -- 10.20.193.76:0/2163415895 >> v1:10.20.193.76:6800/1563581135 conn(0x7f8f9404f880 legacy=0x7f8f94051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:17.331 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.329+0000 7f8fcd7b1640 1 -- 10.20.193.76:0/2163415895 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8fc806e8f0 msgr2=0x7f8fc8128990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:17.331 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.329+0000 7f8fcd7b1640 1 --2- 10.20.193.76:0/2163415895 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8fc806e8f0 0x7f8fc8128990 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009b00 tx=0x7f8fb00047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:17.331 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.329+0000 7f8fcd7b1640 1 -- 10.20.193.76:0/2163415895 shutdown_connections 2026-02-25T17:21:17.331 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.329+0000 7f8fcd7b1640 1 --2- 10.20.193.76:0/2163415895 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f8fc8070ed0 0x7f8fc8128ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:17.331 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.329+0000 7f8fcd7b1640 1 --2- 10.20.193.76:0/2163415895 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f8fc806e8f0 0x7f8fc8128990 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:17.331 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.329+0000 7f8fcd7b1640 1 --2- 10.20.193.76:0/2163415895 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f8fc806dfd0 0x7f8fc8128450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:17.331 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.329+0000 7f8fcd7b1640 1 -- 10.20.193.76:0/2163415895 >> 10.20.193.76:0/2163415895 conn(0x7f8fc809a960 msgr2=0x7f8fc808d770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:17.331 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.329+0000 7f8fcd7b1640 1 -- 10.20.193.76:0/2163415895 shutdown_connections 2026-02-25T17:21:17.331 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:17.329+0000 7f8fcd7b1640 1 -- 10.20.193.76:0/2163415895 wait complete. 2026-02-25T17:21:17.758 INFO:tasks.ceph.osd.3.trial076.stderr:2026-02-25T17:21:17.755+0000 7f194742d780 -1 Falling back to public interface 2026-02-25T17:21:18.218 INFO:tasks.ceph.osd.0.trial076.stderr:2026-02-25T17:21:18.216+0000 7f62a7614780 -1 osd.0 16 log_to_monitors true 2026-02-25T17:21:19.184 INFO:tasks.ceph.osd.0.trial076.stderr:2026-02-25T17:21:19.182+0000 7f629ace3640 -1 osd.0 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T17:21:19.255 INFO:tasks.ceph.osd.1.trial076.stderr:2026-02-25T17:21:19.253+0000 7f09aa00d780 -1 osd.1 16 log_to_monitors true 2026-02-25T17:21:20.188 INFO:tasks.ceph.osd.1.trial076.stderr:2026-02-25T17:21:20.185+0000 7f099dda9640 -1 osd.1 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T17:21:20.206 INFO:tasks.ceph.osd.2.trial076.stderr:2026-02-25T17:21:20.204+0000 7f6fe872e780 -1 osd.2 18 log_to_monitors true 2026-02-25T17:21:20.340 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T17:21:20.410 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.405+0000 7f3c15c38640 1 Processor -- start 2026-02-25T17:21:20.410 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.406+0000 7f3c15c38640 1 -- start start 2026-02-25T17:21:20.410 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.406+0000 7f3c15c38640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f3c1006eac0 0x7f3c101316f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:20.410 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.406+0000 7f3c15c38640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3c10131c30 0x7f3c10134020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:20.411 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.406+0000 7f3c15c38640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c1009d9a0 con 0x7f3c1006dfd0 2026-02-25T17:21:20.411 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.406+0000 7f3c15c38640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c1006eea0 con 0x7f3c1006eac0 2026-02-25T17:21:20.411 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.406+0000 7f3c15c38640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c10099190 con 0x7f3c10131c30 2026-02-25T17:21:20.411 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.406+0000 7f3c0f7fe640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f3c1006dfd0 0x7f3c1006e3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:35352/0 (socket says 10.20.193.76:35352) 2026-02-25T17:21:20.411 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.406+0000 7f3c0f7fe640 1 -- 10.20.193.76:0/296418706 learned_addr learned my addr 10.20.193.76:0/296418706 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:20.411 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.406+0000 7f3c0effd640 1 --2- 10.20.193.76:0/296418706 >> v2:10.20.193.76:3300/0 conn(0x7f3c1006eac0 0x7f3c101316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:20.411 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.406+0000 7f3c0ffff640 1 --2- 10.20.193.76:0/296418706 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3c10131c30 0x7f3c10134020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:20.411 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.406+0000 7f3c0e7fc640 1 -- 10.20.193.76:0/296418706 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229236376 0 0) 0x7f3c1009d9a0 con 0x7f3c1006dfd0 2026-02-25T17:21:20.411 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.406+0000 7f3c0e7fc640 1 -- 10.20.193.76:0/296418706 --> v1:10.20.193.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bf4003620 con 0x7f3c1006dfd0 2026-02-25T17:21:20.411 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.406+0000 7f3c0effd640 1 -- 10.20.193.76:0/296418706 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3c10131c30 msgr2=0x7f3c10134020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:20.411 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.406+0000 7f3c0effd640 1 --2- 10.20.193.76:0/296418706 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3c10131c30 0x7f3c10134020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:20.412 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.406+0000 7f3c0effd640 1 -- 10.20.193.76:0/296418706 >> v1:10.20.193.76:6789/0 conn(0x7f3c1006dfd0 legacy=0x7f3c1006e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:20.412 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.406+0000 7f3c0effd640 1 -- 10.20.193.76:0/296418706 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c10072260 con 0x7f3c1006eac0 2026-02-25T17:21:20.412 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.407+0000 7f3c0effd640 1 --2- 10.20.193.76:0/296418706 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3c1006eac0 0x7f3c101316f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3c000098a0 tx=0x7f3c0002ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433af0cb1842c73d server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:20.412 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.407+0000 7f3c0e7fc640 1 -- 10.20.193.76:0/296418706 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0002fad0 con 0x7f3c1006eac0 2026-02-25T17:21:20.412 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.407+0000 7f3c0e7fc640 1 -- 10.20.193.76:0/296418706 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0002fc30 con 0x7f3c1006eac0 2026-02-25T17:21:20.412 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.407+0000 7f3c0e7fc640 1 -- 10.20.193.76:0/296418706 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00037440 con 0x7f3c1006eac0 2026-02-25T17:21:20.412 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.407+0000 7f3c15c38640 1 -- 10.20.193.76:0/296418706 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3c1006eac0 msgr2=0x7f3c101316f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:20.412 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.407+0000 7f3c15c38640 1 --2- 10.20.193.76:0/296418706 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3c1006eac0 0x7f3c101316f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3c000098a0 tx=0x7f3c0002ee10 comp rx=0 tx=0).stop 2026-02-25T17:21:20.412 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.407+0000 7f3c15c38640 1 -- 10.20.193.76:0/296418706 shutdown_connections 2026-02-25T17:21:20.412 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.407+0000 7f3c15c38640 1 --2- 10.20.193.76:0/296418706 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3c10131c30 0x7f3c10134020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:20.412 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.407+0000 7f3c15c38640 1 --2- 10.20.193.76:0/296418706 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3c1006eac0 0x7f3c101316f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:20.412 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.407+0000 7f3c15c38640 1 -- 10.20.193.76:0/296418706 >> 10.20.193.76:0/296418706 conn(0x7f3c1009a960 msgr2=0x7f3c1009ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:20.412 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.407+0000 7f3c15c38640 1 -- 10.20.193.76:0/296418706 shutdown_connections 2026-02-25T17:21:20.413 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.407+0000 7f3c15c38640 1 -- 10.20.193.76:0/296418706 wait complete. 2026-02-25T17:21:20.413 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.408+0000 7f3c15c38640 1 Processor -- start 2026-02-25T17:21:20.413 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.408+0000 7f3c15c38640 1 -- start start 2026-02-25T17:21:20.415 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.408+0000 7f3c15c38640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3c1006dfd0 0x7f3c1012fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:20.415 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.408+0000 7f3c15c38640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3c1006eac0 0x7f3c10130040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:20.415 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.408+0000 7f3c15c38640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3c10131c30 0x7f3c10130580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:20.415 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.408+0000 7f3c15c38640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c10126ab0 con 0x7f3c1006dfd0 2026-02-25T17:21:20.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.408+0000 7f3c15c38640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1012f470 con 0x7f3c1006eac0 2026-02-25T17:21:20.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.408+0000 7f3c15c38640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1012f840 con 0x7f3c10131c30 2026-02-25T17:21:20.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.408+0000 7f3c0f7fe640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3c1006dfd0 0x7f3c1012fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:20.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.408+0000 7f3c0f7fe640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3c1006dfd0 0x7f3c1012fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:51852/0 (socket says 10.20.193.76:51852) 2026-02-25T17:21:20.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.408+0000 7f3c0ffff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3c10131c30 0x7f3c10130580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:20.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.408+0000 7f3c0f7fe640 1 -- 10.20.193.76:0/62052924 learned_addr learned my addr 10.20.193.76:0/62052924 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:20.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.408+0000 7f3c0effd640 1 --2- 10.20.193.76:0/62052924 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3c1006eac0 0x7f3c10130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:20.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.408+0000 7f3c0f7fe640 1 -- 10.20.193.76:0/62052924 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3c10131c30 msgr2=0x7f3c10130580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:20.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.408+0000 7f3c0f7fe640 1 --2- 10.20.193.76:0/62052924 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3c10131c30 0x7f3c10130580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:20.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.408+0000 7f3c0f7fe640 1 -- 10.20.193.76:0/62052924 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3c1006eac0 msgr2=0x7f3c10130040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:20.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.408+0000 7f3c0f7fe640 1 --2- 10.20.193.76:0/62052924 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3c1006eac0 0x7f3c10130040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:20.416 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.408+0000 7f3c0f7fe640 1 -- 10.20.193.76:0/62052924 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c00009500 con 0x7f3c1006dfd0 2026-02-25T17:21:20.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.408+0000 7f3c0effd640 1 --2- 10.20.193.76:0/62052924 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3c1006eac0 0x7f3c10130040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:20.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.409+0000 7f3c0ffff640 1 --2- 10.20.193.76:0/62052924 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3c10131c30 0x7f3c10130580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:20.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.409+0000 7f3c0f7fe640 1 --2- 10.20.193.76:0/62052924 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3c1006dfd0 0x7f3c1012fb00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc00c730 tx=0x7f3bfc00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:20.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.409+0000 7f3bebfff640 1 -- 10.20.193.76:0/62052924 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc005bb0 con 0x7f3c1006dfd0 2026-02-25T17:21:20.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.409+0000 7f3bebfff640 1 -- 10.20.193.76:0/62052924 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bfc005d10 con 0x7f3c1006dfd0 2026-02-25T17:21:20.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.409+0000 7f3c15c38640 1 -- 10.20.193.76:0/62052924 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c101262a0 con 0x7f3c1006dfd0 2026-02-25T17:21:20.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.409+0000 7f3bebfff640 1 -- 10.20.193.76:0/62052924 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc0072b0 con 0x7f3c1006dfd0 2026-02-25T17:21:20.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.409+0000 7f3c15c38640 1 -- 10.20.193.76:0/62052924 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c100717a0 con 0x7f3c1006dfd0 2026-02-25T17:21:20.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.409+0000 7f3c15c38640 1 -- 10.20.193.76:0/62052924 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c1006e3b0 con 0x7f3c1006dfd0 2026-02-25T17:21:20.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.410+0000 7f3bebfff640 1 -- 10.20.193.76:0/62052924 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f3bfc007410 con 0x7f3c1006dfd0 2026-02-25T17:21:20.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.410+0000 7f3bebfff640 1 -- 10.20.193.76:0/62052924 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3021+0+0 (secure 0 0 0) 0x7f3bfc065ed0 con 0x7f3c1006dfd0 2026-02-25T17:21:20.417 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.412+0000 7f3bebfff640 1 -- 10.20.193.76:0/62052924 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f3bfc03f860 con 0x7f3c1006dfd0 2026-02-25T17:21:20.481 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.479+0000 7f3c15c38640 1 -- 10.20.193.76:0/62052924 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c10068270 con 0x7f3c1006dfd0 2026-02-25T17:21:20.481 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.479+0000 7f3bebfff640 1 -- 10.20.193.76:0/62052924 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+8727 (secure 0 0 0) 0x7f3bfc017030 con 0x7f3c1006dfd0 2026-02-25T17:21:20.482 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:20.482 INFO:teuthology.orchestra.run.trial076.stdout:{"epoch":22,"fsid":"0648ee30-4e19-4268-91ad-07b0e65a8518","created":"2026-02-25T17:13:33.780133+0000","modified":"2026-02-25T17:21:20.179727+0000","last_up_change":"2026-02-25T17:21:20.179727+0000","last_in_change":"2026-02-25T17:13:34.859194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-25T17:13:42.208987+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"error_message":"pool 1 has some PGs where all OSDs are with primary_affinity 0 (at least pg 1.3), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-25T17:13:42.832027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"85909bd3-2540-48a9-a649-33709fa74613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":16,"up_from":22,"up_thru":10,"down_at":17,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6805","nonce":1645506709}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6806","nonce":1645506709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6808","nonce":1645506709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6807","nonce":1645506709}]},"public_addr":"10.20.193.76:6805/1645506709","cluster_addr":"10.20.193.76:6806/1645506709","heartbeat_back_addr":"10.20.193.76:6808/1645506709","heartbeat_front_addr":"10.20.193.76:6807/1645506709","state":["exists","up"]},{"osd":1,"uuid":"f0a0a51c-d629-464e-bc04-dacbaaf78efa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6805","nonce":43126}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6807","nonce":43126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6811","nonce":43126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6809","nonce":43126}]},"public_addr":"10.20.193.76:6805/43126","cluster_addr":"10.20.193.76:6807/43126","heartbeat_back_addr":"10.20.193.76:6811/43126","heartbeat_front_addr":"10.20.193.76:6809/43126","state":["exists"]},{"osd":2,"uuid":"9633000b-764d-457a-b560-539dc5830e9e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":18,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6813","nonce":43128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6814","nonce":43128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6816","nonce":43128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6815","nonce":43128}]},"public_addr":"10.20.193.76:6813/43128","cluster_addr":"10.20.193.76:6814/43128","heartbeat_back_addr":"10.20.193.76:6816/43128","heartbeat_front_addr":"10.20.193.76:6815/43128","state":["exists"]},{"osd":3,"uuid":"fc098e34-48a8-4414-ad41-60abdf7388a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6801","nonce":43129}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6802","nonce":43129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6804","nonce":43129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6803","nonce":43129}]},"public_addr":"10.20.193.76:6801/43129","cluster_addr":"10.20.193.76:6802/43129","heartbeat_back_addr":"10.20.193.76:6804/43129","heartbeat_front_addr":"10.20.193.76:6803/43129","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.998715+0000","dead_epoch":17},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.974454+0000","dead_epoch":18},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:40.020834+0000","dead_epoch":19},{"osd":3,"down_stamp":"2026-02-25T17:21:17.173929+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.943932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.76:0/94912213":"2026-02-26T17:21:11.039698+0000","10.20.193.76:6800/42442":"2026-02-26T17:21:11.039698+0000","10.20.193.76:0/1432153956":"2026-02-26T17:21:11.039698+0000","10.20.193.76:0/1754372634":"2026-02-26T17:21:11.039698+0000","10.20.193.76:0/599075350":"2026-02-26T17:21:11.039698+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T17:21:20.483 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.481+0000 7f3c15c38640 1 -- 10.20.193.76:0/62052924 >> v1:10.20.193.76:6800/1563581135 conn(0x7f3be004f880 legacy=0x7f3be0051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:20.483 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.481+0000 7f3c15c38640 1 -- 10.20.193.76:0/62052924 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3c1006dfd0 msgr2=0x7f3c1012fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:20.484 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.481+0000 7f3c15c38640 1 --2- 10.20.193.76:0/62052924 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3c1006dfd0 0x7f3c1012fb00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc00c730 tx=0x7f3bfc00cc00 comp rx=0 tx=0).stop 2026-02-25T17:21:20.484 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.481+0000 7f3c15c38640 1 -- 10.20.193.76:0/62052924 shutdown_connections 2026-02-25T17:21:20.484 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.481+0000 7f3c15c38640 1 --2- 10.20.193.76:0/62052924 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3c10131c30 0x7f3c10130580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:20.484 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.481+0000 7f3c15c38640 1 --2- 10.20.193.76:0/62052924 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3c1006eac0 0x7f3c10130040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:20.484 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.481+0000 7f3c15c38640 1 --2- 10.20.193.76:0/62052924 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3c1006dfd0 0x7f3c1012fb00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:20.484 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.481+0000 7f3c15c38640 1 -- 10.20.193.76:0/62052924 >> 10.20.193.76:0/62052924 conn(0x7f3c1009a960 msgr2=0x7f3c1009b610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:20.484 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.481+0000 7f3c15c38640 1 -- 10.20.193.76:0/62052924 shutdown_connections 2026-02-25T17:21:20.484 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:20.481+0000 7f3c15c38640 1 -- 10.20.193.76:0/62052924 wait complete. 2026-02-25T17:21:21.189 INFO:tasks.ceph.osd.2.trial076.stderr:2026-02-25T17:21:21.187+0000 7f6fdc4cc640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T17:21:21.190 INFO:tasks.ceph.osd.3.trial076.stderr:2026-02-25T17:21:21.188+0000 7f194742d780 -1 osd.3 19 log_to_monitors true 2026-02-25T17:21:22.191 INFO:tasks.ceph.osd.3.trial076.stderr:2026-02-25T17:21:22.189+0000 7f193a7d2640 -1 osd.3 19 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-25T17:21:23.493 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T17:21:23.568 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.561+0000 7ff9872c0640 1 Processor -- start 2026-02-25T17:21:23.569 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.561+0000 7ff9872c0640 1 -- start start 2026-02-25T17:21:23.569 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.562+0000 7ff9872c0640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff98006fcc0 0x7ff980071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:23.569 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.562+0000 7ff9872c0640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff980133c20 0x7ff980136010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:23.569 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.562+0000 7ff9872c0640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff98009d9a0 con 0x7ff98006f210 2026-02-25T17:21:23.569 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.562+0000 7ff9872c0640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff980070560 con 0x7ff98006fcc0 2026-02-25T17:21:23.569 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.562+0000 7ff9872c0640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800992e0 con 0x7ff980133c20 2026-02-25T17:21:23.570 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.562+0000 7ff985035640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7ff98006f210 0x7ff980070b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:35374/0 (socket says 10.20.193.76:35374) 2026-02-25T17:21:23.570 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.562+0000 7ff985035640 1 -- 10.20.193.76:0/3589209782 learned_addr learned my addr 10.20.193.76:0/3589209782 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:23.570 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.562+0000 7ff985836640 1 --2- 10.20.193.76:0/3589209782 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff980133c20 0x7ff980136010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:23.570 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.562+0000 7ff984834640 1 --2- 10.20.193.76:0/3589209782 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff98006fcc0 0x7ff980071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:23.570 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.562+0000 7ff96ffff640 1 -- 10.20.193.76:0/3589209782 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238796852 0 0) 0x7ff98009d9a0 con 0x7ff98006f210 2026-02-25T17:21:23.570 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.562+0000 7ff96ffff640 1 -- 10.20.193.76:0/3589209782 --> v1:10.20.193.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff968003620 con 0x7ff98006f210 2026-02-25T17:21:23.570 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.562+0000 7ff984834640 1 -- 10.20.193.76:0/3589209782 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff980133c20 msgr2=0x7ff980136010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:23.572 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.562+0000 7ff984834640 1 --2- 10.20.193.76:0/3589209782 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff980133c20 0x7ff980136010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.572 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.562+0000 7ff984834640 1 -- 10.20.193.76:0/3589209782 >> v1:10.20.193.76:6789/0 conn(0x7ff98006f210 legacy=0x7ff980070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:23.572 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.562+0000 7ff984834640 1 -- 10.20.193.76:0/3589209782 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff980070870 con 0x7ff98006fcc0 2026-02-25T17:21:23.572 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.562+0000 7ff985836640 1 --2- 10.20.193.76:0/3589209782 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff980133c20 0x7ff980136010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:23.572 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.562+0000 7ff984834640 1 --2- 10.20.193.76:0/3589209782 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff98006fcc0 0x7ff980071240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff9740098d0 tx=0x7ff97402edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea3c9fcebb509f98 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:23.572 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.562+0000 7ff96ffff640 1 -- 10.20.193.76:0/3589209782 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97402fa30 con 0x7ff98006fcc0 2026-02-25T17:21:23.572 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.562+0000 7ff96ffff640 1 -- 10.20.193.76:0/3589209782 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97402fb90 con 0x7ff98006fcc0 2026-02-25T17:21:23.572 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.562+0000 7ff96ffff640 1 -- 10.20.193.76:0/3589209782 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974037440 con 0x7ff98006fcc0 2026-02-25T17:21:23.573 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.563+0000 7ff9872c0640 1 -- 10.20.193.76:0/3589209782 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff98006fcc0 msgr2=0x7ff980071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:23.573 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.563+0000 7ff9872c0640 1 --2- 10.20.193.76:0/3589209782 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff98006fcc0 0x7ff980071240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff9740098d0 tx=0x7ff97402edc0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.573 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.563+0000 7ff9872c0640 1 -- 10.20.193.76:0/3589209782 shutdown_connections 2026-02-25T17:21:23.573 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.563+0000 7ff9872c0640 1 --2- 10.20.193.76:0/3589209782 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff980133c20 0x7ff980136010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.573 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.563+0000 7ff9872c0640 1 --2- 10.20.193.76:0/3589209782 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff98006fcc0 0x7ff980071240 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.573 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.563+0000 7ff9872c0640 1 -- 10.20.193.76:0/3589209782 >> 10.20.193.76:0/3589209782 conn(0x7ff98009a960 msgr2=0x7ff98009ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:23.573 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.563+0000 7ff9872c0640 1 -- 10.20.193.76:0/3589209782 shutdown_connections 2026-02-25T17:21:23.573 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.563+0000 7ff9872c0640 1 -- 10.20.193.76:0/3589209782 wait complete. 2026-02-25T17:21:23.573 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.563+0000 7ff9872c0640 1 Processor -- start 2026-02-25T17:21:23.573 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.563+0000 7ff9872c0640 1 -- start start 2026-02-25T17:21:23.573 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff9872c0640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff98006f210 0x7ff9800968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:23.574 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff9872c0640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff98006fcc0 0x7ff980096e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:23.574 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff9872c0640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff980133c20 0x7ff980097360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:23.574 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff9872c0640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff980095690 con 0x7ff980133c20 2026-02-25T17:21:23.574 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff9872c0640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800978a0 con 0x7ff98006f210 2026-02-25T17:21:23.574 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff9872c0640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff980095230 con 0x7ff98006fcc0 2026-02-25T17:21:23.574 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff984834640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff98006fcc0 0x7ff980096e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:23.574 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff985035640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff98006f210 0x7ff9800968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:23.574 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff984834640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff98006fcc0 0x7ff980096e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:58356/0 (socket says 10.20.193.76:58356) 2026-02-25T17:21:23.574 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff984834640 1 -- 10.20.193.76:0/2252377042 learned_addr learned my addr 10.20.193.76:0/2252377042 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:23.574 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff985836640 1 --2- 10.20.193.76:0/2252377042 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff980133c20 0x7ff980097360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:23.574 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff984834640 1 -- 10.20.193.76:0/2252377042 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff98006f210 msgr2=0x7ff9800968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:23.574 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff984834640 1 --2- 10.20.193.76:0/2252377042 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff98006f210 0x7ff9800968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.575 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff984834640 1 -- 10.20.193.76:0/2252377042 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff980133c20 msgr2=0x7ff980097360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:23.575 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff984834640 1 --2- 10.20.193.76:0/2252377042 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff980133c20 0x7ff980097360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.575 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff984834640 1 -- 10.20.193.76:0/2252377042 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c009a70 con 0x7ff98006fcc0 2026-02-25T17:21:23.575 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff984834640 1 --2- 10.20.193.76:0/2252377042 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff98006fcc0 0x7ff980096e20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff97403a040 tx=0x7ff9740047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:23.575 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff96dffb640 1 -- 10.20.193.76:0/2252377042 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974046070 con 0x7ff98006fcc0 2026-02-25T17:21:23.575 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff96dffb640 1 -- 10.20.193.76:0/2252377042 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff974042470 con 0x7ff98006fcc0 2026-02-25T17:21:23.575 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff9872c0640 1 -- 10.20.193.76:0/2252377042 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff974009500 con 0x7ff98006fcc0 2026-02-25T17:21:23.575 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff96dffb640 1 -- 10.20.193.76:0/2252377042 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974042800 con 0x7ff98006fcc0 2026-02-25T17:21:23.575 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.564+0000 7ff9872c0640 1 -- 10.20.193.76:0/2252377042 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff980095d30 con 0x7ff98006fcc0 2026-02-25T17:21:23.575 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.565+0000 7ff9872c0640 1 -- 10.20.193.76:0/2252377042 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff980096730 con 0x7ff98006fcc0 2026-02-25T17:21:23.576 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.565+0000 7ff96dffb640 1 -- 10.20.193.76:0/2252377042 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7ff974042960 con 0x7ff98006fcc0 2026-02-25T17:21:23.576 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.565+0000 7ff96dffb640 1 -- 10.20.193.76:0/2252377042 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3021+0+0 (secure 0 0 0) 0x7ff97408bd60 con 0x7ff98006fcc0 2026-02-25T17:21:23.577 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.567+0000 7ff96dffb640 1 -- 10.20.193.76:0/2252377042 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7ff974065920 con 0x7ff98006fcc0 2026-02-25T17:21:23.636 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.633+0000 7ff9872c0640 1 -- 10.20.193.76:0/2252377042 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff980068270 con 0x7ff98006fcc0 2026-02-25T17:21:23.637 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.634+0000 7ff96dffb640 1 -- 10.20.193.76:0/2252377042 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+9088 (secure 0 0 0) 0x7ff97403c070 con 0x7ff98006fcc0 2026-02-25T17:21:23.637 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:23.637 INFO:teuthology.orchestra.run.trial076.stdout:{"epoch":25,"fsid":"0648ee30-4e19-4268-91ad-07b0e65a8518","created":"2026-02-25T17:13:33.780133+0000","modified":"2026-02-25T17:21:23.187037+0000","last_up_change":"2026-02-25T17:21:23.187037+0000","last_in_change":"2026-02-25T17:13:34.859194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-25T17:13:42.208987+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-25T17:13:42.832027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85909bd3-2540-48a9-a649-33709fa74613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":16,"up_from":22,"up_thru":23,"down_at":17,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6805","nonce":1645506709}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6806","nonce":1645506709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6808","nonce":1645506709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6807","nonce":1645506709}]},"public_addr":"10.20.193.76:6805/1645506709","cluster_addr":"10.20.193.76:6806/1645506709","heartbeat_back_addr":"10.20.193.76:6808/1645506709","heartbeat_front_addr":"10.20.193.76:6807/1645506709","state":["exists","up"]},{"osd":1,"uuid":"f0a0a51c-d629-464e-bc04-dacbaaf78efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":16,"up_from":23,"up_thru":24,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6809","nonce":1923901808}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6810","nonce":1923901808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6812","nonce":1923901808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6811","nonce":1923901808}]},"public_addr":"10.20.193.76:6809/1923901808","cluster_addr":"10.20.193.76:6810/1923901808","heartbeat_back_addr":"10.20.193.76:6812/1923901808","heartbeat_front_addr":"10.20.193.76:6811/1923901808","state":["exists","up"]},{"osd":2,"uuid":"9633000b-764d-457a-b560-539dc5830e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":24,"up_thru":24,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6801","nonce":3531107996}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6802","nonce":3531107996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6804","nonce":3531107996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6803","nonce":3531107996}]},"public_addr":"10.20.193.76:6801/3531107996","cluster_addr":"10.20.193.76:6802/3531107996","heartbeat_back_addr":"10.20.193.76:6804/3531107996","heartbeat_front_addr":"10.20.193.76:6803/3531107996","state":["exists","up"]},{"osd":3,"uuid":"fc098e34-48a8-4414-ad41-60abdf7388a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":19,"up_from":25,"up_thru":19,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6813","nonce":39660203}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6814","nonce":39660203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6816","nonce":39660203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6815","nonce":39660203}]},"public_addr":"10.20.193.76:6813/39660203","cluster_addr":"10.20.193.76:6814/39660203","heartbeat_back_addr":"10.20.193.76:6816/39660203","heartbeat_front_addr":"10.20.193.76:6815/39660203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.998715+0000","dead_epoch":17},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.974454+0000","dead_epoch":18},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:40.020834+0000","dead_epoch":19},{"osd":3,"down_stamp":"2026-02-25T17:21:17.173929+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.943932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.76:0/94912213":"2026-02-26T17:21:11.039698+0000","10.20.193.76:6800/42442":"2026-02-26T17:21:11.039698+0000","10.20.193.76:0/1432153956":"2026-02-26T17:21:11.039698+0000","10.20.193.76:0/1754372634":"2026-02-26T17:21:11.039698+0000","10.20.193.76:0/599075350":"2026-02-26T17:21:11.039698+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T17:21:23.638 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.635+0000 7ff9872c0640 1 -- 10.20.193.76:0/2252377042 >> v1:10.20.193.76:6800/1563581135 conn(0x7ff95004f880 legacy=0x7ff950051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:23.638 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.635+0000 7ff9872c0640 1 -- 10.20.193.76:0/2252377042 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff98006fcc0 msgr2=0x7ff980096e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:23.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.635+0000 7ff9872c0640 1 --2- 10.20.193.76:0/2252377042 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff98006fcc0 0x7ff980096e20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff97403a040 tx=0x7ff9740047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.635+0000 7ff9872c0640 1 -- 10.20.193.76:0/2252377042 shutdown_connections 2026-02-25T17:21:23.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.635+0000 7ff9872c0640 1 --2- 10.20.193.76:0/2252377042 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff980133c20 0x7ff980097360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.635+0000 7ff9872c0640 1 --2- 10.20.193.76:0/2252377042 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff98006fcc0 0x7ff980096e20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.635+0000 7ff9872c0640 1 --2- 10.20.193.76:0/2252377042 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff98006f210 0x7ff9800968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.635+0000 7ff9872c0640 1 -- 10.20.193.76:0/2252377042 >> 10.20.193.76:0/2252377042 conn(0x7ff98009a960 msgr2=0x7ff980134000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:23.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.635+0000 7ff9872c0640 1 -- 10.20.193.76:0/2252377042 shutdown_connections 2026-02-25T17:21:23.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.635+0000 7ff9872c0640 1 -- 10.20.193.76:0/2252377042 wait complete. 2026-02-25T17:21:23.646 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-25T17:21:23.646 INFO:teuthology.run_tasks:Running task exec... 2026-02-25T17:21:23.664 INFO:teuthology.task.exec:Executing custom commands... 2026-02-25T17:21:23.665 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@trial076.front.sepia.ceph.com 2026-02-25T17:21:23.665 DEBUG:teuthology.orchestra.run.trial076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2026-02-25T17:21:23.732 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.724+0000 7f066d438640 1 Processor -- start 2026-02-25T17:21:23.732 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.724+0000 7f066d438640 1 -- start start 2026-02-25T17:21:23.732 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.725+0000 7f066d438640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0668096440 0x7f0668133640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:23.733 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.725+0000 7f066d438640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0668133b80 0x7f0668135f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:23.733 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.725+0000 7f066d438640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f066809a510 con 0x7f066812e870 2026-02-25T17:21:23.733 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.725+0000 7f066d438640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0668095cc0 con 0x7f0668133b80 2026-02-25T17:21:23.733 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.725+0000 7f066d438640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0668096dd0 con 0x7f0668096440 2026-02-25T17:21:23.733 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.725+0000 7f0666ffd640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f066812e870 0x7f066812ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:35382/0 (socket says 10.20.193.76:35382) 2026-02-25T17:21:23.733 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.725+0000 7f0666ffd640 1 -- 10.20.193.76:0/23774916 learned_addr learned my addr 10.20.193.76:0/23774916 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:23.733 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.725+0000 7f06667fc640 1 --2- 10.20.193.76:0/23774916 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0668096440 0x7f0668133640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:23.733 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.725+0000 7f06677fe640 1 --2- 10.20.193.76:0/23774916 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0668133b80 0x7f0668135f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:23.733 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.725+0000 7f0665ffb640 1 -- 10.20.193.76:0/23774916 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601232571 0 0) 0x7f065c002920 con 0x7f066812e870 2026-02-25T17:21:23.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.725+0000 7f0665ffb640 1 -- 10.20.193.76:0/23774916 --> v1:10.20.193.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0654003620 con 0x7f066812e870 2026-02-25T17:21:23.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.725+0000 7f06667fc640 1 -- 10.20.193.76:0/23774916 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0668133b80 msgr2=0x7f0668135f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:23.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.725+0000 7f06667fc640 1 --2- 10.20.193.76:0/23774916 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0668133b80 0x7f0668135f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.725+0000 7f06667fc640 1 -- 10.20.193.76:0/23774916 >> v1:10.20.193.76:6789/0 conn(0x7f066812e870 legacy=0x7f066812ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:23.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.725+0000 7f06667fc640 1 -- 10.20.193.76:0/23774916 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066812e590 con 0x7f0668096440 2026-02-25T17:21:23.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.725+0000 7f06677fe640 1 --2- 10.20.193.76:0/23774916 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0668133b80 0x7f0668135f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:23.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.725+0000 7f06667fc640 1 --2- 10.20.193.76:0/23774916 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0668096440 0x7f0668133640 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f06500098d0 tx=0x7f065002edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58d7dd5824ae790 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:23.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.725+0000 7f0665ffb640 1 -- 10.20.193.76:0/23774916 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065002fa30 con 0x7f0668096440 2026-02-25T17:21:23.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.726+0000 7f0665ffb640 1 -- 10.20.193.76:0/23774916 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065002fb90 con 0x7f0668096440 2026-02-25T17:21:23.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.726+0000 7f0665ffb640 1 -- 10.20.193.76:0/23774916 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650037440 con 0x7f0668096440 2026-02-25T17:21:23.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.726+0000 7f066d438640 1 -- 10.20.193.76:0/23774916 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0668096440 msgr2=0x7f0668133640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:23.734 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.726+0000 7f066d438640 1 --2- 10.20.193.76:0/23774916 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0668096440 0x7f0668133640 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f06500098d0 tx=0x7f065002edc0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.726+0000 7f066d438640 1 -- 10.20.193.76:0/23774916 shutdown_connections 2026-02-25T17:21:23.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.726+0000 7f066d438640 1 --2- 10.20.193.76:0/23774916 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0668133b80 0x7f0668135f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.726+0000 7f066d438640 1 --2- 10.20.193.76:0/23774916 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0668096440 0x7f0668133640 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.726+0000 7f066d438640 1 -- 10.20.193.76:0/23774916 >> 10.20.193.76:0/23774916 conn(0x7f066809b780 msgr2=0x7f066809bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:23.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.726+0000 7f066d438640 1 -- 10.20.193.76:0/23774916 shutdown_connections 2026-02-25T17:21:23.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.726+0000 7f066d438640 1 -- 10.20.193.76:0/23774916 wait complete. 2026-02-25T17:21:23.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.726+0000 7f066d438640 1 Processor -- start 2026-02-25T17:21:23.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.726+0000 7f066d438640 1 -- start start 2026-02-25T17:21:23.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f066d438640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0668096440 0x7f066812f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:23.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f066d438640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f066812e870 0x7f066812fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:23.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f066d438640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0668133b80 0x7f0668130100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:23.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f066d438640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0668130b00 con 0x7f066812e870 2026-02-25T17:21:23.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f066d438640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0668132770 con 0x7f0668133b80 2026-02-25T17:21:23.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f066d438640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0668132440 con 0x7f0668096440 2026-02-25T17:21:23.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f0666ffd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0668096440 0x7f066812f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:23.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f06667fc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f066812e870 0x7f066812fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:23.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f0666ffd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0668096440 0x7f066812f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:58368/0 (socket says 10.20.193.76:58368) 2026-02-25T17:21:23.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f06677fe640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0668133b80 0x7f0668130100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:23.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f0666ffd640 1 -- 10.20.193.76:0/2810486012 learned_addr learned my addr 10.20.193.76:0/2810486012 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:23.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f0666ffd640 1 -- 10.20.193.76:0/2810486012 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0668133b80 msgr2=0x7f0668130100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:23.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f0666ffd640 1 --2- 10.20.193.76:0/2810486012 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0668133b80 0x7f0668130100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f0666ffd640 1 -- 10.20.193.76:0/2810486012 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f066812e870 msgr2=0x7f066812fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:23.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f0666ffd640 1 --2- 10.20.193.76:0/2810486012 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f066812e870 0x7f066812fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f0666ffd640 1 -- 10.20.193.76:0/2810486012 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0658009a70 con 0x7f0668096440 2026-02-25T17:21:23.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f0666ffd640 1 --2- 10.20.193.76:0/2810486012 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0668096440 0x7f066812f680 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f065c00c730 tx=0x7f065c00cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:23.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f06477fe640 1 -- 10.20.193.76:0/2810486012 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c005bb0 con 0x7f0668096440 2026-02-25T17:21:23.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f06477fe640 1 -- 10.20.193.76:0/2810486012 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065c005d10 con 0x7f0668096440 2026-02-25T17:21:23.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f066d438640 1 -- 10.20.193.76:0/2810486012 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0650009500 con 0x7f0668096440 2026-02-25T17:21:23.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f06477fe640 1 -- 10.20.193.76:0/2810486012 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065c007290 con 0x7f0668096440 2026-02-25T17:21:23.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.727+0000 7f066d438640 1 -- 10.20.193.76:0/2810486012 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0668131b30 con 0x7f0668096440 2026-02-25T17:21:23.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.728+0000 7f066d438640 1 -- 10.20.193.76:0/2810486012 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0668131d80 con 0x7f0668096440 2026-02-25T17:21:23.738 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.728+0000 7f06477fe640 1 -- 10.20.193.76:0/2810486012 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f065c0073f0 con 0x7f0668096440 2026-02-25T17:21:23.738 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.728+0000 7f06477fe640 1 -- 10.20.193.76:0/2810486012 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3021+0+0 (secure 0 0 0) 0x7f065c065c20 con 0x7f0668096440 2026-02-25T17:21:23.738 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.730+0000 7f06477fe640 1 -- 10.20.193.76:0/2810486012 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f065c03f5b0 con 0x7f0668096440 2026-02-25T17:21:23.818 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.816+0000 7f066d438640 1 -- 10.20.193.76:0/2810486012 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f066809a510 con 0x7f0668096440 2026-02-25T17:21:23.818 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.816+0000 7f06477fe640 1 -- 10.20.193.76:0/2810486012 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+507 (secure 0 0 0) 0x7f066809a510 con 0x7f0668096440 2026-02-25T17:21:23.818 INFO:teuthology.orchestra.run.trial076.stdout:{ 2026-02-25T17:21:23.818 INFO:teuthology.orchestra.run.trial076.stdout: "mon": { 2026-02-25T17:21:23.818 INFO:teuthology.orchestra.run.trial076.stdout: "ceph version 18.2.7-1050-g0ef62ce8 (0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28) reef (stable)": 3 2026-02-25T17:21:23.818 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.818 INFO:teuthology.orchestra.run.trial076.stdout: "mgr": { 2026-02-25T17:21:23.818 INFO:teuthology.orchestra.run.trial076.stdout: "ceph version 18.2.7-1050-g0ef62ce8 (0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28) reef (stable)": 2 2026-02-25T17:21:23.818 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.818 INFO:teuthology.orchestra.run.trial076.stdout: "osd": { 2026-02-25T17:21:23.818 INFO:teuthology.orchestra.run.trial076.stdout: "ceph version 18.2.7-1050-g0ef62ce8 (0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28) reef (stable)": 4 2026-02-25T17:21:23.819 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.819 INFO:teuthology.orchestra.run.trial076.stdout: "overall": { 2026-02-25T17:21:23.819 INFO:teuthology.orchestra.run.trial076.stdout: "ceph version 18.2.7-1050-g0ef62ce8 (0ef62ce8e48de042e1e5e6a70cfa2ee3f1174d28) reef (stable)": 9 2026-02-25T17:21:23.819 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.819 INFO:teuthology.orchestra.run.trial076.stdout:} 2026-02-25T17:21:23.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.817+0000 7f066d438640 1 -- 10.20.193.76:0/2810486012 >> v1:10.20.193.76:6800/1563581135 conn(0x7f063404f8b0 legacy=0x7f0634051d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:23.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.817+0000 7f066d438640 1 -- 10.20.193.76:0/2810486012 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0668096440 msgr2=0x7f066812f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:23.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.817+0000 7f066d438640 1 --2- 10.20.193.76:0/2810486012 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0668096440 0x7f066812f680 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f065c00c730 tx=0x7f065c00cc00 comp rx=0 tx=0).stop 2026-02-25T17:21:23.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.817+0000 7f066d438640 1 -- 10.20.193.76:0/2810486012 shutdown_connections 2026-02-25T17:21:23.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.817+0000 7f066d438640 1 --2- 10.20.193.76:0/2810486012 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0668133b80 0x7f0668130100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.817+0000 7f066d438640 1 --2- 10.20.193.76:0/2810486012 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f066812e870 0x7f066812fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.817+0000 7f066d438640 1 --2- 10.20.193.76:0/2810486012 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0668096440 0x7f066812f680 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.817+0000 7f066d438640 1 -- 10.20.193.76:0/2810486012 >> 10.20.193.76:0/2810486012 conn(0x7f066809b780 msgr2=0x7f066812d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:23.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.817+0000 7f066d438640 1 -- 10.20.193.76:0/2810486012 shutdown_connections 2026-02-25T17:21:23.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.817+0000 7f066d438640 1 -- 10.20.193.76:0/2810486012 wait complete. 2026-02-25T17:21:23.825 DEBUG:teuthology.orchestra.run.trial076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2026-02-25T17:21:23.892 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.886+0000 7fbbd73e5640 1 Processor -- start 2026-02-25T17:21:23.892 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.886+0000 7fbbd73e5640 1 -- start start 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.886+0000 7fbbd73e5640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fbbd012e870 0x7fbbd012ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.886+0000 7fbbd73e5640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fbbd0096440 0x7fbbd0094910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.886+0000 7fbbd73e5640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbbd0094e50 0x7fbbd00952e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.886+0000 7fbbd73e5640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd0096dd0 con 0x7fbbd0096440 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.886+0000 7fbbd73e5640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd0097060 con 0x7fbbd012e870 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.886+0000 7fbbd73e5640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd009a510 con 0x7fbbd0094e50 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.886+0000 7fbbd4959640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fbbd0096440 0x7fbbd0094910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.886+0000 7fbbd595b640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbbd0094e50 0x7fbbd00952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.886+0000 7fbbd515a640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fbbd012e870 0x7fbbd012ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.886+0000 7fbbd4959640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fbbd0096440 0x7fbbd0094910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:51888/0 (socket says 10.20.193.76:51888) 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.886+0000 7fbbd595b640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbbd0094e50 0x7fbbd00952e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:58370/0 (socket says 10.20.193.76:58370) 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.886+0000 7fbbd4959640 1 -- 10.20.193.76:0/3478186849 learned_addr learned my addr 10.20.193.76:0/3478186849 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.886+0000 7fbbd595b640 1 -- 10.20.193.76:0/3478186849 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fbbd012e870 msgr2=0x7fbbd012ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.886+0000 7fbbd595b640 1 --2- 10.20.193.76:0/3478186849 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fbbd012e870 0x7fbbd012ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.886+0000 7fbbd595b640 1 -- 10.20.193.76:0/3478186849 >> v2:10.20.193.76:3300/0 conn(0x7fbbd0096440 msgr2=0x7fbbd0094910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.886+0000 7fbbd595b640 1 --2- 10.20.193.76:0/3478186849 >> v2:10.20.193.76:3300/0 conn(0x7fbbd0096440 0x7fbbd0094910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.886+0000 7fbbd595b640 1 -- 10.20.193.76:0/3478186849 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd012f190 con 0x7fbbd0094e50 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.886+0000 7fbbd4959640 1 --2- 10.20.193.76:0/3478186849 >> v2:10.20.193.76:3300/0 conn(0x7fbbd0096440 0x7fbbd0094910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.887+0000 7fbbd595b640 1 --2- 10.20.193.76:0/3478186849 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbbd0094e50 0x7fbbd00952e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc009d90 tx=0x7fbbcc02f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b8ea4c7559012dd server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.887+0000 7fbbbffff640 1 -- 10.20.193.76:0/3478186849 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc006ea0 con 0x7fbbd0094e50 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.887+0000 7fbbbffff640 1 -- 10.20.193.76:0/3478186849 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbcc02fdc0 con 0x7fbbd0094e50 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.887+0000 7fbbbffff640 1 -- 10.20.193.76:0/3478186849 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc037660 con 0x7fbbd0094e50 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.887+0000 7fbbd73e5640 1 -- 10.20.193.76:0/3478186849 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbbd0094e50 msgr2=0x7fbbd00952e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.887+0000 7fbbd73e5640 1 --2- 10.20.193.76:0/3478186849 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbbd0094e50 0x7fbbd00952e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc009d90 tx=0x7fbbcc02f150 comp rx=0 tx=0).stop 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.887+0000 7fbbd73e5640 1 -- 10.20.193.76:0/3478186849 shutdown_connections 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.887+0000 7fbbd73e5640 1 --2- 10.20.193.76:0/3478186849 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbbd0094e50 0x7fbbd00952e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.887+0000 7fbbd73e5640 1 --2- 10.20.193.76:0/3478186849 >> v2:10.20.193.76:3300/0 conn(0x7fbbd0096440 0x7fbbd0094910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.887+0000 7fbbd73e5640 1 --2- 10.20.193.76:0/3478186849 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fbbd012e870 0x7fbbd012ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.887+0000 7fbbd73e5640 1 -- 10.20.193.76:0/3478186849 >> 10.20.193.76:0/3478186849 conn(0x7fbbd009b780 msgr2=0x7fbbd009bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.887+0000 7fbbd73e5640 1 -- 10.20.193.76:0/3478186849 shutdown_connections 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.887+0000 7fbbd73e5640 1 -- 10.20.193.76:0/3478186849 wait complete. 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd73e5640 1 Processor -- start 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd73e5640 1 -- start start 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd73e5640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fbbd0094e50 0x7fbbd01c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:23.893 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd73e5640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbbd0096440 0x7fbbd01c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd73e5640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fbbd012e870 0x7fbbd0132020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd73e5640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd0121ff0 con 0x7fbbd0094e50 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd73e5640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd0133af0 con 0x7fbbd012e870 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd73e5640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd0134e80 con 0x7fbbd0096440 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd4959640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbbd0096440 0x7fbbd01c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd515a640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fbbd0094e50 0x7fbbd01c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd4959640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbbd0096440 0x7fbbd01c5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:58386/0 (socket says 10.20.193.76:58386) 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd595b640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fbbd012e870 0x7fbbd0132020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd4959640 1 -- 10.20.193.76:0/3491611964 learned_addr learned my addr 10.20.193.76:0/3491611964 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd4959640 1 -- 10.20.193.76:0/3491611964 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fbbd012e870 msgr2=0x7fbbd0132020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd4959640 1 --2- 10.20.193.76:0/3491611964 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fbbd012e870 0x7fbbd0132020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd4959640 1 -- 10.20.193.76:0/3491611964 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fbbd0094e50 msgr2=0x7fbbd01c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd4959640 1 --2- 10.20.193.76:0/3491611964 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fbbd0094e50 0x7fbbd01c57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd4959640 1 -- 10.20.193.76:0/3491611964 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc40095d0 con 0x7fbbd0096440 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd595b640 1 --2- 10.20.193.76:0/3491611964 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fbbd012e870 0x7fbbd0132020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd4959640 1 --2- 10.20.193.76:0/3491611964 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbbd0096440 0x7fbbd01c5cf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbbc400ebe0 tx=0x7fbbc400c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbbdffb640 1 -- 10.20.193.76:0/3491611964 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc400cc40 con 0x7fbbd0096440 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbbdffb640 1 -- 10.20.193.76:0/3491611964 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc400cda0 con 0x7fbbd0096440 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd73e5640 1 -- 10.20.193.76:0/3491611964 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbcc009a70 con 0x7fbbd0096440 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbbdffb640 1 -- 10.20.193.76:0/3491611964 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4013690 con 0x7fbbd0096440 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.888+0000 7fbbd73e5640 1 -- 10.20.193.76:0/3491611964 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd01342f0 con 0x7fbbd0096440 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.889+0000 7fbbd73e5640 1 -- 10.20.193.76:0/3491611964 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd012dc90 con 0x7fbbd0096440 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.889+0000 7fbbbdffb640 1 -- 10.20.193.76:0/3491611964 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fbbc4011070 con 0x7fbbd0096440 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.889+0000 7fbbbdffb640 1 -- 10.20.193.76:0/3491611964 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3021+0+0 (secure 0 0 0) 0x7fbbc40669f0 con 0x7fbbd0096440 2026-02-25T17:21:23.894 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.891+0000 7fbbbdffb640 1 -- 10.20.193.76:0/3491611964 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7fbbc4040380 con 0x7fbbd0096440 2026-02-25T17:21:23.960 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.958+0000 7fbbd73e5640 1 -- 10.20.193.76:0/3491611964 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fbbd012d8d0 con 0x7fbbd0096440 2026-02-25T17:21:23.961 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.959+0000 7fbbbdffb640 1 -- 10.20.193.76:0/3491611964 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v25) v1 ==== 81+0+16716 (secure 0 0 0) 0x7fbbc4017020 con 0x7fbbd0096440 2026-02-25T17:21:23.961 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:23.961 INFO:teuthology.orchestra.run.trial076.stdout:{ 2026-02-25T17:21:23.961 INFO:teuthology.orchestra.run.trial076.stdout: "epoch": 25, 2026-02-25T17:21:23.961 INFO:teuthology.orchestra.run.trial076.stdout: "fsid": "0648ee30-4e19-4268-91ad-07b0e65a8518", 2026-02-25T17:21:23.961 INFO:teuthology.orchestra.run.trial076.stdout: "created": "2026-02-25T17:13:33.780133+0000", 2026-02-25T17:21:23.961 INFO:teuthology.orchestra.run.trial076.stdout: "modified": "2026-02-25T17:21:23.187037+0000", 2026-02-25T17:21:23.961 INFO:teuthology.orchestra.run.trial076.stdout: "last_up_change": "2026-02-25T17:21:23.187037+0000", 2026-02-25T17:21:23.961 INFO:teuthology.orchestra.run.trial076.stdout: "last_in_change": "2026-02-25T17:13:34.859194+0000", 2026-02-25T17:21:23.961 INFO:teuthology.orchestra.run.trial076.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-25T17:21:23.961 INFO:teuthology.orchestra.run.trial076.stdout: "flags_num": 5799936, 2026-02-25T17:21:23.961 INFO:teuthology.orchestra.run.trial076.stdout: "flags_set": [ 2026-02-25T17:21:23.961 INFO:teuthology.orchestra.run.trial076.stdout: "pglog_hardlimit", 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "purged_snapdirs", 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "recovery_deletes", 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "sortbitwise" 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: ], 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "crush_version": 8, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "full_ratio": 0.94999998807907104, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "backfillfull_ratio": 0.89999997615814209, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "cluster_snapshot": "", 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "pool_max": 2, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "max_osd": 4, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "require_min_compat_client": "quincy", 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "min_compat_client": "jewel", 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "require_osd_release": "quincy", 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "allow_crimson": false, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "pools": [ 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "pool": 1, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "pool_name": "rbd", 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "create_time": "2026-02-25T17:13:42.208987+0000", 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "flags": 8193, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "type": 1, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "size": 2, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "min_size": 1, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "crush_rule": 0, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "peering_crush_bucket_count": 0, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "peering_crush_bucket_target": 0, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "peering_crush_bucket_barrier": 0, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "is_stretch_pool": false, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "object_hash": 2, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "pg_autoscale_mode": "off", 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "pg_num": 8, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "pg_placement_num": 8, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "pg_placement_num_target": 8, 2026-02-25T17:21:23.962 INFO:teuthology.orchestra.run.trial076.stdout: "pg_num_target": 8, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "pg_num_pending": 8, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "last_pg_merge_meta": { 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "source_pgid": "0.0", 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "ready_epoch": 0, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "last_epoch_started": 0, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "last_epoch_clean": 0, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "source_version": "0'0", 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "target_version": "0'0" 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "last_change": "13", 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "last_force_op_resend": "0", 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "last_force_op_resend_preluminous": "0", 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "auid": 0, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "snap_mode": "selfmanaged", 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "snap_seq": 3, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "snap_epoch": 13, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "pool_snaps": [], 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "removed_snaps": "[]", 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "quota_max_bytes": 0, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "quota_max_objects": 0, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "tiers": [], 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "tier_of": -1, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "read_tier": -1, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "write_tier": -1, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "cache_mode": "none", 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "target_max_bytes": 0, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "target_max_objects": 0, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "cache_min_flush_age": 0, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "cache_min_evict_age": 0, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "erasure_code_profile": "", 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "hit_set_params": { 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "type": "none" 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "hit_set_period": 0, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "hit_set_count": 0, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "use_gmt_hitset": true, 2026-02-25T17:21:23.963 INFO:teuthology.orchestra.run.trial076.stdout: "min_read_recency_for_promote": 0, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "min_write_recency_for_promote": 0, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "hit_set_grade_decay_rate": 0, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "hit_set_search_last_n": 0, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "grade_table": [], 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "stripe_width": 0, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "expected_num_objects": 0, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "fast_read": false, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "options": {}, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "application_metadata": { 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "rbd": {} 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "read_balance": { 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "score_acting": 1.5, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "score_stable": 1.5, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "optimal_score": 1, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "raw_score_acting": 1.5, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "raw_score_stable": 1.5, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "primary_affinity_weighted": 1, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "average_primary_affinity": 1, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "average_primary_affinity_weighted": 1 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "pool": 2, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "pool_name": ".mgr", 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "create_time": "2026-02-25T17:13:42.832027+0000", 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "flags": 1, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "flags_names": "hashpspool", 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "type": 1, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "size": 2, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "min_size": 1, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "crush_rule": 0, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "peering_crush_bucket_count": 0, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "peering_crush_bucket_target": 0, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "peering_crush_bucket_barrier": 0, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "is_stretch_pool": false, 2026-02-25T17:21:23.964 INFO:teuthology.orchestra.run.trial076.stdout: "object_hash": 2, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "pg_autoscale_mode": "off", 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "pg_num": 1, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "pg_placement_num": 1, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "pg_placement_num_target": 1, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "pg_num_target": 1, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "pg_num_pending": 1, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "last_pg_merge_meta": { 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "source_pgid": "0.0", 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "ready_epoch": 0, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "last_epoch_started": 0, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "last_epoch_clean": 0, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "source_version": "0'0", 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "target_version": "0'0" 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "last_change": "12", 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "last_force_op_resend": "0", 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "last_force_op_resend_preluminous": "0", 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "auid": 0, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "snap_mode": "selfmanaged", 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "snap_seq": 0, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "snap_epoch": 0, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "pool_snaps": [], 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "removed_snaps": "[]", 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "quota_max_bytes": 0, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "quota_max_objects": 0, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "tiers": [], 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "tier_of": -1, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "read_tier": -1, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "write_tier": -1, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "cache_mode": "none", 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "target_max_bytes": 0, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "target_max_objects": 0, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "cache_min_flush_age": 0, 2026-02-25T17:21:23.965 INFO:teuthology.orchestra.run.trial076.stdout: "cache_min_evict_age": 0, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "erasure_code_profile": "", 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "hit_set_params": { 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "type": "none" 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "hit_set_period": 0, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "hit_set_count": 0, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "use_gmt_hitset": true, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "min_read_recency_for_promote": 0, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "min_write_recency_for_promote": 0, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "hit_set_grade_decay_rate": 0, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "hit_set_search_last_n": 0, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "grade_table": [], 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "stripe_width": 0, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "expected_num_objects": 0, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "fast_read": false, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "options": { 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "pg_num_max": 32, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "pg_num_min": 1 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "application_metadata": { 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "mgr": {} 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "read_balance": { 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "score_acting": 4, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "score_stable": 4, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "optimal_score": 0.5, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "raw_score_acting": 2, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "raw_score_stable": 2, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "primary_affinity_weighted": 1, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "average_primary_affinity": 1, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "average_primary_affinity_weighted": 1 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: ], 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "osds": [ 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "osd": 0, 2026-02-25T17:21:23.966 INFO:teuthology.orchestra.run.trial076.stdout: "uuid": "85909bd3-2540-48a9-a649-33709fa74613", 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "up": 1, 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "in": 1, 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "weight": 1, 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "primary_affinity": 1, 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "last_clean_begin": 9, 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "last_clean_end": 16, 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "up_from": 22, 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "up_thru": 23, 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "down_at": 17, 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "lost_at": 0, 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "public_addrs": { 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "addrvec": [ 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "type": "v1", 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "addr": "10.20.193.76:6805", 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "nonce": 1645506709 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: ] 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "cluster_addrs": { 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "addrvec": [ 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "type": "v1", 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "addr": "10.20.193.76:6806", 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "nonce": 1645506709 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: ] 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "heartbeat_back_addrs": { 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "addrvec": [ 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "type": "v1", 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "addr": "10.20.193.76:6808", 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: "nonce": 1645506709 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: ] 2026-02-25T17:21:23.967 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "heartbeat_front_addrs": { 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "addrvec": [ 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "type": "v1", 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "addr": "10.20.193.76:6807", 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "nonce": 1645506709 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: ] 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "public_addr": "10.20.193.76:6805/1645506709", 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "cluster_addr": "10.20.193.76:6806/1645506709", 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "heartbeat_back_addr": "10.20.193.76:6808/1645506709", 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "heartbeat_front_addr": "10.20.193.76:6807/1645506709", 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "state": [ 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "exists", 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "up" 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: ] 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "osd": 1, 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "uuid": "f0a0a51c-d629-464e-bc04-dacbaaf78efa", 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "up": 1, 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "in": 1, 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "weight": 1, 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "primary_affinity": 1, 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "last_clean_begin": 9, 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "last_clean_end": 16, 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "up_from": 23, 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "up_thru": 24, 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "down_at": 18, 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "lost_at": 0, 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "public_addrs": { 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "addrvec": [ 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "type": "v1", 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "addr": "10.20.193.76:6809", 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: "nonce": 1923901808 2026-02-25T17:21:23.968 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: ] 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "cluster_addrs": { 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "addrvec": [ 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "type": "v1", 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "addr": "10.20.193.76:6810", 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "nonce": 1923901808 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: ] 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "heartbeat_back_addrs": { 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "addrvec": [ 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "type": "v1", 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "addr": "10.20.193.76:6812", 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "nonce": 1923901808 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: ] 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "heartbeat_front_addrs": { 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "addrvec": [ 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "type": "v1", 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "addr": "10.20.193.76:6811", 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "nonce": 1923901808 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: ] 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "public_addr": "10.20.193.76:6809/1923901808", 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "cluster_addr": "10.20.193.76:6810/1923901808", 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "heartbeat_back_addr": "10.20.193.76:6812/1923901808", 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "heartbeat_front_addr": "10.20.193.76:6811/1923901808", 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "state": [ 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "exists", 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "up" 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: ] 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "osd": 2, 2026-02-25T17:21:23.969 INFO:teuthology.orchestra.run.trial076.stdout: "uuid": "9633000b-764d-457a-b560-539dc5830e9e", 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "up": 1, 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "in": 1, 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "weight": 1, 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "primary_affinity": 1, 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "last_clean_begin": 9, 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "last_clean_end": 18, 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "up_from": 24, 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "up_thru": 24, 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "down_at": 19, 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "lost_at": 0, 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "public_addrs": { 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "addrvec": [ 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "type": "v1", 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "addr": "10.20.193.76:6801", 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "nonce": 3531107996 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: ] 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "cluster_addrs": { 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "addrvec": [ 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "type": "v1", 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "addr": "10.20.193.76:6802", 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "nonce": 3531107996 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: ] 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "heartbeat_back_addrs": { 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "addrvec": [ 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "type": "v1", 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "addr": "10.20.193.76:6804", 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "nonce": 3531107996 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: ] 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "heartbeat_front_addrs": { 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "addrvec": [ 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "type": "v1", 2026-02-25T17:21:23.970 INFO:teuthology.orchestra.run.trial076.stdout: "addr": "10.20.193.76:6803", 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "nonce": 3531107996 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: ] 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "public_addr": "10.20.193.76:6801/3531107996", 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "cluster_addr": "10.20.193.76:6802/3531107996", 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "heartbeat_back_addr": "10.20.193.76:6804/3531107996", 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "heartbeat_front_addr": "10.20.193.76:6803/3531107996", 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "state": [ 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "exists", 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "up" 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: ] 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "osd": 3, 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "uuid": "fc098e34-48a8-4414-ad41-60abdf7388a5", 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "up": 1, 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "in": 1, 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "weight": 1, 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "primary_affinity": 1, 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "last_clean_begin": 9, 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "last_clean_end": 19, 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "up_from": 25, 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "up_thru": 19, 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "down_at": 20, 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "lost_at": 0, 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "public_addrs": { 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "addrvec": [ 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "type": "v1", 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "addr": "10.20.193.76:6813", 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "nonce": 39660203 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: ] 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "cluster_addrs": { 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "addrvec": [ 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "type": "v1", 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "addr": "10.20.193.76:6814", 2026-02-25T17:21:23.971 INFO:teuthology.orchestra.run.trial076.stdout: "nonce": 39660203 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: ] 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "heartbeat_back_addrs": { 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "addrvec": [ 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "type": "v1", 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "addr": "10.20.193.76:6816", 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "nonce": 39660203 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: ] 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "heartbeat_front_addrs": { 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "addrvec": [ 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "type": "v1", 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "addr": "10.20.193.76:6815", 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "nonce": 39660203 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: ] 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "public_addr": "10.20.193.76:6813/39660203", 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "cluster_addr": "10.20.193.76:6814/39660203", 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "heartbeat_back_addr": "10.20.193.76:6816/39660203", 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "heartbeat_front_addr": "10.20.193.76:6815/39660203", 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "state": [ 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "exists", 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "up" 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: ] 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: ], 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "osd_xinfo": [ 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "osd": 0, 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "down_stamp": "0.000000", 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "laggy_probability": 0, 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "laggy_interval": 0, 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "features": 4540138322906710015, 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "old_weight": 0, 2026-02-25T17:21:23.972 INFO:teuthology.orchestra.run.trial076.stdout: "last_purged_snaps_scrub": "2026-02-25T17:13:39.998715+0000", 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "dead_epoch": 17 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "osd": 1, 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "down_stamp": "0.000000", 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "laggy_probability": 0, 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "laggy_interval": 0, 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "features": 4540138322906710015, 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "old_weight": 0, 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "last_purged_snaps_scrub": "2026-02-25T17:13:39.974454+0000", 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "dead_epoch": 18 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "osd": 2, 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "down_stamp": "0.000000", 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "laggy_probability": 0, 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "laggy_interval": 0, 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "features": 4540138322906710015, 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "old_weight": 0, 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "last_purged_snaps_scrub": "2026-02-25T17:13:40.020834+0000", 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "dead_epoch": 19 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: { 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "osd": 3, 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "down_stamp": "2026-02-25T17:21:17.173929+0000", 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "laggy_probability": 0, 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "laggy_interval": 0, 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "features": 4540138322906710015, 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "old_weight": 0, 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "last_purged_snaps_scrub": "2026-02-25T17:13:39.943932+0000", 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "dead_epoch": 0 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: ], 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "pg_upmap": [], 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "pg_upmap_items": [], 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "pg_upmap_primaries": [], 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "pg_temp": [], 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "primary_temp": [], 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "blocklist": { 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "10.20.193.76:0/94912213": "2026-02-26T17:21:11.039698+0000", 2026-02-25T17:21:23.973 INFO:teuthology.orchestra.run.trial076.stdout: "10.20.193.76:6800/42442": "2026-02-26T17:21:11.039698+0000", 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "10.20.193.76:0/1432153956": "2026-02-26T17:21:11.039698+0000", 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "10.20.193.76:0/1754372634": "2026-02-26T17:21:11.039698+0000", 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "10.20.193.76:0/599075350": "2026-02-26T17:21:11.039698+0000" 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "range_blocklist": {}, 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "erasure_code_profiles": { 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "default": { 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "crush-failure-domain": "osd", 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "k": "2", 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "m": "1", 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "plugin": "jerasure", 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "technique": "reed_sol_van" 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: }, 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "removed_snaps_queue": [], 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "new_removed_snaps": [], 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "new_purged_snaps": [], 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "crush_node_flags": {}, 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "device_class_flags": {}, 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "stretch_mode": { 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "stretch_mode_enabled": false, 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "stretch_bucket_count": 0, 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "degraded_stretch_mode": 0, 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "recovering_stretch_mode": 0, 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: "stretch_mode_bucket": 0 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout: } 2026-02-25T17:21:23.974 INFO:teuthology.orchestra.run.trial076.stdout:} 2026-02-25T17:21:23.975 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.960+0000 7fbbd73e5640 1 -- 10.20.193.76:0/3491611964 >> v1:10.20.193.76:6800/1563581135 conn(0x7fbba004f880 legacy=0x7fbba0051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:23.975 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.960+0000 7fbbd73e5640 1 -- 10.20.193.76:0/3491611964 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbbd0096440 msgr2=0x7fbbd01c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:23.975 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.960+0000 7fbbd73e5640 1 --2- 10.20.193.76:0/3491611964 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbbd0096440 0x7fbbd01c5cf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbbc400ebe0 tx=0x7fbbc400c520 comp rx=0 tx=0).stop 2026-02-25T17:21:23.975 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.960+0000 7fbbd73e5640 1 -- 10.20.193.76:0/3491611964 shutdown_connections 2026-02-25T17:21:23.975 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.960+0000 7fbbd73e5640 1 --2- 10.20.193.76:0/3491611964 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fbbd012e870 0x7fbbd0132020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.975 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.960+0000 7fbbd73e5640 1 --2- 10.20.193.76:0/3491611964 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbbd0096440 0x7fbbd01c5cf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.975 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.960+0000 7fbbd73e5640 1 --2- 10.20.193.76:0/3491611964 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fbbd0094e50 0x7fbbd01c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:23.975 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.960+0000 7fbbd73e5640 1 -- 10.20.193.76:0/3491611964 >> 10.20.193.76:0/3491611964 conn(0x7fbbd009b780 msgr2=0x7fbbd008cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:23.975 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.960+0000 7fbbd73e5640 1 -- 10.20.193.76:0/3491611964 shutdown_connections 2026-02-25T17:21:23.975 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:23.960+0000 7fbbd73e5640 1 -- 10.20.193.76:0/3491611964 wait complete. 2026-02-25T17:21:23.975 DEBUG:teuthology.orchestra.run.trial076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs dump' 2026-02-25T17:21:24.043 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.037+0000 7f1fabf40640 1 Processor -- start 2026-02-25T17:21:24.043 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.037+0000 7f1fabf40640 1 -- start start 2026-02-25T17:21:24.044 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.038+0000 7f1fabf40640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1fa406c260 0x7f1fa406c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:24.044 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.038+0000 7f1fabf40640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1fa412c800 0x7f1fa412cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:24.044 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.038+0000 7f1fabf40640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa406d520 con 0x7f1fa406cb80 2026-02-25T17:21:24.044 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.038+0000 7f1fabf40640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa406cf80 con 0x7f1fa412c800 2026-02-25T17:21:24.044 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.038+0000 7f1fabf40640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa4070620 con 0x7f1fa406c260 2026-02-25T17:21:24.044 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.038+0000 7f1fa9cb5640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1fa406c260 0x7f1fa406c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:24.044 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.038+0000 7f1fa9cb5640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1fa406c260 0x7f1fa406c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:58392/0 (socket says 10.20.193.76:58392) 2026-02-25T17:21:24.044 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.038+0000 7f1fa9cb5640 1 -- 10.20.193.76:0/2990345419 learned_addr learned my addr 10.20.193.76:0/2990345419 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:24.044 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.038+0000 7f1fa94b4640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f1fa406cb80 0x7f1fa412c0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:35396/0 (socket says 10.20.193.76:35396) 2026-02-25T17:21:24.044 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.038+0000 7f1faa4b6640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1fa412c800 0x7f1fa412cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:24.044 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.038+0000 7f1fa8cb3640 1 -- 10.20.193.76:0/2990345419 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 557738651 0 0) 0x7f1fa406d520 con 0x7f1fa406cb80 2026-02-25T17:21:24.044 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.038+0000 7f1fa8cb3640 1 -- 10.20.193.76:0/2990345419 --> v1:10.20.193.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f8c003620 con 0x7f1fa406cb80 2026-02-25T17:21:24.044 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.038+0000 7f1fa9cb5640 1 -- 10.20.193.76:0/2990345419 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1fa412c800 msgr2=0x7f1fa412cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:24.044 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.038+0000 7f1fa9cb5640 1 --2- 10.20.193.76:0/2990345419 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1fa412c800 0x7f1fa412cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:24.045 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.038+0000 7f1fa9cb5640 1 -- 10.20.193.76:0/2990345419 >> v1:10.20.193.76:6789/0 conn(0x7f1fa406cb80 legacy=0x7f1fa412c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:24.045 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.038+0000 7f1fa9cb5640 1 -- 10.20.193.76:0/2990345419 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa406fe20 con 0x7f1fa406c260 2026-02-25T17:21:24.045 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.038+0000 7f1faa4b6640 1 --2- 10.20.193.76:0/2990345419 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1fa412c800 0x7f1fa412cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:24.045 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.038+0000 7f1fa9cb5640 1 --2- 10.20.193.76:0/2990345419 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1fa406c260 0x7f1fa406c640 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1f940099a0 tx=0x7f1f9402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8e461b7f008c5be server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:24.045 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.039+0000 7f1fa8cb3640 1 -- 10.20.193.76:0/2990345419 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9402fb00 con 0x7f1fa406c260 2026-02-25T17:21:24.045 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.039+0000 7f1fa8cb3640 1 -- 10.20.193.76:0/2990345419 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9402fc60 con 0x7f1fa406c260 2026-02-25T17:21:24.045 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.039+0000 7f1fa8cb3640 1 -- 10.20.193.76:0/2990345419 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f94037440 con 0x7f1fa406c260 2026-02-25T17:21:24.045 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.039+0000 7f1fabf40640 1 -- 10.20.193.76:0/2990345419 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1fa406c260 msgr2=0x7f1fa406c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:24.045 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.039+0000 7f1fabf40640 1 --2- 10.20.193.76:0/2990345419 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1fa406c260 0x7f1fa406c640 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1f940099a0 tx=0x7f1f9402ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:24.045 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.039+0000 7f1fabf40640 1 -- 10.20.193.76:0/2990345419 shutdown_connections 2026-02-25T17:21:24.045 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.039+0000 7f1fabf40640 1 --2- 10.20.193.76:0/2990345419 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1fa412c800 0x7f1fa412cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:24.045 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.039+0000 7f1fabf40640 1 --2- 10.20.193.76:0/2990345419 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1fa406c260 0x7f1fa406c640 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:24.045 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.039+0000 7f1fabf40640 1 -- 10.20.193.76:0/2990345419 >> 10.20.193.76:0/2990345419 conn(0x7f1fa409b780 msgr2=0x7f1fa409bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:24.045 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.039+0000 7f1fabf40640 1 -- 10.20.193.76:0/2990345419 shutdown_connections 2026-02-25T17:21:24.045 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.039+0000 7f1fabf40640 1 -- 10.20.193.76:0/2990345419 wait complete. 2026-02-25T17:21:24.046 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.039+0000 7f1fabf40640 1 Processor -- start 2026-02-25T17:21:24.046 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.039+0000 7f1fabf40640 1 -- start start 2026-02-25T17:21:24.046 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1fabf40640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f1fa406c260 0x7f1fa4096dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:24.046 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1fabf40640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1fa406cb80 0x7f1fa4097310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:24.046 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1fabf40640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1fa412c800 0x7f1fa4097850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:24.046 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1fabf40640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa40990c0 con 0x7f1fa406c260 2026-02-25T17:21:24.046 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1fabf40640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa409a390 con 0x7f1fa406cb80 2026-02-25T17:21:24.046 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1fabf40640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa4099ac0 con 0x7f1fa412c800 2026-02-25T17:21:24.046 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1faa4b6640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1fa412c800 0x7f1fa4097850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:24.046 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1fa94b4640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1fa406cb80 0x7f1fa4097310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:24.046 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1fa9cb5640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f1fa406c260 0x7f1fa4096dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:24.046 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1faa4b6640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1fa412c800 0x7f1fa4097850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:58400/0 (socket says 10.20.193.76:58400) 2026-02-25T17:21:24.046 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1faa4b6640 1 -- 10.20.193.76:0/3859580209 learned_addr learned my addr 10.20.193.76:0/3859580209 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:24.046 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1fa94b4640 1 -- 10.20.193.76:0/3859580209 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1fa412c800 msgr2=0x7f1fa4097850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:24.047 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1fa94b4640 1 --2- 10.20.193.76:0/3859580209 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1fa412c800 0x7f1fa4097850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:24.047 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1fa94b4640 1 -- 10.20.193.76:0/3859580209 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f1fa406c260 msgr2=0x7f1fa4096dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:24.047 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1fa94b4640 1 --2- 10.20.193.76:0/3859580209 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f1fa406c260 0x7f1fa4096dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:24.047 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1fa94b4640 1 -- 10.20.193.76:0/3859580209 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa0009a70 con 0x7f1fa406cb80 2026-02-25T17:21:24.047 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1faa4b6640 1 --2- 10.20.193.76:0/3859580209 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1fa412c800 0x7f1fa4097850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:24.047 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1fa94b4640 1 --2- 10.20.193.76:0/3859580209 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1fa406cb80 0x7f1fa4097310 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800c4f0 tx=0x7f1f9800c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:24.047 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1f927fc640 1 -- 10.20.193.76:0/3859580209 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98005d20 con 0x7f1fa406cb80 2026-02-25T17:21:24.047 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1f927fc640 1 -- 10.20.193.76:0/3859580209 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f98005e80 con 0x7f1fa406cb80 2026-02-25T17:21:24.047 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1fabf40640 1 -- 10.20.193.76:0/3859580209 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f940095d0 con 0x7f1fa406cb80 2026-02-25T17:21:24.047 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1f927fc640 1 -- 10.20.193.76:0/3859580209 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98007290 con 0x7f1fa406cb80 2026-02-25T17:21:24.047 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.040+0000 7f1fabf40640 1 -- 10.20.193.76:0/3859580209 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa4098010 con 0x7f1fa406cb80 2026-02-25T17:21:24.047 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.041+0000 7f1fabf40640 1 -- 10.20.193.76:0/3859580209 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa40996f0 con 0x7f1fa406cb80 2026-02-25T17:21:24.047 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.041+0000 7f1f927fc640 1 -- 10.20.193.76:0/3859580209 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f1f980073f0 con 0x7f1fa406cb80 2026-02-25T17:21:24.047 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.041+0000 7f1f927fc640 1 -- 10.20.193.76:0/3859580209 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3021+0+0 (secure 0 0 0) 0x7f1f98065e20 con 0x7f1fa406cb80 2026-02-25T17:21:24.048 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.043+0000 7f1f927fc640 1 -- 10.20.193.76:0/3859580209 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f1f9803f870 con 0x7f1fa406cb80 2026-02-25T17:21:24.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.117+0000 7f1fabf40640 1 -- 10.20.193.76:0/3859580209 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1fa406c640 con 0x7f1fa406cb80 2026-02-25T17:21:24.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.118+0000 7f1f927fc640 1 -- 10.20.193.76:0/3859580209 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 1 v1) v1 ==== 75+0+358 (secure 0 0 0) 0x7f1f98017030 con 0x7f1fa406cb80 2026-02-25T17:21:24.120 INFO:teuthology.orchestra.run.trial076.stdout:e1 2026-02-25T17:21:24.120 INFO:teuthology.orchestra.run.trial076.stdout:enable_multiple, ever_enabled_multiple: 1,1 2026-02-25T17:21:24.120 INFO:teuthology.orchestra.run.trial076.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2026-02-25T17:21:24.121 INFO:teuthology.orchestra.run.trial076.stdout:legacy client fscid: -1 2026-02-25T17:21:24.121 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:24.121 INFO:teuthology.orchestra.run.trial076.stdout:No filesystems configured 2026-02-25T17:21:24.121 INFO:teuthology.orchestra.run.trial076.stderr:dumped fsmap epoch 1 2026-02-25T17:21:24.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.118+0000 7f1fabf40640 1 -- 10.20.193.76:0/3859580209 >> v1:10.20.193.76:6800/1563581135 conn(0x7f1f7404f880 legacy=0x7f1f74051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:24.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.118+0000 7f1fabf40640 1 -- 10.20.193.76:0/3859580209 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1fa406cb80 msgr2=0x7f1fa4097310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:24.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.118+0000 7f1fabf40640 1 --2- 10.20.193.76:0/3859580209 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1fa406cb80 0x7f1fa4097310 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800c4f0 tx=0x7f1f9800c9c0 comp rx=0 tx=0).stop 2026-02-25T17:21:24.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.118+0000 7f1fabf40640 1 -- 10.20.193.76:0/3859580209 shutdown_connections 2026-02-25T17:21:24.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.118+0000 7f1fabf40640 1 --2- 10.20.193.76:0/3859580209 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f1fa412c800 0x7f1fa4097850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:24.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.118+0000 7f1fabf40640 1 --2- 10.20.193.76:0/3859580209 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f1fa406cb80 0x7f1fa4097310 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:24.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.118+0000 7f1fabf40640 1 --2- 10.20.193.76:0/3859580209 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f1fa406c260 0x7f1fa4096dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:24.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.118+0000 7f1fabf40640 1 -- 10.20.193.76:0/3859580209 >> 10.20.193.76:0/3859580209 conn(0x7f1fa409b780 msgr2=0x7f1fa4129ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:24.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.118+0000 7f1fabf40640 1 -- 10.20.193.76:0/3859580209 shutdown_connections 2026-02-25T17:21:24.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.118+0000 7f1fabf40640 1 -- 10.20.193.76:0/3859580209 wait complete. 2026-02-25T17:21:24.127 DEBUG:teuthology.orchestra.run.trial076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release reef' 2026-02-25T17:21:24.197 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.190+0000 7f982d1aa640 1 Processor -- start 2026-02-25T17:21:24.197 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.190+0000 7f982d1aa640 1 -- start start 2026-02-25T17:21:24.197 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.190+0000 7f982d1aa640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f982812e380 0x7f9828130770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:24.197 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.190+0000 7f982d1aa640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9828130cb0 0x7f98281330a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:24.198 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.190+0000 7f982d1aa640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982806c260 con 0x7f982812b4c0 2026-02-25T17:21:24.198 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.190+0000 7f982d1aa640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982809cc50 con 0x7f982812e380 2026-02-25T17:21:24.198 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.190+0000 7f982d1aa640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f982812b070 con 0x7f9828130cb0 2026-02-25T17:21:24.198 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.190+0000 7f9826575640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f982812e380 0x7f9828130770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:24.198 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.190+0000 7f9826d76640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f982812b4c0 0x7f982812b8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:35402/0 (socket says 10.20.193.76:35402) 2026-02-25T17:21:24.198 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.190+0000 7f9826d76640 1 -- 10.20.193.76:0/2723957507 learned_addr learned my addr 10.20.193.76:0/2723957507 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:24.198 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.190+0000 7f9827577640 1 --2- 10.20.193.76:0/2723957507 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9828130cb0 0x7f98281330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:24.198 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.190+0000 7f9826575640 1 -- 10.20.193.76:0/2723957507 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9828130cb0 msgr2=0x7f98281330a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:24.198 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.190+0000 7f9826575640 1 --2- 10.20.193.76:0/2723957507 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9828130cb0 0x7f98281330a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:24.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.190+0000 7f9826575640 1 -- 10.20.193.76:0/2723957507 >> v1:10.20.193.76:6789/0 conn(0x7f982812b4c0 legacy=0x7f982812b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:24.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.190+0000 7f9826575640 1 -- 10.20.193.76:0/2723957507 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982806f860 con 0x7f982812e380 2026-02-25T17:21:24.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.190+0000 7f9827577640 1 --2- 10.20.193.76:0/2723957507 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9828130cb0 0x7f98281330a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:24.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.191+0000 7f9826575640 1 --2- 10.20.193.76:0/2723957507 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f982812e380 0x7f9828130770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f98100098a0 tx=0x7f981002ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31fc58ab94521aa5 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:24.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.191+0000 7f9825d74640 1 -- 10.20.193.76:0/2723957507 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981002fa40 con 0x7f982812e380 2026-02-25T17:21:24.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.191+0000 7f9825d74640 1 -- 10.20.193.76:0/2723957507 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981002fba0 con 0x7f982812e380 2026-02-25T17:21:24.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.191+0000 7f9825d74640 1 -- 10.20.193.76:0/2723957507 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810037440 con 0x7f982812e380 2026-02-25T17:21:24.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.191+0000 7f982d1aa640 1 -- 10.20.193.76:0/2723957507 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f982812e380 msgr2=0x7f9828130770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:24.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.191+0000 7f982d1aa640 1 --2- 10.20.193.76:0/2723957507 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f982812e380 0x7f9828130770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f98100098a0 tx=0x7f981002ed80 comp rx=0 tx=0).stop 2026-02-25T17:21:24.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.191+0000 7f982d1aa640 1 -- 10.20.193.76:0/2723957507 shutdown_connections 2026-02-25T17:21:24.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.191+0000 7f982d1aa640 1 --2- 10.20.193.76:0/2723957507 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f9828130cb0 0x7f98281330a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:24.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.191+0000 7f982d1aa640 1 --2- 10.20.193.76:0/2723957507 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f982812e380 0x7f9828130770 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:24.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.191+0000 7f982d1aa640 1 -- 10.20.193.76:0/2723957507 >> 10.20.193.76:0/2723957507 conn(0x7f982809b780 msgr2=0x7f982809bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:24.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.192+0000 7f982d1aa640 1 -- 10.20.193.76:0/2723957507 shutdown_connections 2026-02-25T17:21:24.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.192+0000 7f982d1aa640 1 -- 10.20.193.76:0/2723957507 wait complete. 2026-02-25T17:21:24.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.192+0000 7f982d1aa640 1 Processor -- start 2026-02-25T17:21:24.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.192+0000 7f982d1aa640 1 -- start start 2026-02-25T17:21:24.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.192+0000 7f982d1aa640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f982812b4c0 0x7f9828127a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:24.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.192+0000 7f982d1aa640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f982812e380 0x7f9828127fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:24.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.192+0000 7f982d1aa640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9828130cb0 0x7f982812e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:24.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.192+0000 7f982d1aa640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98281305b0 con 0x7f982812b4c0 2026-02-25T17:21:24.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.192+0000 7f982d1aa640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9828126d30 con 0x7f9828130cb0 2026-02-25T17:21:24.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.192+0000 7f982d1aa640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9828127630 con 0x7f982812e380 2026-02-25T17:21:24.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.192+0000 7f9826575640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f982812e380 0x7f9828127fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:24.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.192+0000 7f9827577640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9828130cb0 0x7f982812e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:24.201 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.192+0000 7f9826d76640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f982812b4c0 0x7f9828127a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:24.201 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.192+0000 7f9826575640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f982812e380 0x7f9828127fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:58424/0 (socket says 10.20.193.76:58424) 2026-02-25T17:21:24.201 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.192+0000 7f9826575640 1 -- 10.20.193.76:0/2552676341 learned_addr learned my addr 10.20.193.76:0/2552676341 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:24.201 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.193+0000 7f9826575640 1 -- 10.20.193.76:0/2552676341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9828130cb0 msgr2=0x7f982812e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:24.201 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.193+0000 7f9826575640 1 --2- 10.20.193.76:0/2552676341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9828130cb0 0x7f982812e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:24.201 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.193+0000 7f9826575640 1 -- 10.20.193.76:0/2552676341 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f982812b4c0 msgr2=0x7f9828127a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:24.201 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.193+0000 7f9826575640 1 --2- 10.20.193.76:0/2552676341 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f982812b4c0 0x7f9828127a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:24.201 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.193+0000 7f9826575640 1 -- 10.20.193.76:0/2552676341 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9818009a70 con 0x7f982812e380 2026-02-25T17:21:24.201 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.193+0000 7f9826575640 1 --2- 10.20.193.76:0/2552676341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f982812e380 0x7f9828127fa0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f98100099d0 tx=0x7f98100047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:24.201 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.193+0000 7f98077fe640 1 -- 10.20.193.76:0/2552676341 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810042650 con 0x7f982812e380 2026-02-25T17:21:24.201 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.193+0000 7f98077fe640 1 -- 10.20.193.76:0/2552676341 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98100427b0 con 0x7f982812e380 2026-02-25T17:21:24.202 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.193+0000 7f982d1aa640 1 -- 10.20.193.76:0/2552676341 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9810009500 con 0x7f982812e380 2026-02-25T17:21:24.202 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.193+0000 7f98077fe640 1 -- 10.20.193.76:0/2552676341 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810042b60 con 0x7f982812e380 2026-02-25T17:21:24.202 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.193+0000 7f982d1aa640 1 -- 10.20.193.76:0/2552676341 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9828126550 con 0x7f982812e380 2026-02-25T17:21:24.202 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.193+0000 7f982d1aa640 1 -- 10.20.193.76:0/2552676341 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982812b8a0 con 0x7f982812e380 2026-02-25T17:21:24.202 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.194+0000 7f98077fe640 1 -- 10.20.193.76:0/2552676341 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f9810052020 con 0x7f982812e380 2026-02-25T17:21:24.202 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.194+0000 7f98077fe640 1 -- 10.20.193.76:0/2552676341 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 3021+0+0 (secure 0 0 0) 0x7f981008c140 con 0x7f982812e380 2026-02-25T17:21:24.203 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.196+0000 7f98077fe640 1 -- 10.20.193.76:0/2552676341 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f9810066110 con 0x7f982812e380 2026-02-25T17:21:24.267 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:24.264+0000 7f982d1aa640 1 -- 10.20.193.76:0/2552676341 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd require-osd-release", "release": "reef"} v 0) v1 -- 0x7f9828128a40 con 0x7f982812e380 2026-02-25T17:21:25.198 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.196+0000 7f98077fe640 1 -- 10.20.193.76:0/2552676341 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "reef"}]=0 v27) v1 ==== 90+0+0 (secure 0 0 0) 0x7f981003c0a0 con 0x7f982812e380 2026-02-25T17:21:25.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.197+0000 7f982d1aa640 1 -- 10.20.193.76:0/2552676341 >> v1:10.20.193.76:6800/1563581135 conn(0x7f97f404f880 legacy=0x7f97f4051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:25.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.197+0000 7f982d1aa640 1 -- 10.20.193.76:0/2552676341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f982812e380 msgr2=0x7f9828127fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:25.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.197+0000 7f982d1aa640 1 --2- 10.20.193.76:0/2552676341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f982812e380 0x7f9828127fa0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f98100099d0 tx=0x7f98100047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:25.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.197+0000 7f982d1aa640 1 -- 10.20.193.76:0/2552676341 shutdown_connections 2026-02-25T17:21:25.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.197+0000 7f982d1aa640 1 --2- 10.20.193.76:0/2552676341 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f9828130cb0 0x7f982812e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:25.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.197+0000 7f982d1aa640 1 --2- 10.20.193.76:0/2552676341 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f982812e380 0x7f9828127fa0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:25.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.197+0000 7f982d1aa640 1 --2- 10.20.193.76:0/2552676341 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f982812b4c0 0x7f9828127a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:25.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.197+0000 7f982d1aa640 1 -- 10.20.193.76:0/2552676341 >> 10.20.193.76:0/2552676341 conn(0x7f982809b780 msgr2=0x7f982812da90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:25.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.197+0000 7f982d1aa640 1 -- 10.20.193.76:0/2552676341 shutdown_connections 2026-02-25T17:21:25.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.197+0000 7f982d1aa640 1 -- 10.20.193.76:0/2552676341 wait complete. 2026-02-25T17:21:25.208 DEBUG:teuthology.orchestra.run.trial076:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2026-02-25T17:21:25.278 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.271+0000 7f6350d79640 1 Processor -- start 2026-02-25T17:21:25.278 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.271+0000 7f6350d79640 1 -- start start 2026-02-25T17:21:25.278 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.271+0000 7f6350d79640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f634c12e870 0x7f634c12ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:25.278 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.271+0000 7f6350d79640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f634c096440 0x7f634c094910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:25.278 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.271+0000 7f6350d79640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f634c094e50 0x7f634c0952e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:25.278 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.271+0000 7f6350d79640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634c096dd0 con 0x7f634c096440 2026-02-25T17:21:25.278 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.271+0000 7f6350d79640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c097060 con 0x7f634c12e870 2026-02-25T17:21:25.279 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.271+0000 7f6350d79640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f634c09a510 con 0x7f634c094e50 2026-02-25T17:21:25.279 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.271+0000 7f634a575640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f634c12e870 0x7f634c12ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:25.279 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.271+0000 7f6349d74640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f634c096440 0x7f634c094910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:25.279 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.271+0000 7f634ad76640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f634c094e50 0x7f634c0952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:25.279 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.271+0000 7f634a575640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f634c12e870 0x7f634c12ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:49444/0 (socket says 10.20.193.76:49444) 2026-02-25T17:21:25.279 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.271+0000 7f634a575640 1 -- 10.20.193.76:0/3157530464 learned_addr learned my addr 10.20.193.76:0/3157530464 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:25.279 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.271+0000 7f6349d74640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f634c096440 0x7f634c094910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:51916/0 (socket says 10.20.193.76:51916) 2026-02-25T17:21:25.279 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.271+0000 7f634a575640 1 -- 10.20.193.76:0/3157530464 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f634c094e50 msgr2=0x7f634c0952e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:25.279 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.271+0000 7f634a575640 1 --2- 10.20.193.76:0/3157530464 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f634c094e50 0x7f634c0952e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:25.279 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.271+0000 7f634a575640 1 -- 10.20.193.76:0/3157530464 >> v2:10.20.193.76:3300/0 conn(0x7f634c096440 msgr2=0x7f634c094910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:25.280 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.271+0000 7f634a575640 1 --2- 10.20.193.76:0/3157530464 >> v2:10.20.193.76:3300/0 conn(0x7f634c096440 0x7f634c094910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:25.280 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.271+0000 7f634a575640 1 -- 10.20.193.76:0/3157530464 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634c12f190 con 0x7f634c12e870 2026-02-25T17:21:25.280 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.272+0000 7f634a575640 1 --2- 10.20.193.76:0/3157530464 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f634c12e870 0x7f634c12ec50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6340009970 tx=0x7f634002ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2527ecfc2c0e2d3 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:25.280 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.272+0000 7f6349573640 1 -- 10.20.193.76:0/3157530464 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634002fa60 con 0x7f634c12e870 2026-02-25T17:21:25.280 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.272+0000 7f6349573640 1 -- 10.20.193.76:0/3157530464 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634002fbc0 con 0x7f634c12e870 2026-02-25T17:21:25.280 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.272+0000 7f6349573640 1 -- 10.20.193.76:0/3157530464 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340037440 con 0x7f634c12e870 2026-02-25T17:21:25.280 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.272+0000 7f6350d79640 1 -- 10.20.193.76:0/3157530464 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f634c12e870 msgr2=0x7f634c12ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:25.280 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.272+0000 7f6350d79640 1 --2- 10.20.193.76:0/3157530464 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f634c12e870 0x7f634c12ec50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6340009970 tx=0x7f634002ee30 comp rx=0 tx=0).stop 2026-02-25T17:21:25.280 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.272+0000 7f6350d79640 1 -- 10.20.193.76:0/3157530464 shutdown_connections 2026-02-25T17:21:25.280 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.272+0000 7f6350d79640 1 --2- 10.20.193.76:0/3157530464 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f634c094e50 0x7f634c0952e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:25.280 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.272+0000 7f6350d79640 1 --2- 10.20.193.76:0/3157530464 >> v2:10.20.193.76:3300/0 conn(0x7f634c096440 0x7f634c094910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:25.280 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.272+0000 7f6350d79640 1 --2- 10.20.193.76:0/3157530464 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f634c12e870 0x7f634c12ec50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:25.281 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.272+0000 7f6350d79640 1 -- 10.20.193.76:0/3157530464 >> 10.20.193.76:0/3157530464 conn(0x7f634c09b780 msgr2=0x7f634c09bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:25.281 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.272+0000 7f6350d79640 1 -- 10.20.193.76:0/3157530464 shutdown_connections 2026-02-25T17:21:25.281 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.272+0000 7f6350d79640 1 -- 10.20.193.76:0/3157530464 wait complete. 2026-02-25T17:21:25.281 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f6350d79640 1 Processor -- start 2026-02-25T17:21:25.281 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f6350d79640 1 -- start start 2026-02-25T17:21:25.281 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f6350d79640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f634c094e50 0x7f634c131d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:25.281 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f6350d79640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f634c096440 0x7f634c1322d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:25.281 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f6350d79640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f634c12e870 0x7f634c132810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:25.281 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f6350d79640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634c134860 con 0x7f634c12e870 2026-02-25T17:21:25.281 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f6350d79640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634c135100 con 0x7f634c096440 2026-02-25T17:21:25.281 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f6350d79640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f634c1337a0 con 0x7f634c094e50 2026-02-25T17:21:25.281 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f634a575640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f634c094e50 0x7f634c131d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:25.282 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f6349d74640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f634c096440 0x7f634c1322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:25.282 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f634a575640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f634c094e50 0x7f634c131d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:58438/0 (socket says 10.20.193.76:58438) 2026-02-25T17:21:25.282 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f634a575640 1 -- 10.20.193.76:0/2748122415 learned_addr learned my addr 10.20.193.76:0/2748122415 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:25.282 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f634ad76640 1 --2- 10.20.193.76:0/2748122415 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f634c12e870 0x7f634c132810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:25.282 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f634a575640 1 -- 10.20.193.76:0/2748122415 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f634c096440 msgr2=0x7f634c1322d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:25.282 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f634a575640 1 --2- 10.20.193.76:0/2748122415 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f634c096440 0x7f634c1322d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:25.282 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f634a575640 1 -- 10.20.193.76:0/2748122415 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f634c12e870 msgr2=0x7f634c132810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:25.282 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f634a575640 1 --2- 10.20.193.76:0/2748122415 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f634c12e870 0x7f634c132810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:25.282 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f634a575640 1 -- 10.20.193.76:0/2748122415 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63400095d0 con 0x7f634c094e50 2026-02-25T17:21:25.282 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f634a575640 1 --2- 10.20.193.76:0/2748122415 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f634c094e50 0x7f634c131d90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6340009aa0 tx=0x7f63400047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:25.282 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f6332ffd640 1 -- 10.20.193.76:0/2748122415 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340040630 con 0x7f634c094e50 2026-02-25T17:21:25.283 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f6332ffd640 1 -- 10.20.193.76:0/2748122415 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63400407b0 con 0x7f634c094e50 2026-02-25T17:21:25.283 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f6350d79640 1 -- 10.20.193.76:0/2748122415 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634c133ed0 con 0x7f634c094e50 2026-02-25T17:21:25.283 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f6332ffd640 1 -- 10.20.193.76:0/2748122415 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340040b60 con 0x7f634c094e50 2026-02-25T17:21:25.283 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.273+0000 7f6350d79640 1 -- 10.20.193.76:0/2748122415 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634c128a50 con 0x7f634c094e50 2026-02-25T17:21:25.283 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.274+0000 7f6350d79640 1 -- 10.20.193.76:0/2748122415 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634c094910 con 0x7f634c094e50 2026-02-25T17:21:25.283 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.274+0000 7f6332ffd640 1 -- 10.20.193.76:0/2748122415 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f6340050020 con 0x7f634c094e50 2026-02-25T17:21:25.283 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.274+0000 7f6332ffd640 1 -- 10.20.193.76:0/2748122415 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3025+0+0 (secure 0 0 0) 0x7f634008b9c0 con 0x7f634c094e50 2026-02-25T17:21:25.284 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.276+0000 7f6332ffd640 1 -- 10.20.193.76:0/2748122415 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f63400653b0 con 0x7f634c094e50 2026-02-25T17:21:25.345 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.342+0000 7f6350d79640 1 -- 10.20.193.76:0/2748122415 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7f634c134b60 con 0x7f634c094e50 2026-02-25T17:21:25.345 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.342+0000 7f6332ffd640 1 -- 10.20.193.76:0/2748122415 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v27) v1 ==== 59+0+9 (secure 0 0 0) 0x7f634003c070 con 0x7f634c094e50 2026-02-25T17:21:25.347 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.343+0000 7f6350d79640 1 -- 10.20.193.76:0/2748122415 >> v1:10.20.193.76:6800/1563581135 conn(0x7f631804f880 legacy=0x7f6318051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:25.347 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.343+0000 7f6350d79640 1 -- 10.20.193.76:0/2748122415 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f634c094e50 msgr2=0x7f634c131d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:25.347 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.343+0000 7f6350d79640 1 --2- 10.20.193.76:0/2748122415 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f634c094e50 0x7f634c131d90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6340009aa0 tx=0x7f63400047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:25.347 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.343+0000 7f6350d79640 1 -- 10.20.193.76:0/2748122415 shutdown_connections 2026-02-25T17:21:25.347 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.343+0000 7f6350d79640 1 --2- 10.20.193.76:0/2748122415 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f634c12e870 0x7f634c132810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:25.347 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.343+0000 7f6350d79640 1 --2- 10.20.193.76:0/2748122415 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f634c096440 0x7f634c1322d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:25.347 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.343+0000 7f6350d79640 1 --2- 10.20.193.76:0/2748122415 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f634c094e50 0x7f634c131d90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:25.347 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.343+0000 7f6350d79640 1 -- 10.20.193.76:0/2748122415 >> 10.20.193.76:0/2748122415 conn(0x7f634c09b780 msgr2=0x7f634c08cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:25.347 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.343+0000 7f6350d79640 1 -- 10.20.193.76:0/2748122415 shutdown_connections 2026-02-25T17:21:25.348 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.343+0000 7f6350d79640 1 -- 10.20.193.76:0/2748122415 wait complete. 2026-02-25T17:21:25.399 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.393+0000 7fb74d92b640 1 Processor -- start 2026-02-25T17:21:25.400 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.393+0000 7fb74d92b640 1 -- start start 2026-02-25T17:21:25.400 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.393+0000 7fb74d92b640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fb74812c510 0x7fb74812c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:25.400 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.393+0000 7fb74d92b640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb74812ce30 0x7fb74806bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:25.400 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.393+0000 7fb74d92b640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb74806f4f0 con 0x7fb74806c530 2026-02-25T17:21:25.400 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.393+0000 7fb74d92b640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb74812c190 con 0x7fb74812c510 2026-02-25T17:21:25.400 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.393+0000 7fb74d92b640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480730e0 con 0x7fb74812ce30 2026-02-25T17:21:25.400 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.393+0000 7fb7467fc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb74812ce30 0x7fb74806bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:25.400 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.393+0000 7fb7467fc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb74812ce30 0x7fb74806bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:58440/0 (socket says 10.20.193.76:58440) 2026-02-25T17:21:25.401 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.393+0000 7fb7467fc640 1 -- 10.20.193.76:0/518522474 learned_addr learned my addr 10.20.193.76:0/518522474 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:25.401 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.393+0000 7fb746ffd640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fb74812c510 0x7fb74812c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:25.401 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.393+0000 7fb745ffb640 1 -- 10.20.193.76:0/518522474 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910557272 0 0) 0x7fb74806f4f0 con 0x7fb74806c530 2026-02-25T17:21:25.401 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.393+0000 7fb7467fc640 1 -- 10.20.193.76:0/518522474 >> v2:10.20.193.76:3300/0 conn(0x7fb74812c510 msgr2=0x7fb74812c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:25.401 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.393+0000 7fb7467fc640 1 --2- 10.20.193.76:0/518522474 >> v2:10.20.193.76:3300/0 conn(0x7fb74812c510 0x7fb74812c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:25.401 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.393+0000 7fb7467fc640 1 -- 10.20.193.76:0/518522474 >> v1:10.20.193.76:6789/0 conn(0x7fb74806c530 legacy=0x7fb7481334e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:25.401 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.393+0000 7fb7467fc640 1 -- 10.20.193.76:0/518522474 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb748070be0 con 0x7fb74812ce30 2026-02-25T17:21:25.401 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.394+0000 7fb7467fc640 1 --2- 10.20.193.76:0/518522474 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb74812ce30 0x7fb74806bff0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb730009970 tx=0x7fb73002ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6e2deccb59abb2b server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:25.401 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.394+0000 7fb745ffb640 1 -- 10.20.193.76:0/518522474 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73002fb10 con 0x7fb74812ce30 2026-02-25T17:21:25.401 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.394+0000 7fb745ffb640 1 -- 10.20.193.76:0/518522474 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73002fc70 con 0x7fb74812ce30 2026-02-25T17:21:25.401 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.394+0000 7fb745ffb640 1 -- 10.20.193.76:0/518522474 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb730037440 con 0x7fb74812ce30 2026-02-25T17:21:25.401 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.394+0000 7fb74d92b640 1 -- 10.20.193.76:0/518522474 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb74812ce30 msgr2=0x7fb74806bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:25.402 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.394+0000 7fb74d92b640 1 --2- 10.20.193.76:0/518522474 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb74812ce30 0x7fb74806bff0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb730009970 tx=0x7fb73002ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:25.402 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.394+0000 7fb74d92b640 1 -- 10.20.193.76:0/518522474 shutdown_connections 2026-02-25T17:21:25.402 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.394+0000 7fb74d92b640 1 --2- 10.20.193.76:0/518522474 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb74812ce30 0x7fb74806bff0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:25.402 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.394+0000 7fb74d92b640 1 --2- 10.20.193.76:0/518522474 >> v2:10.20.193.76:3300/0 conn(0x7fb74812c510 0x7fb74812c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:25.402 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.394+0000 7fb74d92b640 1 -- 10.20.193.76:0/518522474 >> 10.20.193.76:0/518522474 conn(0x7fb74809af50 msgr2=0x7fb74808e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:25.402 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.394+0000 7fb74d92b640 1 -- 10.20.193.76:0/518522474 shutdown_connections 2026-02-25T17:21:25.402 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.394+0000 7fb74d92b640 1 -- 10.20.193.76:0/518522474 wait complete. 2026-02-25T17:21:25.402 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb74d92b640 1 Processor -- start 2026-02-25T17:21:25.402 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb74d92b640 1 -- start start 2026-02-25T17:21:25.402 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb74d92b640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb74806c530 0x7fb7480918b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:25.402 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb74d92b640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb74812c510 0x7fb748091df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:25.402 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb74d92b640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb74812ce30 0x7fb7481c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:25.403 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb74d92b640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480942b0 con 0x7fb74812c510 2026-02-25T17:21:25.403 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb74d92b640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb748092a10 con 0x7fb74806c530 2026-02-25T17:21:25.403 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb74d92b640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb748094a90 con 0x7fb74812ce30 2026-02-25T17:21:25.403 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb7467fc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb74812c510 0x7fb748091df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:25.403 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb7477fe640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb74812ce30 0x7fb7481c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:25.403 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb746ffd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb74806c530 0x7fb7480918b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:25.403 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb7467fc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb74812c510 0x7fb748091df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:51946/0 (socket says 10.20.193.76:51946) 2026-02-25T17:21:25.403 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb7467fc640 1 -- 10.20.193.76:0/974230073 learned_addr learned my addr 10.20.193.76:0/974230073 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:25.403 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb7477fe640 1 --2- 10.20.193.76:0/974230073 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb74812ce30 0x7fb7481c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:58446/0 (socket says 10.20.193.76:58446) 2026-02-25T17:21:25.403 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb7467fc640 1 -- 10.20.193.76:0/974230073 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb74812ce30 msgr2=0x7fb7481c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:25.403 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb7467fc640 1 --2- 10.20.193.76:0/974230073 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb74812ce30 0x7fb7481c5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:25.404 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb7467fc640 1 -- 10.20.193.76:0/974230073 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb74806c530 msgr2=0x7fb7480918b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:25.404 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb7467fc640 1 --2- 10.20.193.76:0/974230073 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb74806c530 0x7fb7480918b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:25.404 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb7467fc640 1 -- 10.20.193.76:0/974230073 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7300095d0 con 0x7fb74812c510 2026-02-25T17:21:25.404 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb7467fc640 1 --2- 10.20.193.76:0/974230073 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb74812c510 0x7fb748091df0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb730009aa0 tx=0x7fb7300047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:25.404 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb71ffff640 1 -- 10.20.193.76:0/974230073 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7300374c0 con 0x7fb74812c510 2026-02-25T17:21:25.404 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb71ffff640 1 -- 10.20.193.76:0/974230073 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb730040610 con 0x7fb74812c510 2026-02-25T17:21:25.404 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb74d92b640 1 -- 10.20.193.76:0/974230073 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb748094e60 con 0x7fb74812c510 2026-02-25T17:21:25.404 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb71ffff640 1 -- 10.20.193.76:0/974230073 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7300409a0 con 0x7fb74812c510 2026-02-25T17:21:25.404 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.395+0000 7fb74d92b640 1 -- 10.20.193.76:0/974230073 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb748092330 con 0x7fb74812c510 2026-02-25T17:21:25.404 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.396+0000 7fb74d92b640 1 -- 10.20.193.76:0/974230073 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74812c8f0 con 0x7fb74812c510 2026-02-25T17:21:25.404 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.396+0000 7fb71ffff640 1 -- 10.20.193.76:0/974230073 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fb730040b00 con 0x7fb74812c510 2026-02-25T17:21:25.404 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.396+0000 7fb71ffff640 1 -- 10.20.193.76:0/974230073 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3025+0+0 (secure 0 0 0) 0x7fb73008bbe0 con 0x7fb74812c510 2026-02-25T17:21:25.405 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.398+0000 7fb71ffff640 1 -- 10.20.193.76:0/974230073 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7fb730065670 con 0x7fb74812c510 2026-02-25T17:21:25.464 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:25.462+0000 7fb74d92b640 1 -- 10.20.193.76:0/974230073 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fb74806c970 con 0x7fb74812c510 2026-02-25T17:21:26.199 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.197+0000 7fb71ffff640 1 -- 10.20.193.76:0/974230073 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v28) v1 ==== 152+0+0 (secure 0 0 0) 0x7fb73003c020 con 0x7fb74812c510 2026-02-25T17:21:26.199 INFO:teuthology.orchestra.run.trial076.stderr:set pool 1 pg_autoscale_mode to off 2026-02-25T17:21:26.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.198+0000 7fb74d92b640 1 -- 10.20.193.76:0/974230073 >> v1:10.20.193.76:6800/1563581135 conn(0x7fb71804f880 legacy=0x7fb718051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:26.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.198+0000 7fb74d92b640 1 -- 10.20.193.76:0/974230073 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb74812c510 msgr2=0x7fb748091df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:26.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.198+0000 7fb74d92b640 1 --2- 10.20.193.76:0/974230073 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb74812c510 0x7fb748091df0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb730009aa0 tx=0x7fb7300047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:26.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.198+0000 7fb74d92b640 1 -- 10.20.193.76:0/974230073 shutdown_connections 2026-02-25T17:21:26.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.198+0000 7fb74d92b640 1 --2- 10.20.193.76:0/974230073 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb74812ce30 0x7fb7481c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:26.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.198+0000 7fb74d92b640 1 --2- 10.20.193.76:0/974230073 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb74812c510 0x7fb748091df0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:26.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.198+0000 7fb74d92b640 1 --2- 10.20.193.76:0/974230073 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb74806c530 0x7fb7480918b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:26.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.198+0000 7fb74d92b640 1 -- 10.20.193.76:0/974230073 >> 10.20.193.76:0/974230073 conn(0x7fb74809af50 msgr2=0x7fb748072550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:26.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.198+0000 7fb74d92b640 1 -- 10.20.193.76:0/974230073 shutdown_connections 2026-02-25T17:21:26.200 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.198+0000 7fb74d92b640 1 -- 10.20.193.76:0/974230073 wait complete. 2026-02-25T17:21:26.250 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.248+0000 7f341ec86640 1 Processor -- start 2026-02-25T17:21:26.250 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.248+0000 7f341ec86640 1 -- start start 2026-02-25T17:21:26.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.248+0000 7f341ec86640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f341812e3d0 0x7f34181307c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:26.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.248+0000 7f341ec86640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3418130d00 0x7f34181330f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:26.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.248+0000 7f341ec86640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3418127d40 con 0x7f3418127f40 2026-02-25T17:21:26.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.248+0000 7f341ec86640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341806e480 con 0x7f3418130d00 2026-02-25T17:21:26.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.248+0000 7f341ec86640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f341806fa80 con 0x7f341812e3d0 2026-02-25T17:21:26.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.248+0000 7f341c9fb640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f3418127f40 0x7f3418128320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:35408/0 (socket says 10.20.193.76:35408) 2026-02-25T17:21:26.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.249+0000 7f341c9fb640 1 -- 10.20.193.76:0/1172043924 learned_addr learned my addr 10.20.193.76:0/1172043924 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:26.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.249+0000 7f341d1fc640 1 --2- 10.20.193.76:0/1172043924 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3418130d00 0x7f34181330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:26.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.249+0000 7f340ffff640 1 --2- 10.20.193.76:0/1172043924 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f341812e3d0 0x7f34181307c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:26.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.249+0000 7f341d1fc640 1 -- 10.20.193.76:0/1172043924 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f341812e3d0 msgr2=0x7f34181307c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:26.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.249+0000 7f341d1fc640 1 --2- 10.20.193.76:0/1172043924 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f341812e3d0 0x7f34181307c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:26.251 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.249+0000 7f340f7fe640 1 -- 10.20.193.76:0/1172043924 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200136032 0 0) 0x7f3418127d40 con 0x7f3418127f40 2026-02-25T17:21:26.252 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.249+0000 7f341d1fc640 1 -- 10.20.193.76:0/1172043924 >> v1:10.20.193.76:6789/0 conn(0x7f3418127f40 legacy=0x7f3418128320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:26.252 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.249+0000 7f341d1fc640 1 -- 10.20.193.76:0/1172043924 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341806ef60 con 0x7f3418130d00 2026-02-25T17:21:26.252 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.249+0000 7f341d1fc640 1 --2- 10.20.193.76:0/1172043924 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3418130d00 0x7f34181330f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3414009dc0 tx=0x7f341402f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0996e45afcac6a3 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:26.252 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.249+0000 7f340f7fe640 1 -- 10.20.193.76:0/1172043924 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414006ea0 con 0x7f3418130d00 2026-02-25T17:21:26.252 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.249+0000 7f340f7fe640 1 -- 10.20.193.76:0/1172043924 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341402fdf0 con 0x7f3418130d00 2026-02-25T17:21:26.252 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.249+0000 7f340f7fe640 1 -- 10.20.193.76:0/1172043924 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414037660 con 0x7f3418130d00 2026-02-25T17:21:26.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.249+0000 7f341ec86640 1 -- 10.20.193.76:0/1172043924 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3418130d00 msgr2=0x7f34181330f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:26.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.249+0000 7f341ec86640 1 --2- 10.20.193.76:0/1172043924 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3418130d00 0x7f34181330f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3414009dc0 tx=0x7f341402f1c0 comp rx=0 tx=0).stop 2026-02-25T17:21:26.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.249+0000 7f341ec86640 1 -- 10.20.193.76:0/1172043924 shutdown_connections 2026-02-25T17:21:26.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.249+0000 7f341ec86640 1 --2- 10.20.193.76:0/1172043924 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3418130d00 0x7f34181330f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:26.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.249+0000 7f341ec86640 1 --2- 10.20.193.76:0/1172043924 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f341812e3d0 0x7f34181307c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:26.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.249+0000 7f341ec86640 1 -- 10.20.193.76:0/1172043924 >> 10.20.193.76:0/1172043924 conn(0x7f341809af50 msgr2=0x7f341808e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:26.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.249+0000 7f341ec86640 1 -- 10.20.193.76:0/1172043924 shutdown_connections 2026-02-25T17:21:26.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.249+0000 7f341ec86640 1 -- 10.20.193.76:0/1172043924 wait complete. 2026-02-25T17:21:26.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.250+0000 7f341ec86640 1 Processor -- start 2026-02-25T17:21:26.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.250+0000 7f341ec86640 1 -- start start 2026-02-25T17:21:26.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.250+0000 7f341ec86640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3418127f40 0x7f341812c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:26.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.250+0000 7f341ec86640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f341812e3d0 0x7f341812caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:26.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.250+0000 7f341ec86640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3418130d00 0x7f341812cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:26.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.250+0000 7f341ec86640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34181274f0 con 0x7f341812e3d0 2026-02-25T17:21:26.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.250+0000 7f341ec86640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341808e490 con 0x7f3418130d00 2026-02-25T17:21:26.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.250+0000 7f341ec86640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f341808c3c0 con 0x7f3418127f40 2026-02-25T17:21:26.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.250+0000 7f340ffff640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f341812e3d0 0x7f341812caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:26.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.250+0000 7f341c9fb640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3418127f40 0x7f341812c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:26.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.250+0000 7f340ffff640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f341812e3d0 0x7f341812caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:51950/0 (socket says 10.20.193.76:51950) 2026-02-25T17:21:26.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.250+0000 7f340ffff640 1 -- 10.20.193.76:0/4290418605 learned_addr learned my addr 10.20.193.76:0/4290418605 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:26.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.250+0000 7f341d1fc640 1 --2- 10.20.193.76:0/4290418605 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3418130d00 0x7f341812cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:26.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.251+0000 7f340ffff640 1 -- 10.20.193.76:0/4290418605 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3418127f40 msgr2=0x7f341812c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:26.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.251+0000 7f340ffff640 1 --2- 10.20.193.76:0/4290418605 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3418127f40 0x7f341812c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:26.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.251+0000 7f340ffff640 1 -- 10.20.193.76:0/4290418605 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3418130d00 msgr2=0x7f341812cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:26.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.251+0000 7f340ffff640 1 --2- 10.20.193.76:0/4290418605 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3418130d00 0x7f341812cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:26.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.251+0000 7f340ffff640 1 -- 10.20.193.76:0/4290418605 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3414009a70 con 0x7f341812e3d0 2026-02-25T17:21:26.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.251+0000 7f340ffff640 1 --2- 10.20.193.76:0/4290418605 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f341812e3d0 0x7f341812caa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f340000ebb0 tx=0x7f340000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:26.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.251+0000 7f340d7fa640 1 -- 10.20.193.76:0/4290418605 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400009770 con 0x7f341812e3d0 2026-02-25T17:21:26.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.251+0000 7f340d7fa640 1 -- 10.20.193.76:0/4290418605 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340000eec0 con 0x7f341812e3d0 2026-02-25T17:21:26.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.251+0000 7f341ec86640 1 -- 10.20.193.76:0/4290418605 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34181260c0 con 0x7f341812e3d0 2026-02-25T17:21:26.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.251+0000 7f340d7fa640 1 -- 10.20.193.76:0/4290418605 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340000ce60 con 0x7f341812e3d0 2026-02-25T17:21:26.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.251+0000 7f341ec86640 1 -- 10.20.193.76:0/4290418605 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341808c920 con 0x7f341812e3d0 2026-02-25T17:21:26.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.251+0000 7f341ec86640 1 -- 10.20.193.76:0/4290418605 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3418128320 con 0x7f341812e3d0 2026-02-25T17:21:26.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.252+0000 7f340d7fa640 1 -- 10.20.193.76:0/4290418605 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f3400011070 con 0x7f341812e3d0 2026-02-25T17:21:26.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.252+0000 7f340d7fa640 1 -- 10.20.193.76:0/4290418605 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3025+0+0 (secure 0 0 0) 0x7f3400066900 con 0x7f341812e3d0 2026-02-25T17:21:26.256 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.254+0000 7f340d7fa640 1 -- 10.20.193.76:0/4290418605 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f34000403a0 con 0x7f341812e3d0 2026-02-25T17:21:26.321 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:26.318+0000 7f341ec86640 1 -- 10.20.193.76:0/4290418605 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f341806f6b0 con 0x7f341812e3d0 2026-02-25T17:21:27.202 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.199+0000 7f340d7fa640 1 -- 10.20.193.76:0/4290418605 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v29) v1 ==== 153+0+0 (secure 0 0 0) 0x7f3400017030 con 0x7f341812e3d0 2026-02-25T17:21:27.202 INFO:teuthology.orchestra.run.trial076.stderr:set pool 2 pg_autoscale_mode to off 2026-02-25T17:21:27.204 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.201+0000 7f341ec86640 1 -- 10.20.193.76:0/4290418605 >> v1:10.20.193.76:6800/1563581135 conn(0x7f33e804f880 legacy=0x7f33e8051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.204 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.201+0000 7f341ec86640 1 -- 10.20.193.76:0/4290418605 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f341812e3d0 msgr2=0x7f341812caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.204 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.201+0000 7f341ec86640 1 --2- 10.20.193.76:0/4290418605 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f341812e3d0 0x7f341812caa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f340000ebb0 tx=0x7f340000c520 comp rx=0 tx=0).stop 2026-02-25T17:21:27.204 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.201+0000 7f341ec86640 1 -- 10.20.193.76:0/4290418605 shutdown_connections 2026-02-25T17:21:27.205 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.201+0000 7f341ec86640 1 --2- 10.20.193.76:0/4290418605 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3418130d00 0x7f341812cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.205 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.201+0000 7f341ec86640 1 --2- 10.20.193.76:0/4290418605 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f341812e3d0 0x7f341812caa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.205 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.201+0000 7f341ec86640 1 --2- 10.20.193.76:0/4290418605 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3418127f40 0x7f341812c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.205 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.201+0000 7f341ec86640 1 -- 10.20.193.76:0/4290418605 >> 10.20.193.76:0/4290418605 conn(0x7f341809af50 msgr2=0x7f3418132950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:27.205 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.201+0000 7f341ec86640 1 -- 10.20.193.76:0/4290418605 shutdown_connections 2026-02-25T17:21:27.205 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.201+0000 7f341ec86640 1 -- 10.20.193.76:0/4290418605 wait complete. 2026-02-25T17:21:27.214 INFO:teuthology.run_tasks:Running task ceph.healthy... 2026-02-25T17:21:27.232 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-25T17:21:27.232 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-25T17:21:27.233 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-25T17:21:27.305 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.298+0000 7f5efdfd1640 1 Processor -- start 2026-02-25T17:21:27.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.298+0000 7f5efdfd1640 1 -- start start 2026-02-25T17:21:27.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.298+0000 7f5efdfd1640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f5ef806fcc0 0x7f5ef8071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.298+0000 7f5efdfd1640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5ef8133c20 0x7f5ef8136010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.298+0000 7f5efdfd1640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef809d9a0 con 0x7f5ef806f210 2026-02-25T17:21:27.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.298+0000 7f5efdfd1640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef8070560 con 0x7f5ef806fcc0 2026-02-25T17:21:27.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.298+0000 7f5efdfd1640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef80992e0 con 0x7f5ef8133c20 2026-02-25T17:21:27.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.298+0000 7f5ef77fe640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f5ef806f210 0x7f5ef8070b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:60864/0 (socket says 10.20.193.76:60864) 2026-02-25T17:21:27.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.298+0000 7f5ef77fe640 1 -- 10.20.193.76:0/3138956931 learned_addr learned my addr 10.20.193.76:0/3138956931 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:27.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.298+0000 7f5ef7fff640 1 --2- 10.20.193.76:0/3138956931 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5ef8133c20 0x7f5ef8136010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.298+0000 7f5ef6ffd640 1 --2- 10.20.193.76:0/3138956931 >> v2:10.20.193.76:3300/0 conn(0x7f5ef806fcc0 0x7f5ef8071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.298+0000 7f5ef67fc640 1 -- 10.20.193.76:0/3138956931 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856485907 0 0) 0x7f5ef809d9a0 con 0x7f5ef806f210 2026-02-25T17:21:27.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.299+0000 7f5ef67fc640 1 -- 10.20.193.76:0/3138956931 --> v1:10.20.193.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5edc003620 con 0x7f5ef806f210 2026-02-25T17:21:27.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.299+0000 7f5ef6ffd640 1 -- 10.20.193.76:0/3138956931 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5ef8133c20 msgr2=0x7f5ef8136010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:27.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.299+0000 7f5ef6ffd640 1 --2- 10.20.193.76:0/3138956931 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5ef8133c20 0x7f5ef8136010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.299+0000 7f5ef6ffd640 1 -- 10.20.193.76:0/3138956931 >> v1:10.20.193.76:6789/0 conn(0x7f5ef806f210 legacy=0x7f5ef8070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.299+0000 7f5ef6ffd640 1 -- 10.20.193.76:0/3138956931 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef8070870 con 0x7f5ef806fcc0 2026-02-25T17:21:27.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.299+0000 7f5ef6ffd640 1 --2- 10.20.193.76:0/3138956931 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5ef806fcc0 0x7f5ef8071240 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80098a0 tx=0x7f5ee802ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3710ce3385ef75 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.299+0000 7f5ef67fc640 1 -- 10.20.193.76:0/3138956931 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee802fa40 con 0x7f5ef806fcc0 2026-02-25T17:21:27.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.299+0000 7f5ef67fc640 1 -- 10.20.193.76:0/3138956931 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee802fba0 con 0x7f5ef806fcc0 2026-02-25T17:21:27.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.299+0000 7f5ef67fc640 1 -- 10.20.193.76:0/3138956931 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8037440 con 0x7f5ef806fcc0 2026-02-25T17:21:27.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.299+0000 7f5efdfd1640 1 -- 10.20.193.76:0/3138956931 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5ef806fcc0 msgr2=0x7f5ef8071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.299+0000 7f5efdfd1640 1 --2- 10.20.193.76:0/3138956931 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5ef806fcc0 0x7f5ef8071240 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ee80098a0 tx=0x7f5ee802ed80 comp rx=0 tx=0).stop 2026-02-25T17:21:27.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.299+0000 7f5efdfd1640 1 -- 10.20.193.76:0/3138956931 shutdown_connections 2026-02-25T17:21:27.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.299+0000 7f5efdfd1640 1 --2- 10.20.193.76:0/3138956931 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5ef8133c20 0x7f5ef8136010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.299+0000 7f5efdfd1640 1 --2- 10.20.193.76:0/3138956931 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5ef806fcc0 0x7f5ef8071240 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.299+0000 7f5efdfd1640 1 -- 10.20.193.76:0/3138956931 >> 10.20.193.76:0/3138956931 conn(0x7f5ef809a960 msgr2=0x7f5ef809ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:27.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.299+0000 7f5efdfd1640 1 -- 10.20.193.76:0/3138956931 shutdown_connections 2026-02-25T17:21:27.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.299+0000 7f5efdfd1640 1 -- 10.20.193.76:0/3138956931 wait complete. 2026-02-25T17:21:27.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5efdfd1640 1 Processor -- start 2026-02-25T17:21:27.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5efdfd1640 1 -- start start 2026-02-25T17:21:27.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5efdfd1640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5ef806f210 0x7f5ef80930a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5efdfd1640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5ef806fcc0 0x7f5ef80935e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5efdfd1640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5ef8133c20 0x7f5ef8093b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5efdfd1640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef80987e0 con 0x7f5ef806f210 2026-02-25T17:21:27.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5efdfd1640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef8072000 con 0x7f5ef8133c20 2026-02-25T17:21:27.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5efdfd1640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef80964a0 con 0x7f5ef806fcc0 2026-02-25T17:21:27.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5ef6ffd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5ef806fcc0 0x7f5ef80935e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5ef77fe640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5ef806f210 0x7f5ef80930a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5ef6ffd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5ef806fcc0 0x7f5ef80935e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:38986/0 (socket says 10.20.193.76:38986) 2026-02-25T17:21:27.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5ef6ffd640 1 -- 10.20.193.76:0/1869401377 learned_addr learned my addr 10.20.193.76:0/1869401377 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:27.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5ef7fff640 1 --2- 10.20.193.76:0/1869401377 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5ef8133c20 0x7f5ef8093b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5ef6ffd640 1 -- 10.20.193.76:0/1869401377 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5ef8133c20 msgr2=0x7f5ef8093b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5ef6ffd640 1 --2- 10.20.193.76:0/1869401377 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5ef8133c20 0x7f5ef8093b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5ef6ffd640 1 -- 10.20.193.76:0/1869401377 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5ef806f210 msgr2=0x7f5ef80930a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5ef6ffd640 1 --2- 10.20.193.76:0/1869401377 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5ef806f210 0x7f5ef80930a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5ef6ffd640 1 -- 10.20.193.76:0/1869401377 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee8009500 con 0x7f5ef806fcc0 2026-02-25T17:21:27.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5ef7fff640 1 --2- 10.20.193.76:0/1869401377 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5ef8133c20 0x7f5ef8093b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-25T17:21:27.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5ef6ffd640 1 --2- 10.20.193.76:0/1869401377 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5ef806fcc0 0x7f5ef80935e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009130 tx=0x7f5ee80047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.300+0000 7f5ed3fff640 1 -- 10.20.193.76:0/1869401377 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8004230 con 0x7f5ef806fcc0 2026-02-25T17:21:27.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.301+0000 7f5ed3fff640 1 -- 10.20.193.76:0/1869401377 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee8004390 con 0x7f5ef806fcc0 2026-02-25T17:21:27.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.301+0000 7f5efdfd1640 1 -- 10.20.193.76:0/1869401377 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef8096870 con 0x7f5ef806fcc0 2026-02-25T17:21:27.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.301+0000 7f5ed3fff640 1 -- 10.20.193.76:0/1869401377 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8003710 con 0x7f5ef806fcc0 2026-02-25T17:21:27.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.301+0000 7f5efdfd1640 1 -- 10.20.193.76:0/1869401377 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef8094b70 con 0x7f5ef806fcc0 2026-02-25T17:21:27.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.301+0000 7f5efdfd1640 1 -- 10.20.193.76:0/1869401377 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ef8135370 con 0x7f5ef806fcc0 2026-02-25T17:21:27.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.301+0000 7f5ed3fff640 1 -- 10.20.193.76:0/1869401377 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f5ee8003870 con 0x7f5ef806fcc0 2026-02-25T17:21:27.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.301+0000 7f5ed3fff640 1 -- 10.20.193.76:0/1869401377 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7f5ee808bff0 con 0x7f5ef806fcc0 2026-02-25T17:21:27.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.303+0000 7f5ed3fff640 1 -- 10.20.193.76:0/1869401377 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f5ee80b74a0 con 0x7f5ef806fcc0 2026-02-25T17:21:27.386 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.384+0000 7f5efdfd1640 1 -- 10.20.193.76:0/1869401377 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f5ef8068270 con 0x7f5ef806fcc0 2026-02-25T17:21:27.388 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.385+0000 7f5ed3fff640 1 -- 10.20.193.76:0/1869401377 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v10) v1 ==== 74+0+121638 (secure 0 0 0) 0x7f5ee80b0b40 con 0x7f5ef806fcc0 2026-02-25T17:21:27.391 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:27.393 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.386+0000 7f5efdfd1640 1 -- 10.20.193.76:0/1869401377 >> v1:10.20.193.76:6800/1563581135 conn(0x7f5ec804f880 legacy=0x7f5ec8051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.393 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.386+0000 7f5efdfd1640 1 -- 10.20.193.76:0/1869401377 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5ef806fcc0 msgr2=0x7f5ef80935e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.394 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.386+0000 7f5efdfd1640 1 --2- 10.20.193.76:0/1869401377 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5ef806fcc0 0x7f5ef80935e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009130 tx=0x7f5ee80047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.394 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.386+0000 7f5efdfd1640 1 -- 10.20.193.76:0/1869401377 shutdown_connections 2026-02-25T17:21:27.394 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.386+0000 7f5efdfd1640 1 --2- 10.20.193.76:0/1869401377 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f5ef8133c20 0x7f5ef8093b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.395 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.386+0000 7f5efdfd1640 1 --2- 10.20.193.76:0/1869401377 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5ef806fcc0 0x7f5ef80935e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.395 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.386+0000 7f5efdfd1640 1 --2- 10.20.193.76:0/1869401377 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f5ef806f210 0x7f5ef80930a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.395 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.386+0000 7f5efdfd1640 1 -- 10.20.193.76:0/1869401377 >> 10.20.193.76:0/1869401377 conn(0x7f5ef809a960 msgr2=0x7f5ef81340b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:27.395 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.386+0000 7f5efdfd1640 1 -- 10.20.193.76:0/1869401377 shutdown_connections 2026-02-25T17:21:27.396 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.386+0000 7f5efdfd1640 1 -- 10.20.193.76:0/1869401377 wait complete. 2026-02-25T17:21:27.398 INFO:teuthology.orchestra.run.trial076.stdout:{"epoch":10,"flags":0,"active_gid":14104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6800","nonce":1563581135}]},"active_addr":"10.20.193.76:6800/1563581135","active_change":"2026-02-25T17:21:11.039792+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14100,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":16,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.76:0","nonce":2015954325}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.76:0","nonce":1436668584}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.76:0","nonce":3998645925}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.76:0","nonce":1393259912}]}]} 2026-02-25T17:21:27.412 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-25T17:21:27.412 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-25T17:21:27.413 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T17:21:27.485 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.477+0000 7ff2971f0640 1 Processor -- start 2026-02-25T17:21:27.486 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.477+0000 7ff2971f0640 1 -- start start 2026-02-25T17:21:27.486 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff2971f0640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff29006f210 0x7ff290070b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.486 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff2971f0640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7ff29006fcc0 0x7ff290071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.486 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff2971f0640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff2900715b0 0x7ff290134c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.486 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff2971f0640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29009d9a0 con 0x7ff29006fcc0 2026-02-25T17:21:27.486 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff2971f0640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff290070560 con 0x7ff29006f210 2026-02-25T17:21:27.486 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff2971f0640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2900992e0 con 0x7ff2900715b0 2026-02-25T17:21:27.486 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff294f65640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff29006f210 0x7ff290070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.486 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff294f65640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff29006f210 0x7ff290070b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50428/0 (socket says 10.20.193.76:50428) 2026-02-25T17:21:27.486 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff294f65640 1 -- 10.20.193.76:0/3288030975 learned_addr learned my addr 10.20.193.76:0/3288030975 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:27.487 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff287fff640 1 --2- 10.20.193.76:0/3288030975 >> v2:10.20.193.76:3300/0 conn(0x7ff29006fcc0 0x7ff290071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.487 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff295766640 1 --2- 10.20.193.76:0/3288030975 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff2900715b0 0x7ff290134c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.487 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff294f65640 1 -- 10.20.193.76:0/3288030975 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff2900715b0 msgr2=0x7ff290134c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:27.487 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff294f65640 1 --2- 10.20.193.76:0/3288030975 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff2900715b0 0x7ff290134c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.487 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff294f65640 1 -- 10.20.193.76:0/3288030975 >> v2:10.20.193.76:3300/0 conn(0x7ff29006fcc0 msgr2=0x7ff290071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:27.487 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff294f65640 1 --2- 10.20.193.76:0/3288030975 >> v2:10.20.193.76:3300/0 conn(0x7ff29006fcc0 0x7ff290071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.487 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff294f65640 1 -- 10.20.193.76:0/3288030975 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff290070870 con 0x7ff29006f210 2026-02-25T17:21:27.487 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff295766640 1 --2- 10.20.193.76:0/3288030975 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff2900715b0 0x7ff290134c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-25T17:21:27.487 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff294f65640 1 --2- 10.20.193.76:0/3288030975 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff29006f210 0x7ff290070b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff2800099a0 tx=0x7ff28002ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f49ace306c46388f server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.487 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff2877fe640 1 -- 10.20.193.76:0/3288030975 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28002fac0 con 0x7ff29006f210 2026-02-25T17:21:27.488 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff2877fe640 1 -- 10.20.193.76:0/3288030975 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28002fc20 con 0x7ff29006f210 2026-02-25T17:21:27.488 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.478+0000 7ff2877fe640 1 -- 10.20.193.76:0/3288030975 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280037440 con 0x7ff29006f210 2026-02-25T17:21:27.488 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.479+0000 7ff2971f0640 1 -- 10.20.193.76:0/3288030975 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff29006f210 msgr2=0x7ff290070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.488 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.479+0000 7ff2971f0640 1 --2- 10.20.193.76:0/3288030975 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff29006f210 0x7ff290070b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff2800099a0 tx=0x7ff28002ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:27.488 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.479+0000 7ff2971f0640 1 -- 10.20.193.76:0/3288030975 shutdown_connections 2026-02-25T17:21:27.488 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.479+0000 7ff2971f0640 1 --2- 10.20.193.76:0/3288030975 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff2900715b0 0x7ff290134c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.488 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.479+0000 7ff2971f0640 1 --2- 10.20.193.76:0/3288030975 >> v2:10.20.193.76:3300/0 conn(0x7ff29006fcc0 0x7ff290071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.488 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.479+0000 7ff2971f0640 1 --2- 10.20.193.76:0/3288030975 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff29006f210 0x7ff290070b30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.488 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.479+0000 7ff2971f0640 1 -- 10.20.193.76:0/3288030975 >> 10.20.193.76:0/3288030975 conn(0x7ff29009a960 msgr2=0x7ff29009ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:27.488 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.479+0000 7ff2971f0640 1 -- 10.20.193.76:0/3288030975 shutdown_connections 2026-02-25T17:21:27.489 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.479+0000 7ff2971f0640 1 -- 10.20.193.76:0/3288030975 wait complete. 2026-02-25T17:21:27.489 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.479+0000 7ff2971f0640 1 Processor -- start 2026-02-25T17:21:27.489 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.479+0000 7ff2971f0640 1 -- start start 2026-02-25T17:21:27.489 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff2971f0640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff29006f210 0x7ff290123ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.489 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff2971f0640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff29006fcc0 0x7ff290123ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.489 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff2971f0640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff2900715b0 0x7ff290124530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.489 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff2971f0640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2901254c0 con 0x7ff29006fcc0 2026-02-25T17:21:27.489 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff2971f0640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff290126850 con 0x7ff2900715b0 2026-02-25T17:21:27.489 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff2971f0640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff290071f90 con 0x7ff29006f210 2026-02-25T17:21:27.489 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff294f65640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff29006f210 0x7ff290123ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.490 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff287fff640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff29006fcc0 0x7ff290123ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.490 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff294f65640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff29006f210 0x7ff290123ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39004/0 (socket says 10.20.193.76:39004) 2026-02-25T17:21:27.490 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff294f65640 1 -- 10.20.193.76:0/4118969015 learned_addr learned my addr 10.20.193.76:0/4118969015 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:27.490 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff295766640 1 --2- 10.20.193.76:0/4118969015 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff2900715b0 0x7ff290124530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.490 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff287fff640 1 -- 10.20.193.76:0/4118969015 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff29006f210 msgr2=0x7ff290123ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.490 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff287fff640 1 --2- 10.20.193.76:0/4118969015 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff29006f210 0x7ff290123ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.490 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff287fff640 1 -- 10.20.193.76:0/4118969015 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff2900715b0 msgr2=0x7ff290124530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.490 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff287fff640 1 --2- 10.20.193.76:0/4118969015 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff2900715b0 0x7ff290124530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.490 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff287fff640 1 -- 10.20.193.76:0/4118969015 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2800095d0 con 0x7ff29006fcc0 2026-02-25T17:21:27.491 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff294f65640 1 --2- 10.20.193.76:0/4118969015 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff29006f210 0x7ff290123ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:27.491 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff295766640 1 --2- 10.20.193.76:0/4118969015 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff2900715b0 0x7ff290124530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-25T17:21:27.491 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff287fff640 1 --2- 10.20.193.76:0/4118969015 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff29006fcc0 0x7ff290123ff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff27800e9e0 tx=0x7ff27800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.491 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff2857fa640 1 -- 10.20.193.76:0/4118969015 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27800ca00 con 0x7ff29006fcc0 2026-02-25T17:21:27.491 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff2857fa640 1 -- 10.20.193.76:0/4118969015 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27800cb60 con 0x7ff29006fcc0 2026-02-25T17:21:27.491 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff2971f0640 1 -- 10.20.193.76:0/4118969015 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff290134ee0 con 0x7ff29006fcc0 2026-02-25T17:21:27.491 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff2857fa640 1 -- 10.20.193.76:0/4118969015 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278013470 con 0x7ff29006fcc0 2026-02-25T17:21:27.491 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.480+0000 7ff2971f0640 1 -- 10.20.193.76:0/4118969015 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff290125b40 con 0x7ff29006fcc0 2026-02-25T17:21:27.491 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.481+0000 7ff2971f0640 1 -- 10.20.193.76:0/4118969015 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2900008d0 con 0x7ff29006fcc0 2026-02-25T17:21:27.491 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.481+0000 7ff2857fa640 1 -- 10.20.193.76:0/4118969015 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7ff278011070 con 0x7ff29006fcc0 2026-02-25T17:21:27.492 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.481+0000 7ff2857fa640 1 -- 10.20.193.76:0/4118969015 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7ff2780668b0 con 0x7ff29006fcc0 2026-02-25T17:21:27.492 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.483+0000 7ff2857fa640 1 -- 10.20.193.76:0/4118969015 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7ff278040230 con 0x7ff29006fcc0 2026-02-25T17:21:27.553 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.550+0000 7ff2971f0640 1 -- 10.20.193.76:0/4118969015 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff290070a90 con 0x7ff29006fcc0 2026-02-25T17:21:27.553 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.550+0000 7ff2857fa640 1 -- 10.20.193.76:0/4118969015 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+9086 (secure 0 0 0) 0x7ff278017030 con 0x7ff29006fcc0 2026-02-25T17:21:27.554 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:27.554 INFO:teuthology.orchestra.run.trial076.stdout:{"epoch":29,"fsid":"0648ee30-4e19-4268-91ad-07b0e65a8518","created":"2026-02-25T17:13:33.780133+0000","modified":"2026-02-25T17:21:27.198134+0000","last_up_change":"2026-02-25T17:21:23.187037+0000","last_in_change":"2026-02-25T17:13:34.859194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-25T17:13:42.208987+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-25T17:13:42.832027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85909bd3-2540-48a9-a649-33709fa74613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":16,"up_from":22,"up_thru":23,"down_at":17,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6805","nonce":1645506709}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6806","nonce":1645506709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6808","nonce":1645506709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6807","nonce":1645506709}]},"public_addr":"10.20.193.76:6805/1645506709","cluster_addr":"10.20.193.76:6806/1645506709","heartbeat_back_addr":"10.20.193.76:6808/1645506709","heartbeat_front_addr":"10.20.193.76:6807/1645506709","state":["exists","up"]},{"osd":1,"uuid":"f0a0a51c-d629-464e-bc04-dacbaaf78efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":16,"up_from":23,"up_thru":25,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6809","nonce":1923901808}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6810","nonce":1923901808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6812","nonce":1923901808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6811","nonce":1923901808}]},"public_addr":"10.20.193.76:6809/1923901808","cluster_addr":"10.20.193.76:6810/1923901808","heartbeat_back_addr":"10.20.193.76:6812/1923901808","heartbeat_front_addr":"10.20.193.76:6811/1923901808","state":["exists","up"]},{"osd":2,"uuid":"9633000b-764d-457a-b560-539dc5830e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":24,"up_thru":25,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6801","nonce":3531107996}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6802","nonce":3531107996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6804","nonce":3531107996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6803","nonce":3531107996}]},"public_addr":"10.20.193.76:6801/3531107996","cluster_addr":"10.20.193.76:6802/3531107996","heartbeat_back_addr":"10.20.193.76:6804/3531107996","heartbeat_front_addr":"10.20.193.76:6803/3531107996","state":["exists","up"]},{"osd":3,"uuid":"fc098e34-48a8-4414-ad41-60abdf7388a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":19,"up_from":25,"up_thru":25,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6813","nonce":39660203}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6814","nonce":39660203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6816","nonce":39660203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6815","nonce":39660203}]},"public_addr":"10.20.193.76:6813/39660203","cluster_addr":"10.20.193.76:6814/39660203","heartbeat_back_addr":"10.20.193.76:6816/39660203","heartbeat_front_addr":"10.20.193.76:6815/39660203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.998715+0000","dead_epoch":17},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.974454+0000","dead_epoch":18},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:40.020834+0000","dead_epoch":19},{"osd":3,"down_stamp":"2026-02-25T17:21:17.173929+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.943932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.76:0/94912213":"2026-02-26T17:21:11.039698+0000","10.20.193.76:6800/42442":"2026-02-26T17:21:11.039698+0000","10.20.193.76:0/1432153956":"2026-02-26T17:21:11.039698+0000","10.20.193.76:0/1754372634":"2026-02-26T17:21:11.039698+0000","10.20.193.76:0/599075350":"2026-02-26T17:21:11.039698+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T17:21:27.555 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.551+0000 7ff2971f0640 1 -- 10.20.193.76:0/4118969015 >> v1:10.20.193.76:6800/1563581135 conn(0x7ff26004f880 legacy=0x7ff260051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.555 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.551+0000 7ff2971f0640 1 -- 10.20.193.76:0/4118969015 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff29006fcc0 msgr2=0x7ff290123ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.555 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.551+0000 7ff2971f0640 1 --2- 10.20.193.76:0/4118969015 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff29006fcc0 0x7ff290123ff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff27800e9e0 tx=0x7ff27800eeb0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.555 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.551+0000 7ff2971f0640 1 -- 10.20.193.76:0/4118969015 shutdown_connections 2026-02-25T17:21:27.555 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.551+0000 7ff2971f0640 1 --2- 10.20.193.76:0/4118969015 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff2900715b0 0x7ff290124530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.556 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.551+0000 7ff2971f0640 1 --2- 10.20.193.76:0/4118969015 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff29006fcc0 0x7ff290123ff0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.556 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.551+0000 7ff2971f0640 1 --2- 10.20.193.76:0/4118969015 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff29006f210 0x7ff290123ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.556 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.551+0000 7ff2971f0640 1 -- 10.20.193.76:0/4118969015 >> 10.20.193.76:0/4118969015 conn(0x7ff29009a960 msgr2=0x7ff29006c090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:27.556 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.552+0000 7ff2971f0640 1 -- 10.20.193.76:0/4118969015 shutdown_connections 2026-02-25T17:21:27.556 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.552+0000 7ff2971f0640 1 -- 10.20.193.76:0/4118969015 wait complete. 2026-02-25T17:21:27.562 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-25T17:21:27.562 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T17:21:27.634 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.627+0000 7f2a0fcd1640 1 Processor -- start 2026-02-25T17:21:27.634 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.627+0000 7f2a0fcd1640 1 -- start start 2026-02-25T17:21:27.634 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.627+0000 7f2a0fcd1640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2a0806eac0 0x7f2a081316f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.634 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.627+0000 7f2a0fcd1640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f2a08131c30 0x7f2a08134020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.634 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.627+0000 7f2a0fcd1640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a0809d9a0 con 0x7f2a0806dfd0 2026-02-25T17:21:27.635 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.627+0000 7f2a0fcd1640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a0806eea0 con 0x7f2a08131c30 2026-02-25T17:21:27.635 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.627+0000 7f2a0fcd1640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a08099190 con 0x7f2a0806eac0 2026-02-25T17:21:27.635 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.627+0000 7f2a0da46640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f2a0806dfd0 0x7f2a0806e3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:60866/0 (socket says 10.20.193.76:60866) 2026-02-25T17:21:27.635 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.627+0000 7f2a0da46640 1 -- 10.20.193.76:0/4063198413 learned_addr learned my addr 10.20.193.76:0/4063198413 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:27.635 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.627+0000 7f2a0d245640 1 --2- 10.20.193.76:0/4063198413 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2a0806eac0 0x7f2a081316f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.635 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.627+0000 7f2a0e247640 1 --2- 10.20.193.76:0/4063198413 >> v2:10.20.193.76:3300/0 conn(0x7f2a08131c30 0x7f2a08134020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.635 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.627+0000 7f2a0ca44640 1 -- 10.20.193.76:0/4063198413 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28879818 0 0) 0x7f2a0809d9a0 con 0x7f2a0806dfd0 2026-02-25T17:21:27.635 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.627+0000 7f2a0ca44640 1 -- 10.20.193.76:0/4063198413 --> v1:10.20.193.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29f0003620 con 0x7f2a0806dfd0 2026-02-25T17:21:27.635 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.627+0000 7f2a0d245640 1 -- 10.20.193.76:0/4063198413 >> v2:10.20.193.76:3300/0 conn(0x7f2a08131c30 msgr2=0x7f2a08134020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:27.635 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.627+0000 7f2a0d245640 1 --2- 10.20.193.76:0/4063198413 >> v2:10.20.193.76:3300/0 conn(0x7f2a08131c30 0x7f2a08134020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.635 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.627+0000 7f2a0d245640 1 -- 10.20.193.76:0/4063198413 >> v1:10.20.193.76:6789/0 conn(0x7f2a0806dfd0 legacy=0x7f2a0806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.636 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.627+0000 7f2a0d245640 1 -- 10.20.193.76:0/4063198413 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a08072260 con 0x7f2a0806eac0 2026-02-25T17:21:27.636 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.627+0000 7f2a0e247640 1 --2- 10.20.193.76:0/4063198413 >> v2:10.20.193.76:3300/0 conn(0x7f2a08131c30 0x7f2a08134020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:27.636 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.628+0000 7f2a0d245640 1 --2- 10.20.193.76:0/4063198413 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2a0806eac0 0x7f2a081316f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0098a0 tx=0x7f29fc02ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aefce2f7fd44583 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.636 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.628+0000 7f2a0ca44640 1 -- 10.20.193.76:0/4063198413 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc02fad0 con 0x7f2a0806eac0 2026-02-25T17:21:27.636 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.628+0000 7f2a0ca44640 1 -- 10.20.193.76:0/4063198413 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc02fc30 con 0x7f2a0806eac0 2026-02-25T17:21:27.636 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.628+0000 7f2a0ca44640 1 -- 10.20.193.76:0/4063198413 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc037440 con 0x7f2a0806eac0 2026-02-25T17:21:27.636 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.628+0000 7f2a0fcd1640 1 -- 10.20.193.76:0/4063198413 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2a0806eac0 msgr2=0x7f2a081316f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.636 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.628+0000 7f2a0fcd1640 1 --2- 10.20.193.76:0/4063198413 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2a0806eac0 0x7f2a081316f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0098a0 tx=0x7f29fc02ee10 comp rx=0 tx=0).stop 2026-02-25T17:21:27.636 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.628+0000 7f2a0fcd1640 1 -- 10.20.193.76:0/4063198413 shutdown_connections 2026-02-25T17:21:27.636 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.628+0000 7f2a0fcd1640 1 --2- 10.20.193.76:0/4063198413 >> v2:10.20.193.76:3300/0 conn(0x7f2a08131c30 0x7f2a08134020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.637 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.628+0000 7f2a0fcd1640 1 --2- 10.20.193.76:0/4063198413 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2a0806eac0 0x7f2a081316f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.637 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.628+0000 7f2a0fcd1640 1 -- 10.20.193.76:0/4063198413 >> 10.20.193.76:0/4063198413 conn(0x7f2a0809a960 msgr2=0x7f2a0809ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:27.637 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.628+0000 7f2a0fcd1640 1 -- 10.20.193.76:0/4063198413 shutdown_connections 2026-02-25T17:21:27.637 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.628+0000 7f2a0fcd1640 1 -- 10.20.193.76:0/4063198413 wait complete. 2026-02-25T17:21:27.637 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0fcd1640 1 Processor -- start 2026-02-25T17:21:27.637 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0fcd1640 1 -- start start 2026-02-25T17:21:27.637 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0fcd1640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2a0806dfd0 0x7f2a0812d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.637 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0fcd1640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2a0806eac0 0x7f2a0812dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.637 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0fcd1640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2a08131c30 0x7f2a0812e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.637 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0fcd1640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a081317c0 con 0x7f2a08131c30 2026-02-25T17:21:27.637 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0fcd1640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a08129310 con 0x7f2a0806dfd0 2026-02-25T17:21:27.638 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0fcd1640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0812edc0 con 0x7f2a0806eac0 2026-02-25T17:21:27.638 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0d245640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2a0806eac0 0x7f2a0812dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.638 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0e247640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2a08131c30 0x7f2a0812e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.638 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0d245640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2a0806eac0 0x7f2a0812dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39024/0 (socket says 10.20.193.76:39024) 2026-02-25T17:21:27.638 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0da46640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2a0806dfd0 0x7f2a0812d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.638 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0d245640 1 -- 10.20.193.76:0/3619699958 learned_addr learned my addr 10.20.193.76:0/3619699958 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:27.638 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0d245640 1 -- 10.20.193.76:0/3619699958 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2a0806dfd0 msgr2=0x7f2a0812d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.638 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0d245640 1 --2- 10.20.193.76:0/3619699958 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2a0806dfd0 0x7f2a0812d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.638 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0d245640 1 -- 10.20.193.76:0/3619699958 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2a08131c30 msgr2=0x7f2a0812e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.638 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0d245640 1 --2- 10.20.193.76:0/3619699958 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2a08131c30 0x7f2a0812e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0d245640 1 -- 10.20.193.76:0/3619699958 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a04009a70 con 0x7f2a0806eac0 2026-02-25T17:21:27.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0d245640 1 --2- 10.20.193.76:0/3619699958 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2a0806eac0 0x7f2a0812dc10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f29fc009130 tx=0x7f29fc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f29f67fc640 1 -- 10.20.193.76:0/3619699958 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc046070 con 0x7f2a0806eac0 2026-02-25T17:21:27.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f29f67fc640 1 -- 10.20.193.76:0/3619699958 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29fc042470 con 0x7f2a0806eac0 2026-02-25T17:21:27.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f29f67fc640 1 -- 10.20.193.76:0/3619699958 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29fc042800 con 0x7f2a0806eac0 2026-02-25T17:21:27.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0fcd1640 1 -- 10.20.193.76:0/3619699958 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29fc009500 con 0x7f2a0806eac0 2026-02-25T17:21:27.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.629+0000 7f2a0fcd1640 1 -- 10.20.193.76:0/3619699958 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a08126b70 con 0x7f2a0806eac0 2026-02-25T17:21:27.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.630+0000 7f2a0fcd1640 1 -- 10.20.193.76:0/3619699958 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a0812f9a0 con 0x7f2a0806eac0 2026-02-25T17:21:27.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.630+0000 7f29f67fc640 1 -- 10.20.193.76:0/3619699958 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f29fc040420 con 0x7f2a0806eac0 2026-02-25T17:21:27.639 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.630+0000 7f29f67fc640 1 -- 10.20.193.76:0/3619699958 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7f29fc08ba30 con 0x7f2a0806eac0 2026-02-25T17:21:27.640 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.632+0000 7f29f67fc640 1 -- 10.20.193.76:0/3619699958 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f29fc065460 con 0x7f2a0806eac0 2026-02-25T17:21:27.701 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.699+0000 7f2a0fcd1640 1 -- 10.20.193.76:0/3619699958 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a0806e3b0 con 0x7f2a0806eac0 2026-02-25T17:21:27.702 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.699+0000 7f29f67fc640 1 -- 10.20.193.76:0/3619699958 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+9086 (secure 0 0 0) 0x7f29fc03c070 con 0x7f2a0806eac0 2026-02-25T17:21:27.702 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:27.702 INFO:teuthology.orchestra.run.trial076.stdout:{"epoch":29,"fsid":"0648ee30-4e19-4268-91ad-07b0e65a8518","created":"2026-02-25T17:13:33.780133+0000","modified":"2026-02-25T17:21:27.198134+0000","last_up_change":"2026-02-25T17:21:23.187037+0000","last_in_change":"2026-02-25T17:13:34.859194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-25T17:13:42.208987+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-25T17:13:42.832027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85909bd3-2540-48a9-a649-33709fa74613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":16,"up_from":22,"up_thru":23,"down_at":17,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6805","nonce":1645506709}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6806","nonce":1645506709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6808","nonce":1645506709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6807","nonce":1645506709}]},"public_addr":"10.20.193.76:6805/1645506709","cluster_addr":"10.20.193.76:6806/1645506709","heartbeat_back_addr":"10.20.193.76:6808/1645506709","heartbeat_front_addr":"10.20.193.76:6807/1645506709","state":["exists","up"]},{"osd":1,"uuid":"f0a0a51c-d629-464e-bc04-dacbaaf78efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":16,"up_from":23,"up_thru":25,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6809","nonce":1923901808}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6810","nonce":1923901808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6812","nonce":1923901808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6811","nonce":1923901808}]},"public_addr":"10.20.193.76:6809/1923901808","cluster_addr":"10.20.193.76:6810/1923901808","heartbeat_back_addr":"10.20.193.76:6812/1923901808","heartbeat_front_addr":"10.20.193.76:6811/1923901808","state":["exists","up"]},{"osd":2,"uuid":"9633000b-764d-457a-b560-539dc5830e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":24,"up_thru":25,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6801","nonce":3531107996}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6802","nonce":3531107996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6804","nonce":3531107996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6803","nonce":3531107996}]},"public_addr":"10.20.193.76:6801/3531107996","cluster_addr":"10.20.193.76:6802/3531107996","heartbeat_back_addr":"10.20.193.76:6804/3531107996","heartbeat_front_addr":"10.20.193.76:6803/3531107996","state":["exists","up"]},{"osd":3,"uuid":"fc098e34-48a8-4414-ad41-60abdf7388a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":19,"up_from":25,"up_thru":25,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6813","nonce":39660203}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6814","nonce":39660203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6816","nonce":39660203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6815","nonce":39660203}]},"public_addr":"10.20.193.76:6813/39660203","cluster_addr":"10.20.193.76:6814/39660203","heartbeat_back_addr":"10.20.193.76:6816/39660203","heartbeat_front_addr":"10.20.193.76:6815/39660203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.998715+0000","dead_epoch":17},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.974454+0000","dead_epoch":18},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:40.020834+0000","dead_epoch":19},{"osd":3,"down_stamp":"2026-02-25T17:21:17.173929+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.943932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.76:0/94912213":"2026-02-26T17:21:11.039698+0000","10.20.193.76:6800/42442":"2026-02-26T17:21:11.039698+0000","10.20.193.76:0/1432153956":"2026-02-26T17:21:11.039698+0000","10.20.193.76:0/1754372634":"2026-02-26T17:21:11.039698+0000","10.20.193.76:0/599075350":"2026-02-26T17:21:11.039698+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T17:21:27.704 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.700+0000 7f2a0fcd1640 1 -- 10.20.193.76:0/3619699958 >> v1:10.20.193.76:6800/1563581135 conn(0x7f29d804f880 legacy=0x7f29d8051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.704 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.700+0000 7f2a0fcd1640 1 -- 10.20.193.76:0/3619699958 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2a0806eac0 msgr2=0x7f2a0812dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.704 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.700+0000 7f2a0fcd1640 1 --2- 10.20.193.76:0/3619699958 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2a0806eac0 0x7f2a0812dc10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f29fc009130 tx=0x7f29fc0047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.704 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.700+0000 7f2a0fcd1640 1 -- 10.20.193.76:0/3619699958 shutdown_connections 2026-02-25T17:21:27.704 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.700+0000 7f2a0fcd1640 1 --2- 10.20.193.76:0/3619699958 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2a08131c30 0x7f2a0812e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.704 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.700+0000 7f2a0fcd1640 1 --2- 10.20.193.76:0/3619699958 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2a0806eac0 0x7f2a0812dc10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.704 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.700+0000 7f2a0fcd1640 1 --2- 10.20.193.76:0/3619699958 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2a0806dfd0 0x7f2a0812d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.705 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.700+0000 7f2a0fcd1640 1 -- 10.20.193.76:0/3619699958 >> 10.20.193.76:0/3619699958 conn(0x7f2a0809a960 msgr2=0x7f2a0809b560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:27.705 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.700+0000 7f2a0fcd1640 1 -- 10.20.193.76:0/3619699958 shutdown_connections 2026-02-25T17:21:27.705 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.700+0000 7f2a0fcd1640 1 -- 10.20.193.76:0/3619699958 wait complete. 2026-02-25T17:21:27.711 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-25T17:21:27.711 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-25T17:21:27.712 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-25T17:21:27.713 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-25T17:21:27.783 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.780+0000 7fd92ea81640 1 Processor -- start 2026-02-25T17:21:27.784 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.780+0000 7fd92ea81640 1 -- start start 2026-02-25T17:21:27.785 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.780+0000 7f85a5fd7640 1 Processor -- start 2026-02-25T17:21:27.785 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.780+0000 7f85a5fd7640 1 -- start start 2026-02-25T17:21:27.786 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd92ea81640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fd92809d390 0x7fd928133ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.786 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd92ea81640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd92812f020 0x7fd928136020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.787 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd92ea81640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd92806d420 con 0x7fd92812e530 2026-02-25T17:21:27.787 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd92ea81640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd92809b050 con 0x7fd92809d390 2026-02-25T17:21:27.787 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd92ea81640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd92806da80 con 0x7fd92812f020 2026-02-25T17:21:27.788 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd405992640 1 Processor -- start 2026-02-25T17:21:27.788 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd405992640 1 -- start start 2026-02-25T17:21:27.789 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd92cff7640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd92812f020 0x7fd928136020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.789 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd9277fe640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fd92809d390 0x7fd928133ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.789 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7f85a5fd7640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f85a006c9a0 0x7f85a006cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.790 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd92cff7640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd92812f020 0x7fd928136020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39038/0 (socket says 10.20.193.76:39038) 2026-02-25T17:21:27.790 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd92cff7640 1 -- 10.20.193.76:0/430031682 learned_addr learned my addr 10.20.193.76:0/430031682 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:27.791 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7f85a5fd7640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f85a0133fa0 0x7f85a0136390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.792 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7f85a5fd7640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a00621a0 con 0x7f85a006d2c0 2026-02-25T17:21:27.792 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7f85a5fd7640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a00989b0 con 0x7f85a0133fa0 2026-02-25T17:21:27.792 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7f85a5fd7640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00993a0 con 0x7f85a006c9a0 2026-02-25T17:21:27.792 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7f859f7fe640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f85a006c9a0 0x7f85a006cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.792 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7f859ffff640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f85a0133fa0 0x7f85a0136390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.792 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7f859f7fe640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f85a006c9a0 0x7f85a006cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50454/0 (socket says 10.20.193.76:50454) 2026-02-25T17:21:27.793 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7f859f7fe640 1 -- 10.20.193.76:0/2731940336 learned_addr learned my addr 10.20.193.76:0/2731940336 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:27.793 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd52d438640 1 Processor -- start 2026-02-25T17:21:27.794 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd405992640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fd40006b850 0x7fd40006f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.795 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd405992640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd40006fb70 0x7fd4001362d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.795 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd405992640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40006bde0 con 0x7fd40006f760 2026-02-25T17:21:27.795 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd405992640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40009e890 con 0x7fd40006b850 2026-02-25T17:21:27.795 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd405992640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd400070480 con 0x7fd40006fb70 2026-02-25T17:21:27.796 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd92cff7640 1 -- 10.20.193.76:0/430031682 >> v2:10.20.193.76:3300/0 conn(0x7fd92809d390 msgr2=0x7fd928133ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:27.796 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd92cff7640 1 --2- 10.20.193.76:0/430031682 >> v2:10.20.193.76:3300/0 conn(0x7fd92809d390 0x7fd928133ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.796 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd92cff7640 1 -- 10.20.193.76:0/430031682 >> v1:10.20.193.76:6789/0 conn(0x7fd92812e530 legacy=0x7fd92812e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.797 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd52d438640 1 -- start start 2026-02-25T17:21:27.797 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd926ffd640 1 -- 10.20.193.76:0/430031682 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730489674 0 0) 0x7fd92806d420 con 0x7fd92812e530 2026-02-25T17:21:27.798 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd92cff7640 1 -- 10.20.193.76:0/430031682 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd928098570 con 0x7fd92812f020 2026-02-25T17:21:27.798 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd9277fe640 1 --2- 10.20.193.76:0/430031682 >> v2:10.20.193.76:3300/0 conn(0x7fd92809d390 0x7fd928133ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:27.799 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7f859f7fe640 1 -- 10.20.193.76:0/2731940336 >> v2:10.20.193.76:3300/0 conn(0x7f85a0133fa0 msgr2=0x7f85a0136390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:27.799 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7f859f7fe640 1 --2- 10.20.193.76:0/2731940336 >> v2:10.20.193.76:3300/0 conn(0x7f85a0133fa0 0x7f85a0136390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.799 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7f859f7fe640 1 -- 10.20.193.76:0/2731940336 >> v1:10.20.193.76:6789/0 conn(0x7f85a006d2c0 legacy=0x7f85a006d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.800 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd3ff7fe640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd40006fb70 0x7fd4001362d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.800 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7f859f7fe640 1 -- 10.20.193.76:0/2731940336 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a009ec50 con 0x7f85a006c9a0 2026-02-25T17:21:27.801 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd3feffd640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fd40006b850 0x7fd40006f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.801 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd3ff7fe640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd40006fb70 0x7fd4001362d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39048/0 (socket says 10.20.193.76:39048) 2026-02-25T17:21:27.801 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd3ff7fe640 1 -- 10.20.193.76:0/802879684 learned_addr learned my addr 10.20.193.76:0/802879684 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:27.801 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd3ff7fe640 1 -- 10.20.193.76:0/802879684 >> v2:10.20.193.76:3300/0 conn(0x7fd40006b850 msgr2=0x7fd40006f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:27.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd3ff7fe640 1 --2- 10.20.193.76:0/802879684 >> v2:10.20.193.76:3300/0 conn(0x7fd40006b850 0x7fd40006f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd3ff7fe640 1 -- 10.20.193.76:0/802879684 >> v1:10.20.193.76:6789/0 conn(0x7fd40006f760 legacy=0x7fd400132ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd3ff7fe640 1 -- 10.20.193.76:0/802879684 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4000708c0 con 0x7fd40006fb70 2026-02-25T17:21:27.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd52d438640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fd528097f20 0x7fd52806b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd52d438640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd528133d20 0x7fd528136110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd52d438640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52806d390 con 0x7fd52806bd90 2026-02-25T17:21:27.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd52d438640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52806e760 con 0x7fd528097f20 2026-02-25T17:21:27.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd52d438640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd528098300 con 0x7fd528133d20 2026-02-25T17:21:27.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd526ffd640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fd528097f20 0x7fd52806b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd5267fc640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7fd52806bd90 0x7fd52806c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:60900/0 (socket says 10.20.193.76:60900) 2026-02-25T17:21:27.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd5267fc640 1 -- 10.20.193.76:0/837559870 learned_addr learned my addr 10.20.193.76:0/837559870 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:27.804 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd5277fe640 1 --2- 10.20.193.76:0/837559870 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd528133d20 0x7fd528136110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.804 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.781+0000 7fd92cff7640 1 --2- 10.20.193.76:0/430031682 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd92812f020 0x7fd928136020 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd91c009e50 tx=0x7fd91c02f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66efba616dad7684 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.804 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd526ffd640 1 -- 10.20.193.76:0/837559870 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd528133d20 msgr2=0x7fd528136110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:27.805 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd526ffd640 1 --2- 10.20.193.76:0/837559870 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd528133d20 0x7fd528136110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.805 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7f859f7fe640 1 --2- 10.20.193.76:0/2731940336 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f85a006c9a0 0x7f85a006cd80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f858c0099a0 tx=0x7f858c02ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cef5d4219ebc51f server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.805 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd526ffd640 1 -- 10.20.193.76:0/837559870 >> v1:10.20.193.76:6789/0 conn(0x7fd52806bd90 legacy=0x7fd52806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.805 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd526ffd640 1 -- 10.20.193.76:0/837559870 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52809e900 con 0x7fd528097f20 2026-02-25T17:21:27.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd926ffd640 1 -- 10.20.193.76:0/430031682 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c006ea0 con 0x7fd92812f020 2026-02-25T17:21:27.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd926ffd640 1 -- 10.20.193.76:0/430031682 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91c02fcc0 con 0x7fd92812f020 2026-02-25T17:21:27.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd926ffd640 1 -- 10.20.193.76:0/430031682 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c037610 con 0x7fd92812f020 2026-02-25T17:21:27.807 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7f859e7fc640 1 -- 10.20.193.76:0/2731940336 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c02fb10 con 0x7f85a006c9a0 2026-02-25T17:21:27.807 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7f859e7fc640 1 -- 10.20.193.76:0/2731940336 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858c02fc70 con 0x7f85a006c9a0 2026-02-25T17:21:27.807 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7f859e7fc640 1 -- 10.20.193.76:0/2731940336 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c037440 con 0x7f85a006c9a0 2026-02-25T17:21:27.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd3ff7fe640 1 --2- 10.20.193.76:0/802879684 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd40006fb70 0x7fd4001362d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009e50 tx=0x7fd3f002f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d22db5c7253ec89a server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd3fdffb640 1 -- 10.20.193.76:0/802879684 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0006ea0 con 0x7fd40006fb70 2026-02-25T17:21:27.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd3fdffb640 1 -- 10.20.193.76:0/802879684 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f002fcc0 con 0x7fd40006fb70 2026-02-25T17:21:27.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd3fdffb640 1 -- 10.20.193.76:0/802879684 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0037610 con 0x7fd40006fb70 2026-02-25T17:21:27.809 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7f85a5fd7640 1 -- 10.20.193.76:0/2731940336 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f85a006c9a0 msgr2=0x7f85a006cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.809 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7f85a5fd7640 1 --2- 10.20.193.76:0/2731940336 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f85a006c9a0 0x7f85a006cd80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f858c0099a0 tx=0x7f858c02ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:27.809 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7f85a5fd7640 1 -- 10.20.193.76:0/2731940336 shutdown_connections 2026-02-25T17:21:27.809 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7f85a5fd7640 1 --2- 10.20.193.76:0/2731940336 >> v2:10.20.193.76:3300/0 conn(0x7f85a0133fa0 0x7f85a0136390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.809 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7f85a5fd7640 1 --2- 10.20.193.76:0/2731940336 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f85a006c9a0 0x7f85a006cd80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.810 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd92ea81640 1 -- 10.20.193.76:0/430031682 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd92812f020 msgr2=0x7fd928136020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.810 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd92ea81640 1 --2- 10.20.193.76:0/430031682 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd92812f020 0x7fd928136020 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd91c009e50 tx=0x7fd91c02f210 comp rx=0 tx=0).stop 2026-02-25T17:21:27.810 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd526ffd640 1 --2- 10.20.193.76:0/837559870 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd528097f20 0x7fd52806b850 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0098a0 tx=0x7fd51c02ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38431766985ef423 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.811 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7f85a5fd7640 1 -- 10.20.193.76:0/2731940336 >> 10.20.193.76:0/2731940336 conn(0x7f85a009d120 msgr2=0x7f85a009d530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:27.811 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7f85a5fd7640 1 -- 10.20.193.76:0/2731940336 shutdown_connections 2026-02-25T17:21:27.811 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd92ea81640 1 -- 10.20.193.76:0/430031682 shutdown_connections 2026-02-25T17:21:27.812 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd92ea81640 1 --2- 10.20.193.76:0/430031682 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd92812f020 0x7fd928136020 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.812 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd92ea81640 1 --2- 10.20.193.76:0/430031682 >> v2:10.20.193.76:3300/0 conn(0x7fd92809d390 0x7fd928133ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.812 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd92ea81640 1 -- 10.20.193.76:0/430031682 >> 10.20.193.76:0/430031682 conn(0x7fd92809e130 msgr2=0x7fd92809ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:27.812 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7f85a5fd7640 1 -- 10.20.193.76:0/2731940336 wait complete. 2026-02-25T17:21:27.812 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd92ea81640 1 -- 10.20.193.76:0/430031682 shutdown_connections 2026-02-25T17:21:27.813 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd405992640 1 -- 10.20.193.76:0/802879684 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd40006fb70 msgr2=0x7fd4001362d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.813 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd405992640 1 --2- 10.20.193.76:0/802879684 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd40006fb70 0x7fd4001362d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009e50 tx=0x7fd3f002f210 comp rx=0 tx=0).stop 2026-02-25T17:21:27.813 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd92ea81640 1 -- 10.20.193.76:0/430031682 wait complete. 2026-02-25T17:21:27.814 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd525ffb640 1 -- 10.20.193.76:0/837559870 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c02fa40 con 0x7fd528097f20 2026-02-25T17:21:27.814 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd405992640 1 -- 10.20.193.76:0/802879684 shutdown_connections 2026-02-25T17:21:27.814 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd405992640 1 --2- 10.20.193.76:0/802879684 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd40006fb70 0x7fd4001362d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.814 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd405992640 1 --2- 10.20.193.76:0/802879684 >> v2:10.20.193.76:3300/0 conn(0x7fd40006b850 0x7fd40006f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.814 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd405992640 1 -- 10.20.193.76:0/802879684 >> 10.20.193.76:0/802879684 conn(0x7fd40009da00 msgr2=0x7fd40009de10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:27.815 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd525ffb640 1 -- 10.20.193.76:0/837559870 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c02fba0 con 0x7fd528097f20 2026-02-25T17:21:27.815 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd525ffb640 1 -- 10.20.193.76:0/837559870 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c037440 con 0x7fd528097f20 2026-02-25T17:21:27.815 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd405992640 1 -- 10.20.193.76:0/802879684 shutdown_connections 2026-02-25T17:21:27.815 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd405992640 1 -- 10.20.193.76:0/802879684 wait complete. 2026-02-25T17:21:27.816 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd52d438640 1 -- 10.20.193.76:0/837559870 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd528097f20 msgr2=0x7fd52806b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.816 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd52d438640 1 --2- 10.20.193.76:0/837559870 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd528097f20 0x7fd52806b850 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0098a0 tx=0x7fd51c02ed80 comp rx=0 tx=0).stop 2026-02-25T17:21:27.816 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd52d438640 1 -- 10.20.193.76:0/837559870 shutdown_connections 2026-02-25T17:21:27.816 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd52d438640 1 --2- 10.20.193.76:0/837559870 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd528133d20 0x7fd528136110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.817 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd52d438640 1 --2- 10.20.193.76:0/837559870 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd528097f20 0x7fd52806b850 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.817 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd52d438640 1 -- 10.20.193.76:0/837559870 >> 10.20.193.76:0/837559870 conn(0x7fd52809db70 msgr2=0x7fd52809df80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:27.817 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.782+0000 7fd52d438640 1 -- 10.20.193.76:0/837559870 shutdown_connections 2026-02-25T17:21:27.817 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd52d438640 1 -- 10.20.193.76:0/837559870 wait complete. 2026-02-25T17:21:27.817 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd405992640 1 Processor -- start 2026-02-25T17:21:27.817 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7f85a5fd7640 1 Processor -- start 2026-02-25T17:21:27.818 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd405992640 1 -- start start 2026-02-25T17:21:27.818 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd92ea81640 1 Processor -- start 2026-02-25T17:21:27.818 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7f85a5fd7640 1 -- start start 2026-02-25T17:21:27.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd92ea81640 1 -- start start 2026-02-25T17:21:27.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd405992640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd40006b850 0x7fd400094dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd405992640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd40006f760 0x7fd400095300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd405992640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd40006fb70 0x7fd400095840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd405992640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000968b0 con 0x7fd40006b850 2026-02-25T17:21:27.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd405992640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000985b0 con 0x7fd40006fb70 2026-02-25T17:21:27.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd405992640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000993f0 con 0x7fd40006f760 2026-02-25T17:21:27.820 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd52d438640 1 Processor -- start 2026-02-25T17:21:27.820 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd3feffd640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd40006b850 0x7fd400094dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.820 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd3feffd640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd40006b850 0x7fd400094dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:35782/0 (socket says 10.20.193.76:35782) 2026-02-25T17:21:27.821 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd3feffd640 1 -- 10.20.193.76:0/1672963922 learned_addr learned my addr 10.20.193.76:0/1672963922 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:27.821 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd3fe7fc640 1 --2- 10.20.193.76:0/1672963922 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd40006f760 0x7fd400095300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.821 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd3ff7fe640 1 --2- 10.20.193.76:0/1672963922 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd40006fb70 0x7fd400095840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.821 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd52d438640 1 -- start start 2026-02-25T17:21:27.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7f85a5fd7640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f85a006c9a0 0x7f85a0132aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7f85a5fd7640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f85a006d2c0 0x7f85a0132fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7f85a5fd7640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f85a0133fa0 0x7f85a0133520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7f85a5fd7640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a0092590 con 0x7f85a006d2c0 2026-02-25T17:21:27.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7f85a5fd7640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00928a0 con 0x7f85a0133fa0 2026-02-25T17:21:27.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7f85a5fd7640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85a0090ba0 con 0x7f85a006c9a0 2026-02-25T17:21:27.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd92ea81640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd92809d390 0x7fd9281278a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd92ea81640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd92812e530 0x7fd928127de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.822 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd92ea81640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd92812f020 0x7fd928128320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.823 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7f859ffff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f85a0133fa0 0x7f85a0133520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.823 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd92ea81640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd928129330 con 0x7fd92809d390 2026-02-25T17:21:27.823 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd92ea81640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd92809b270 con 0x7fd92812f020 2026-02-25T17:21:27.823 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd92ea81640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd92812a480 con 0x7fd92812e530 2026-02-25T17:21:27.823 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7f859ffff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f85a0133fa0 0x7f85a0133520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50496/0 (socket says 10.20.193.76:50496) 2026-02-25T17:21:27.823 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7f859ffff640 1 -- 10.20.193.76:0/3294393183 learned_addr learned my addr 10.20.193.76:0/3294393183 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:27.824 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd3ff7fe640 1 -- 10.20.193.76:0/1672963922 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd40006f760 msgr2=0x7fd400095300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.824 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd3ff7fe640 1 --2- 10.20.193.76:0/1672963922 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd40006f760 0x7fd400095300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.824 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd3ff7fe640 1 -- 10.20.193.76:0/1672963922 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd40006b850 msgr2=0x7fd400094dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.824 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd3ff7fe640 1 --2- 10.20.193.76:0/1672963922 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd40006b850 0x7fd400094dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.824 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd3ff7fe640 1 -- 10.20.193.76:0/1672963922 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f0009b30 con 0x7fd40006fb70 2026-02-25T17:21:27.824 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7f859f7fe640 1 --2- 10.20.193.76:0/3294393183 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f85a006c9a0 0x7f85a0132aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.825 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd3fe7fc640 1 --2- 10.20.193.76:0/1672963922 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd40006f760 0x7fd400095300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:27.825 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd3feffd640 1 --2- 10.20.193.76:0/1672963922 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd40006b850 0x7fd400094dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:27.825 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd92cff7640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd92812f020 0x7fd928128320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.825 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd52d438640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd52806bd90 0x7fd528096040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.825 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd52d438640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd528097f20 0x7fd528096580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.826 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd92cff7640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd92812f020 0x7fd928128320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50508/0 (socket says 10.20.193.76:50508) 2026-02-25T17:21:27.826 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd52d438640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd528133d20 0x7fd528096ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.826 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd52d438640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd528123e90 con 0x7fd528133d20 2026-02-25T17:21:27.826 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd52d438640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd528124670 con 0x7fd528097f20 2026-02-25T17:21:27.826 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd92cff7640 1 -- 10.20.193.76:0/258710424 learned_addr learned my addr 10.20.193.76:0/258710424 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:27.826 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd52d438640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd528124a40 con 0x7fd52806bd90 2026-02-25T17:21:27.827 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7f859effd640 1 --2- 10.20.193.76:0/3294393183 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f85a006d2c0 0x7f85a0132fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.827 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd9277fe640 1 --2- 10.20.193.76:0/258710424 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd92812e530 0x7fd928127de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.827 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd927fff640 1 --2- 10.20.193.76:0/258710424 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd92809d390 0x7fd9281278a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.827 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd526ffd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd52806bd90 0x7fd528096040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.827 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd5277fe640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd528133d20 0x7fd528096ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.828 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd526ffd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd52806bd90 0x7fd528096040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39080/0 (socket says 10.20.193.76:39080) 2026-02-25T17:21:27.828 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd526ffd640 1 -- 10.20.193.76:0/4070229291 learned_addr learned my addr 10.20.193.76:0/4070229291 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:27.828 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd5277fe640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd528133d20 0x7fd528096ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:35810/0 (socket says 10.20.193.76:35810) 2026-02-25T17:21:27.828 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd3ff7fe640 1 --2- 10.20.193.76:0/1672963922 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd40006fb70 0x7fd400095840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0035000 tx=0x7fd3f0004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.828 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7f859ffff640 1 -- 10.20.193.76:0/3294393183 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f85a006c9a0 msgr2=0x7f85a0132aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.828 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7f859ffff640 1 --2- 10.20.193.76:0/3294393183 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f85a006c9a0 0x7f85a0132aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.828 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd5267fc640 1 --2- 10.20.193.76:0/4070229291 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd528097f20 0x7fd528096580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.829 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7f859ffff640 1 -- 10.20.193.76:0/3294393183 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f85a006d2c0 msgr2=0x7f85a0132fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.829 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7f859ffff640 1 --2- 10.20.193.76:0/3294393183 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f85a006d2c0 0x7f85a0132fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.829 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7f859ffff640 1 -- 10.20.193.76:0/3294393183 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c0095d0 con 0x7f85a0133fa0 2026-02-25T17:21:27.829 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7f859effd640 1 --2- 10.20.193.76:0/3294393183 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f85a006d2c0 0x7f85a0132fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-25T17:21:27.829 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7f859ffff640 1 --2- 10.20.193.76:0/3294393183 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f85a0133fa0 0x7f85a0133520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f859400efc0 tx=0x7f859400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.829 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd92cff7640 1 -- 10.20.193.76:0/258710424 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd92812e530 msgr2=0x7fd928127de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.829 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd5277fe640 1 -- 10.20.193.76:0/4070229291 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd52806bd90 msgr2=0x7fd528096040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.830 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd5277fe640 1 --2- 10.20.193.76:0/4070229291 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd52806bd90 0x7fd528096040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.830 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.783+0000 7fd92cff7640 1 --2- 10.20.193.76:0/258710424 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd92812e530 0x7fd928127de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.830 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd92cff7640 1 -- 10.20.193.76:0/258710424 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd92809d390 msgr2=0x7fd9281278a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.830 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd92cff7640 1 --2- 10.20.193.76:0/258710424 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd92809d390 0x7fd9281278a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.831 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd5277fe640 1 -- 10.20.193.76:0/4070229291 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd528097f20 msgr2=0x7fd528096580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.831 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd5277fe640 1 --2- 10.20.193.76:0/4070229291 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd528097f20 0x7fd528096580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.831 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd92cff7640 1 -- 10.20.193.76:0/258710424 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd918009500 con 0x7fd92812f020 2026-02-25T17:21:27.832 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd5277fe640 1 -- 10.20.193.76:0/4070229291 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c009500 con 0x7fd528133d20 2026-02-25T17:21:27.832 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd526ffd640 1 --2- 10.20.193.76:0/4070229291 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd52806bd90 0x7fd528096040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:27.832 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd3d7fff640 1 -- 10.20.193.76:0/1672963922 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0006ea0 con 0x7fd40006fb70 2026-02-25T17:21:27.832 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd405992640 1 -- 10.20.193.76:0/1672963922 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40006c710 con 0x7fd40006fb70 2026-02-25T17:21:27.832 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7f857bfff640 1 -- 10.20.193.76:0/3294393183 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8594006ea0 con 0x7f85a0133fa0 2026-02-25T17:21:27.833 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd5277fe640 1 --2- 10.20.193.76:0/4070229291 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd528133d20 0x7fd528096ac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd51800ef90 tx=0x7fd51800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.833 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7f857bfff640 1 -- 10.20.193.76:0/3294393183 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859400f040 con 0x7f85a0133fa0 2026-02-25T17:21:27.833 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd405992640 1 -- 10.20.193.76:0/1672963922 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd400097d90 con 0x7fd40006fb70 2026-02-25T17:21:27.833 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7f85a5fd7640 1 -- 10.20.193.76:0/3294393183 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a0133a60 con 0x7f85a0133fa0 2026-02-25T17:21:27.833 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7f857bfff640 1 -- 10.20.193.76:0/3294393183 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85940146c0 con 0x7f85a0133fa0 2026-02-25T17:21:27.834 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd3d7fff640 1 -- 10.20.193.76:0/1672963922 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f002fac0 con 0x7fd40006fb70 2026-02-25T17:21:27.834 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd3d7fff640 1 -- 10.20.193.76:0/1672963922 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0041860 con 0x7fd40006fb70 2026-02-25T17:21:27.834 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd92cff7640 1 --2- 10.20.193.76:0/258710424 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd92812f020 0x7fd928128320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd91c039040 tx=0x7fd91c004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.834 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd5077fe640 1 -- 10.20.193.76:0/4070229291 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518006ea0 con 0x7fd528133d20 2026-02-25T17:21:27.834 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7f85a5fd7640 1 -- 10.20.193.76:0/3294393183 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a0091cf0 con 0x7f85a0133fa0 2026-02-25T17:21:27.835 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd5077fe640 1 -- 10.20.193.76:0/4070229291 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51800f040 con 0x7fd528133d20 2026-02-25T17:21:27.835 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd52d438640 1 -- 10.20.193.76:0/4070229291 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5281235e0 con 0x7fd528133d20 2026-02-25T17:21:27.835 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd5077fe640 1 -- 10.20.193.76:0/4070229291 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5180146c0 con 0x7fd528133d20 2026-02-25T17:21:27.835 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd52d438640 1 -- 10.20.193.76:0/4070229291 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd528133880 con 0x7fd528133d20 2026-02-25T17:21:27.835 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd405992640 1 -- 10.20.193.76:0/1672963922 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd40006c590 con 0x7fd40006fb70 2026-02-25T17:21:27.835 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7f85a5fd7640 1 -- 10.20.193.76:0/3294393183 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f85a009a8c0 con 0x7f85a0133fa0 2026-02-25T17:21:27.835 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd52d438640 1 -- 10.20.193.76:0/4070229291 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd52806b850 con 0x7fd528133d20 2026-02-25T17:21:27.836 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd924ff9640 1 -- 10.20.193.76:0/258710424 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c006ea0 con 0x7fd92812f020 2026-02-25T17:21:27.836 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd924ff9640 1 -- 10.20.193.76:0/258710424 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91c02fac0 con 0x7fd92812f020 2026-02-25T17:21:27.836 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd92ea81640 1 -- 10.20.193.76:0/258710424 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91c009b30 con 0x7fd92812f020 2026-02-25T17:21:27.836 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd924ff9640 1 -- 10.20.193.76:0/258710424 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c0418a0 con 0x7fd92812f020 2026-02-25T17:21:27.836 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd92ea81640 1 -- 10.20.193.76:0/258710424 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd928129c30 con 0x7fd92812f020 2026-02-25T17:21:27.836 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd5077fe640 1 -- 10.20.193.76:0/4070229291 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fd518024020 con 0x7fd528133d20 2026-02-25T17:21:27.836 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.784+0000 7fd3d7fff640 1 -- 10.20.193.76:0/1672963922 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fd3f0052060 con 0x7fd40006fb70 2026-02-25T17:21:27.836 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.785+0000 7f857bfff640 1 -- 10.20.193.76:0/3294393183 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f8594024020 con 0x7f85a0133fa0 2026-02-25T17:21:27.837 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.785+0000 7fd92ea81640 1 -- 10.20.193.76:0/258710424 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd9280a0c90 con 0x7fd92812f020 2026-02-25T17:21:27.837 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.785+0000 7fd5077fe640 1 -- 10.20.193.76:0/4070229291 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7fd518067b50 con 0x7fd528133d20 2026-02-25T17:21:27.837 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.785+0000 7fd5077fe640 1 -- 10.20.193.76:0/4070229291 --> v1:10.20.193.76:6805/1645506709 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4f4059ae0 con 0x7fd4f4055e30 2026-02-25T17:21:27.837 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.785+0000 7fd3d7fff640 1 -- 10.20.193.76:0/1672963922 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7fd3f008c710 con 0x7fd40006fb70 2026-02-25T17:21:27.837 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.785+0000 7fd5077fe640 1 -- 10.20.193.76:0/4070229291 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd518067fa0 con 0x7fd528133d20 2026-02-25T17:21:27.837 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.785+0000 7fd3d7fff640 1 -- 10.20.193.76:0/1672963922 --> v1:10.20.193.76:6801/3531107996 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd3d0059ae0 con 0x7fd3d0055e30 2026-02-25T17:21:27.838 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.785+0000 7fd3d7fff640 1 -- 10.20.193.76:0/1672963922 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3f008cb60 con 0x7fd40006fb70 2026-02-25T17:21:27.838 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.785+0000 7fd924ff9640 1 -- 10.20.193.76:0/258710424 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fd91c052020 con 0x7fd92812f020 2026-02-25T17:21:27.838 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.785+0000 7f857bfff640 1 -- 10.20.193.76:0/3294393183 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7f8594067cf0 con 0x7f85a0133fa0 2026-02-25T17:21:27.838 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.785+0000 7f857bfff640 1 -- 10.20.193.76:0/3294393183 --> v1:10.20.193.76:6809/1923901808 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8570059ae0 con 0x7f8570055e30 2026-02-25T17:21:27.838 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.785+0000 7f857bfff640 1 -- 10.20.193.76:0/3294393183 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8594068140 con 0x7f85a0133fa0 2026-02-25T17:21:27.838 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.785+0000 7fd924ff9640 1 -- 10.20.193.76:0/258710424 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7fd91c08c4a0 con 0x7fd92812f020 2026-02-25T17:21:27.838 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.785+0000 7fd924ff9640 1 -- 10.20.193.76:0/258710424 --> v1:10.20.193.76:6813/39660203 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8f8059ae0 con 0x7fd8f8055e30 2026-02-25T17:21:27.838 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.785+0000 7fd924ff9640 1 -- 10.20.193.76:0/258710424 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd91c08eac0 con 0x7fd92812f020 2026-02-25T17:21:27.839 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.785+0000 7fd5077fe640 1 -- 10.20.193.76:0/4070229291 <== osd.0 v1:10.20.193.76:6805/1645506709 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26930 (unknown 0 0 1052135439) 0x7fd4f4059ae0 con 0x7fd4f4055e30 2026-02-25T17:21:27.839 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.786+0000 7fd3d7fff640 1 -- 10.20.193.76:0/1672963922 <== osd.2 v1:10.20.193.76:6801/3531107996 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26930 (unknown 0 0 1052135439) 0x7fd3d0059ae0 con 0x7fd3d0055e30 2026-02-25T17:21:27.839 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.786+0000 7f857bfff640 1 -- 10.20.193.76:0/3294393183 <== osd.1 v1:10.20.193.76:6809/1923901808 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26930 (unknown 0 0 1052135439) 0x7f8570059ae0 con 0x7f8570055e30 2026-02-25T17:21:27.839 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.786+0000 7fd924ff9640 1 -- 10.20.193.76:0/258710424 <== osd.3 v1:10.20.193.76:6813/39660203 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26930 (unknown 0 0 1052135439) 0x7fd8f8059ae0 con 0x7fd8f8055e30 2026-02-25T17:21:27.839 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7fd52d438640 1 -- 10.20.193.76:0/4070229291 --> v1:10.20.193.76:6805/1645506709 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd528136890 con 0x7fd4f4055e30 2026-02-25T17:21:27.839 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7fd5077fe640 1 -- 10.20.193.76:0/4070229291 <== osd.0 v1:10.20.193.76:6805/1645506709 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1833828785) 0x7fd528136890 con 0x7fd4f4055e30 2026-02-25T17:21:27.840 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7fd52d438640 1 -- 10.20.193.76:0/4070229291 >> v1:10.20.193.76:6805/1645506709 conn(0x7fd4f4055e30 legacy=0x7fd4f4058270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.840 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7fd52d438640 1 -- 10.20.193.76:0/4070229291 >> v1:10.20.193.76:6800/1563581135 conn(0x7fd4f404f880 legacy=0x7fd4f4051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.840 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7fd52d438640 1 -- 10.20.193.76:0/4070229291 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd528133d20 msgr2=0x7fd528096ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.840 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7fd52d438640 1 --2- 10.20.193.76:0/4070229291 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd528133d20 0x7fd528096ac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd51800ef90 tx=0x7fd51800c490 comp rx=0 tx=0).stop 2026-02-25T17:21:27.840 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7f85a5fd7640 1 -- 10.20.193.76:0/3294393183 --> v1:10.20.193.76:6809/1923901808 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f85a0071a30 con 0x7f8570055e30 2026-02-25T17:21:27.841 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7fd5277fe640 1 -- 10.20.193.76:0/4070229291 reap_dead start 2026-02-25T17:21:27.841 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7fd52d438640 1 -- 10.20.193.76:0/4070229291 shutdown_connections 2026-02-25T17:21:27.841 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7fd52d438640 1 -- 10.20.193.76:0/4070229291 >> 10.20.193.76:0/4070229291 conn(0x7fd52809db70 msgr2=0x7fd52809aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:27.841 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7fd52d438640 1 -- 10.20.193.76:0/4070229291 shutdown_connections 2026-02-25T17:21:27.841 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7fd52d438640 1 -- 10.20.193.76:0/4070229291 wait complete. 2026-02-25T17:21:27.841 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7f857bfff640 1 -- 10.20.193.76:0/3294393183 <== osd.1 v1:10.20.193.76:6809/1923901808 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1793987854) 0x7f85a0071a30 con 0x7f8570055e30 2026-02-25T17:21:27.841 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7fd92ea81640 1 -- 10.20.193.76:0/258710424 --> v1:10.20.193.76:6813/39660203 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd92812e910 con 0x7fd8f8055e30 2026-02-25T17:21:27.841 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7fd405992640 1 -- 10.20.193.76:0/1672963922 --> v1:10.20.193.76:6801/3531107996 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd400095fc0 con 0x7fd3d0055e30 2026-02-25T17:21:27.842 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7f85a5fd7640 1 -- 10.20.193.76:0/3294393183 >> v1:10.20.193.76:6809/1923901808 conn(0x7f8570055e30 legacy=0x7f8570058270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.842 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7f85a5fd7640 1 -- 10.20.193.76:0/3294393183 >> v1:10.20.193.76:6800/1563581135 conn(0x7f857004f880 legacy=0x7f8570051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.842 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7f85a5fd7640 1 -- 10.20.193.76:0/3294393183 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f85a0133fa0 msgr2=0x7f85a0133520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.842 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7f85a5fd7640 1 --2- 10.20.193.76:0/3294393183 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f85a0133fa0 0x7f85a0133520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f859400efc0 tx=0x7f859400c490 comp rx=0 tx=0).stop 2026-02-25T17:21:27.842 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7fd924ff9640 1 -- 10.20.193.76:0/258710424 <== osd.3 v1:10.20.193.76:6813/39660203 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 4081650579) 0x7fd92812e910 con 0x7fd8f8055e30 2026-02-25T17:21:27.842 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.792+0000 7f859ffff640 1 -- 10.20.193.76:0/3294393183 reap_dead start 2026-02-25T17:21:27.842 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7fd3d7fff640 1 -- 10.20.193.76:0/1672963922 <== osd.2 v1:10.20.193.76:6801/3531107996 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 1720373281) 0x7fd400095fc0 con 0x7fd3d0055e30 2026-02-25T17:21:27.843 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7f85a5fd7640 1 -- 10.20.193.76:0/3294393183 shutdown_connections 2026-02-25T17:21:27.843 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7f85a5fd7640 1 -- 10.20.193.76:0/3294393183 >> 10.20.193.76:0/3294393183 conn(0x7f85a009d120 msgr2=0x7f85a00710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:27.843 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7f85a5fd7640 1 -- 10.20.193.76:0/3294393183 shutdown_connections 2026-02-25T17:21:27.843 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7f85a5fd7640 1 -- 10.20.193.76:0/3294393183 wait complete. 2026-02-25T17:21:27.843 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7fd92ea81640 1 -- 10.20.193.76:0/258710424 >> v1:10.20.193.76:6813/39660203 conn(0x7fd8f8055e30 legacy=0x7fd8f8058270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.843 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7fd92ea81640 1 -- 10.20.193.76:0/258710424 >> v1:10.20.193.76:6800/1563581135 conn(0x7fd8f804f880 legacy=0x7fd8f8051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.843 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7fd405992640 1 -- 10.20.193.76:0/1672963922 >> v1:10.20.193.76:6801/3531107996 conn(0x7fd3d0055e30 legacy=0x7fd3d0058270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.844 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7fd92ea81640 1 -- 10.20.193.76:0/258710424 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd92812f020 msgr2=0x7fd928128320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.844 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7fd92ea81640 1 --2- 10.20.193.76:0/258710424 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd92812f020 0x7fd928128320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd91c039040 tx=0x7fd91c004b40 comp rx=0 tx=0).stop 2026-02-25T17:21:27.844 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7fd92cff7640 1 -- 10.20.193.76:0/258710424 reap_dead start 2026-02-25T17:21:27.844 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7fd405992640 1 -- 10.20.193.76:0/1672963922 >> v1:10.20.193.76:6800/1563581135 conn(0x7fd3d004f880 legacy=0x7fd3d0051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.844 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7fd405992640 1 -- 10.20.193.76:0/1672963922 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd40006fb70 msgr2=0x7fd400095840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.844 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7fd405992640 1 --2- 10.20.193.76:0/1672963922 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd40006fb70 0x7fd400095840 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0035000 tx=0x7fd3f0004b40 comp rx=0 tx=0).stop 2026-02-25T17:21:27.844 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7fd92ea81640 1 -- 10.20.193.76:0/258710424 shutdown_connections 2026-02-25T17:21:27.844 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7fd92ea81640 1 -- 10.20.193.76:0/258710424 >> 10.20.193.76:0/258710424 conn(0x7fd92809e130 msgr2=0x7fd92809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:27.844 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7fd3ff7fe640 1 -- 10.20.193.76:0/1672963922 reap_dead start 2026-02-25T17:21:27.845 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7fd92ea81640 1 -- 10.20.193.76:0/258710424 shutdown_connections 2026-02-25T17:21:27.845 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7fd92ea81640 1 -- 10.20.193.76:0/258710424 wait complete. 2026-02-25T17:21:27.845 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7fd405992640 1 -- 10.20.193.76:0/1672963922 shutdown_connections 2026-02-25T17:21:27.845 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7fd405992640 1 -- 10.20.193.76:0/1672963922 >> 10.20.193.76:0/1672963922 conn(0x7fd40009da00 msgr2=0x7fd40006d210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:27.845 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7fd405992640 1 -- 10.20.193.76:0/1672963922 shutdown_connections 2026-02-25T17:21:27.845 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.793+0000 7fd405992640 1 -- 10.20.193.76:0/1672963922 wait complete. 2026-02-25T17:21:27.846 INFO:teuthology.orchestra.run.trial076.stdout:103079215107 2026-02-25T17:21:27.846 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-25T17:21:27.846 INFO:teuthology.orchestra.run.trial076.stdout:94489280515 2026-02-25T17:21:27.846 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-25T17:21:27.847 INFO:teuthology.orchestra.run.trial076.stdout:98784247811 2026-02-25T17:21:27.847 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-25T17:21:27.847 INFO:teuthology.orchestra.run.trial076.stdout:107374182403 2026-02-25T17:21:27.848 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-25T17:21:27.955 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fee9c065640 1 Processor -- start 2026-02-25T17:21:27.956 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fee9c065640 1 -- start start 2026-02-25T17:21:27.956 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fe5444d5640 1 Processor -- start 2026-02-25T17:21:27.956 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fe5444d5640 1 -- start start 2026-02-25T17:21:27.957 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fee9c065640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fee9412b080 0x7fee9412b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.957 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fee9c065640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fee9412b9a0 0x7fee94098470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.957 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fee9c065640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee940719c0 con 0x7fee940989b0 2026-02-25T17:21:27.957 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fee9c065640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9406e580 con 0x7fee9412b080 2026-02-25T17:21:27.957 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fee9c065640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee9406e2a0 con 0x7fee9412b9a0 2026-02-25T17:21:27.958 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fb5d2b27640 1 Processor -- start 2026-02-25T17:21:27.958 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fee99dda640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fee9412b080 0x7fee9412b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.958 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fee995d9640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fee9412b9a0 0x7fee94098470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.958 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fee9a5db640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7fee940989b0 0x7fee94098e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:60908/0 (socket says 10.20.193.76:60908) 2026-02-25T17:21:27.959 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fee9a5db640 1 -- 10.20.193.76:0/4008109005 learned_addr learned my addr 10.20.193.76:0/4008109005 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:27.959 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fb5d2b27640 1 -- start start 2026-02-25T17:21:27.959 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fe5444d5640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fe53c12b080 0x7fe53c12b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.960 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fe5444d5640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe53c12b9a0 0x7fe53c098470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.960 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fe5444d5640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53c0719c0 con 0x7fe53c0989b0 2026-02-25T17:21:27.960 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fe5444d5640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53c06e2a0 con 0x7fe53c12b080 2026-02-25T17:21:27.960 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fee98dd8640 1 -- 10.20.193.76:0/4008109005 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160082795 0 0) 0x7fee940719c0 con 0x7fee940989b0 2026-02-25T17:21:27.960 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fee99dda640 1 -- 10.20.193.76:0/4008109005 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fee9412b9a0 msgr2=0x7fee94098470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:27.960 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fee99dda640 1 --2- 10.20.193.76:0/4008109005 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fee9412b9a0 0x7fee94098470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.960 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fe5444d5640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c09d9a0 con 0x7fe53c12b9a0 2026-02-25T17:21:27.961 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fee99dda640 1 -- 10.20.193.76:0/4008109005 >> v1:10.20.193.76:6789/0 conn(0x7fee940989b0 legacy=0x7fee94098e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.961 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fee99dda640 1 -- 10.20.193.76:0/4008109005 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9409d9a0 con 0x7fee9412b080 2026-02-25T17:21:27.962 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fe54224a640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fe53c12b080 0x7fe53c12b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.962 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fe54224a640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fe53c12b080 0x7fe53c12b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:35826/0 (socket says 10.20.193.76:35826) 2026-02-25T17:21:27.962 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fe54224a640 1 -- 10.20.193.76:0/591479124 learned_addr learned my addr 10.20.193.76:0/591479124 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:27.962 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fe542a4b640 1 --1- 10.20.193.76:0/591479124 >> v1:10.20.193.76:6789/0 conn(0x7fe53c0989b0 0x7fe53c098e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:60916/0 (socket says 10.20.193.76:60916) 2026-02-25T17:21:27.962 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fe541a49640 1 --2- 10.20.193.76:0/591479124 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe53c12b9a0 0x7fe53c098470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fb5d2b27640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb5cc06cb80 0x7fb5cc06cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fb5d2b27640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb5cc12e9f0 0x7fb5cc12ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fb5d2b27640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5cc06ea00 con 0x7fb5cc06d4a0 2026-02-25T17:21:27.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fb5d2b27640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc069c00 con 0x7fb5cc06cb80 2026-02-25T17:21:27.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fb5d2b27640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc06d8e0 con 0x7fb5cc12e9f0 2026-02-25T17:21:27.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fb5d089c640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb5cc06cb80 0x7fb5cc06cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fb5c3fff640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7fb5cc06d4a0 0x7fb5cc12e2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:60932/0 (socket says 10.20.193.76:60932) 2026-02-25T17:21:27.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fb5d109d640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb5cc12e9f0 0x7fb5cc12ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fb5d089c640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb5cc06cb80 0x7fb5cc06cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50540/0 (socket says 10.20.193.76:50540) 2026-02-25T17:21:27.963 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fb5c3fff640 1 -- 10.20.193.76:0/3911961164 learned_addr learned my addr 10.20.193.76:0/3911961164 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:27.964 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fe54224a640 1 -- 10.20.193.76:0/591479124 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe53c12b9a0 msgr2=0x7fe53c098470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:27.964 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fe54224a640 1 --2- 10.20.193.76:0/591479124 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe53c12b9a0 0x7fe53c098470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.964 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fe54224a640 1 -- 10.20.193.76:0/591479124 >> v1:10.20.193.76:6789/0 conn(0x7fe53c0989b0 legacy=0x7fe53c098e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.964 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fe54224a640 1 -- 10.20.193.76:0/591479124 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53c0611c0 con 0x7fe53c12b080 2026-02-25T17:21:27.964 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fe541248640 1 -- 10.20.193.76:0/591479124 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036970445 0 0) 0x7fe53c0719c0 con 0x7fe53c0989b0 2026-02-25T17:21:27.964 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fe541a49640 1 --2- 10.20.193.76:0/591479124 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe53c12b9a0 0x7fe53c098470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:27.965 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.953+0000 7fb5c37fe640 1 -- 10.20.193.76:0/3911961164 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1087919561 0 0) 0x7fb5cc06ea00 con 0x7fb5cc06d4a0 2026-02-25T17:21:27.965 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fb5c37fe640 1 -- 10.20.193.76:0/3911961164 --> v1:10.20.193.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5b8003620 con 0x7fb5cc06d4a0 2026-02-25T17:21:27.965 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fb5d109d640 1 -- 10.20.193.76:0/3911961164 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb5cc06cb80 msgr2=0x7fb5cc06cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:27.965 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fb5d109d640 1 --2- 10.20.193.76:0/3911961164 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb5cc06cb80 0x7fb5cc06cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.965 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fb5d109d640 1 -- 10.20.193.76:0/3911961164 >> v1:10.20.193.76:6789/0 conn(0x7fb5cc06d4a0 legacy=0x7fb5cc12e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.965 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fb5d109d640 1 -- 10.20.193.76:0/3911961164 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc08c600 con 0x7fb5cc12e9f0 2026-02-25T17:21:27.965 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fb5d089c640 1 --2- 10.20.193.76:0/3911961164 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb5cc06cb80 0x7fb5cc06cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:27.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fee99dda640 1 --2- 10.20.193.76:0/4008109005 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fee9412b080 0x7fee9412b460 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fee840098d0 tx=0x7fee8402edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1fc3ee0071a971a server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7f4180c86640 1 Processor -- start 2026-02-25T17:21:27.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7f4180c86640 1 -- start start 2026-02-25T17:21:27.966 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fee98dd8640 1 -- 10.20.193.76:0/4008109005 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8402fa30 con 0x7fee9412b080 2026-02-25T17:21:27.967 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fe54224a640 1 --2- 10.20.193.76:0/591479124 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe53c12b080 0x7fe53c12b460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009970 tx=0x7fe52c02ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68af6491832b3a2f server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.967 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fee98dd8640 1 -- 10.20.193.76:0/4008109005 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8402fb90 con 0x7fee9412b080 2026-02-25T17:21:27.967 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fee98dd8640 1 -- 10.20.193.76:0/4008109005 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee84037440 con 0x7fee9412b080 2026-02-25T17:21:27.968 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fe541248640 1 -- 10.20.193.76:0/591479124 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c02fb10 con 0x7fe53c12b080 2026-02-25T17:21:27.968 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fe541248640 1 -- 10.20.193.76:0/591479124 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c02fc70 con 0x7fe53c12b080 2026-02-25T17:21:27.968 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fe541248640 1 -- 10.20.193.76:0/591479124 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c037440 con 0x7fe53c12b080 2026-02-25T17:21:27.968 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fb5d109d640 1 --2- 10.20.193.76:0/3911961164 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb5cc12e9f0 0x7fb5cc12ee60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009dc0 tx=0x7fb5c802f180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5eab45c28236196d server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.968 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fee9c065640 1 -- 10.20.193.76:0/4008109005 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fee9412b080 msgr2=0x7fee9412b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.968 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fee9c065640 1 --2- 10.20.193.76:0/4008109005 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fee9412b080 0x7fee9412b460 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fee840098d0 tx=0x7fee8402edc0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.969 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7f4180c86640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f417c098ce0 0x7f417c06c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.969 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7f4180c86640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f417c06cee0 0x7f417c06d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.969 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fee9c065640 1 -- 10.20.193.76:0/4008109005 shutdown_connections 2026-02-25T17:21:27.969 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fee9c065640 1 --2- 10.20.193.76:0/4008109005 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fee9412b9a0 0x7fee94098470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.969 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fee9c065640 1 --2- 10.20.193.76:0/4008109005 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fee9412b080 0x7fee9412b460 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.970 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7f4180c86640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f417c06d820 0x7f417c135010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.970 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fee9c065640 1 -- 10.20.193.76:0/4008109005 >> 10.20.193.76:0/4008109005 conn(0x7fee9409a960 msgr2=0x7fee9409ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:27.970 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7f4180c86640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417c061410 con 0x7f417c06cee0 2026-02-25T17:21:27.970 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7f4180c86640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417c09eb80 con 0x7f417c06d820 2026-02-25T17:21:27.971 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7f4180c86640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f417c06e140 con 0x7f417c098ce0 2026-02-25T17:21:27.971 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fee9c065640 1 -- 10.20.193.76:0/4008109005 shutdown_connections 2026-02-25T17:21:27.971 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fb5c37fe640 1 -- 10.20.193.76:0/3911961164 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8006ea0 con 0x7fb5cc12e9f0 2026-02-25T17:21:27.971 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fee9c065640 1 -- 10.20.193.76:0/4008109005 wait complete. 2026-02-25T17:21:27.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fb5c37fe640 1 -- 10.20.193.76:0/3911961164 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c802fdf0 con 0x7fb5cc12e9f0 2026-02-25T17:21:27.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fb5c37fe640 1 -- 10.20.193.76:0/3911961164 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8037640 con 0x7fb5cc12e9f0 2026-02-25T17:21:27.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7f417a575640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f417c098ce0 0x7f417c06c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7f4179d74640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f417c06cee0 0x7f417c06d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7f417ad76640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f417c06d820 0x7f417c135010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7f417a575640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f417c098ce0 0x7f417c06c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39106/0 (socket says 10.20.193.76:39106) 2026-02-25T17:21:27.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7f417a575640 1 -- 10.20.193.76:0/4009514280 learned_addr learned my addr 10.20.193.76:0/4009514280 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:27.973 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7f4179d74640 1 --2- 10.20.193.76:0/4009514280 >> v2:10.20.193.76:3300/0 conn(0x7f417c06cee0 0x7f417c06d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:35838/0 (socket says 10.20.193.76:35838) 2026-02-25T17:21:27.973 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fe5444d5640 1 -- 10.20.193.76:0/591479124 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe53c12b080 msgr2=0x7fe53c12b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.973 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fe5444d5640 1 --2- 10.20.193.76:0/591479124 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe53c12b080 0x7fe53c12b460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009970 tx=0x7fe52c02ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:27.973 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fe5444d5640 1 -- 10.20.193.76:0/591479124 shutdown_connections 2026-02-25T17:21:27.973 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fe5444d5640 1 --2- 10.20.193.76:0/591479124 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe53c12b9a0 0x7fe53c098470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.973 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fe5444d5640 1 --2- 10.20.193.76:0/591479124 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe53c12b080 0x7fe53c12b460 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.973 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fe5444d5640 1 -- 10.20.193.76:0/591479124 >> 10.20.193.76:0/591479124 conn(0x7fe53c09a960 msgr2=0x7fe53c09ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:27.974 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7f417a575640 1 -- 10.20.193.76:0/4009514280 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f417c06d820 msgr2=0x7f417c135010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:27.974 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7f417a575640 1 --2- 10.20.193.76:0/4009514280 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f417c06d820 0x7f417c135010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.974 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7f417a575640 1 -- 10.20.193.76:0/4009514280 >> v2:10.20.193.76:3300/0 conn(0x7f417c06cee0 msgr2=0x7f417c06d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:27.974 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7f417a575640 1 --2- 10.20.193.76:0/4009514280 >> v2:10.20.193.76:3300/0 conn(0x7f417c06cee0 0x7f417c06d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.974 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7f417a575640 1 -- 10.20.193.76:0/4009514280 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c06dcb0 con 0x7f417c098ce0 2026-02-25T17:21:27.974 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fe5444d5640 1 -- 10.20.193.76:0/591479124 shutdown_connections 2026-02-25T17:21:27.974 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fe5444d5640 1 -- 10.20.193.76:0/591479124 wait complete. 2026-02-25T17:21:27.975 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fb5d2b27640 1 -- 10.20.193.76:0/3911961164 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb5cc12e9f0 msgr2=0x7fb5cc12ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.975 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fb5d2b27640 1 --2- 10.20.193.76:0/3911961164 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb5cc12e9f0 0x7fb5cc12ee60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009dc0 tx=0x7fb5c802f180 comp rx=0 tx=0).stop 2026-02-25T17:21:27.975 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fb5d2b27640 1 -- 10.20.193.76:0/3911961164 shutdown_connections 2026-02-25T17:21:27.975 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fb5d2b27640 1 --2- 10.20.193.76:0/3911961164 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb5cc12e9f0 0x7fb5cc12ee60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.975 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fb5d2b27640 1 --2- 10.20.193.76:0/3911961164 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb5cc06cb80 0x7fb5cc06cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.975 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fb5d2b27640 1 -- 10.20.193.76:0/3911961164 >> 10.20.193.76:0/3911961164 conn(0x7fb5cc09eb10 msgr2=0x7fb5cc09ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:27.976 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.954+0000 7fb5d2b27640 1 -- 10.20.193.76:0/3911961164 shutdown_connections 2026-02-25T17:21:27.976 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fb5d2b27640 1 -- 10.20.193.76:0/3911961164 wait complete. 2026-02-25T17:21:27.976 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee9c065640 1 Processor -- start 2026-02-25T17:21:27.976 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee9c065640 1 -- start start 2026-02-25T17:21:27.976 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7f417a575640 1 --2- 10.20.193.76:0/4009514280 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f417c098ce0 0x7f417c06c9a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f41700099a0 tx=0x7f417002ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1939548d20d734ee server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.977 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe5444d5640 1 Processor -- start 2026-02-25T17:21:27.977 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee9c065640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fee940989b0 0x7fee9412c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.977 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee9c065640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fee9412b080 0x7fee9412cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.978 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7f4179573640 1 -- 10.20.193.76:0/4009514280 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417002fac0 con 0x7f417c098ce0 2026-02-25T17:21:27.978 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee9c065640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fee9412b9a0 0x7fee9412d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.978 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee9c065640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee941287d0 con 0x7fee9412b080 2026-02-25T17:21:27.978 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee9c065640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee940720d0 con 0x7fee940989b0 2026-02-25T17:21:27.979 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe5444d5640 1 -- start start 2026-02-25T17:21:27.979 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee9c065640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee94127fd0 con 0x7fee9412b9a0 2026-02-25T17:21:27.979 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7f4179573640 1 -- 10.20.193.76:0/4009514280 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417002fc20 con 0x7f417c098ce0 2026-02-25T17:21:27.980 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee995d9640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fee9412b080 0x7fee9412cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.980 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee99dda640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fee940989b0 0x7fee9412c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.980 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee9a5db640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fee9412b9a0 0x7fee9412d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.980 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee995d9640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fee9412b080 0x7fee9412cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:35850/0 (socket says 10.20.193.76:35850) 2026-02-25T17:21:27.980 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee995d9640 1 -- 10.20.193.76:0/3970746829 learned_addr learned my addr 10.20.193.76:0/3970746829 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:27.980 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7f4179573640 1 -- 10.20.193.76:0/4009514280 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170037440 con 0x7f417c098ce0 2026-02-25T17:21:27.981 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee995d9640 1 -- 10.20.193.76:0/3970746829 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fee9412b9a0 msgr2=0x7fee9412d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.981 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee995d9640 1 --2- 10.20.193.76:0/3970746829 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fee9412b9a0 0x7fee9412d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.981 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee995d9640 1 -- 10.20.193.76:0/3970746829 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fee940989b0 msgr2=0x7fee9412c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.981 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee995d9640 1 --2- 10.20.193.76:0/3970746829 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fee940989b0 0x7fee9412c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.981 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee995d9640 1 -- 10.20.193.76:0/3970746829 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee84009500 con 0x7fee9412b080 2026-02-25T17:21:27.982 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe5444d5640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe53c0989b0 0x7fe53c12c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.982 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe5444d5640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe53c12b080 0x7fe53c12cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.982 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe5444d5640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe53c12b9a0 0x7fe53c12d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.982 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe5444d5640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c128510 con 0x7fe53c0989b0 2026-02-25T17:21:27.982 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe5444d5640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c12dfe0 con 0x7fe53c12b080 2026-02-25T17:21:27.982 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe5444d5640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c08c3b0 con 0x7fe53c12b9a0 2026-02-25T17:21:27.982 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe54224a640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe53c0989b0 0x7fe53c12c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.983 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee995d9640 1 --2- 10.20.193.76:0/3970746829 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fee9412b080 0x7fee9412cad0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee8800ebb0 tx=0x7fee8800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.983 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fb5d2b27640 1 Processor -- start 2026-02-25T17:21:27.983 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe541a49640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe53c12b080 0x7fe53c12cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.983 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe54224a640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe53c0989b0 0x7fe53c12c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:35866/0 (socket says 10.20.193.76:35866) 2026-02-25T17:21:27.983 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe54224a640 1 -- 10.20.193.76:0/2049721155 learned_addr learned my addr 10.20.193.76:0/2049721155 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:27.983 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe542a4b640 1 --2- 10.20.193.76:0/2049721155 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe53c12b9a0 0x7fe53c12d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fb5d2b27640 1 -- start start 2026-02-25T17:21:27.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7f4180c86640 1 -- 10.20.193.76:0/4009514280 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f417c098ce0 msgr2=0x7f417c06c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7f4180c86640 1 --2- 10.20.193.76:0/4009514280 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f417c098ce0 0x7f417c06c9a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f41700099a0 tx=0x7f417002ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:27.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee827fc640 1 -- 10.20.193.76:0/3970746829 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88009770 con 0x7fee9412b080 2026-02-25T17:21:27.984 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee827fc640 1 -- 10.20.193.76:0/3970746829 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8800eec0 con 0x7fee9412b080 2026-02-25T17:21:27.985 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee9c065640 1 -- 10.20.193.76:0/3970746829 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9412d9e0 con 0x7fee9412b080 2026-02-25T17:21:27.985 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7f4180c86640 1 -- 10.20.193.76:0/4009514280 shutdown_connections 2026-02-25T17:21:27.985 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7f4180c86640 1 --2- 10.20.193.76:0/4009514280 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f417c06d820 0x7f417c135010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.985 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee827fc640 1 -- 10.20.193.76:0/3970746829 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8800ce60 con 0x7fee9412b080 2026-02-25T17:21:27.985 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7f4180c86640 1 --2- 10.20.193.76:0/4009514280 >> v2:10.20.193.76:3300/0 conn(0x7f417c06cee0 0x7f417c06d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.986 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7f4180c86640 1 --2- 10.20.193.76:0/4009514280 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f417c098ce0 0x7f417c06c9a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.986 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7f4180c86640 1 -- 10.20.193.76:0/4009514280 >> 10.20.193.76:0/4009514280 conn(0x7f417c09cd70 msgr2=0x7f417c09d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:27.986 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fee9c065640 1 -- 10.20.193.76:0/3970746829 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee9412e670 con 0x7fee9412b080 2026-02-25T17:21:27.986 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7f4180c86640 1 -- 10.20.193.76:0/4009514280 shutdown_connections 2026-02-25T17:21:27.986 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe541a49640 1 -- 10.20.193.76:0/2049721155 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe53c12b9a0 msgr2=0x7fe53c12d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.987 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe541a49640 1 --2- 10.20.193.76:0/2049721155 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe53c12b9a0 0x7fe53c12d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.987 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe541a49640 1 -- 10.20.193.76:0/2049721155 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe53c0989b0 msgr2=0x7fe53c12c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.987 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe541a49640 1 --2- 10.20.193.76:0/2049721155 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe53c0989b0 0x7fe53c12c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.987 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7f4180c86640 1 -- 10.20.193.76:0/4009514280 wait complete. 2026-02-25T17:21:27.987 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe541a49640 1 -- 10.20.193.76:0/2049721155 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe530009500 con 0x7fe53c12b080 2026-02-25T17:21:27.987 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe541a49640 1 --2- 10.20.193.76:0/2049721155 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe53c12b080 0x7fe53c12cad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe53000ec10 tx=0x7fe53000c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.988 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe522ffd640 1 -- 10.20.193.76:0/2049721155 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53000cc40 con 0x7fe53c12b080 2026-02-25T17:21:27.988 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fb5d2b27640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb5cc06cb80 0x7fb5cc124d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.988 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fb5d2b27640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb5cc06d4a0 0x7fb5cc1252a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.988 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe522ffd640 1 -- 10.20.193.76:0/2049721155 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53000cda0 con 0x7fe53c12b080 2026-02-25T17:21:27.989 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fb5d2b27640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb5cc12e9f0 0x7fb5cc1257e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.989 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fb5d2b27640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc128150 con 0x7fb5cc06d4a0 2026-02-25T17:21:27.989 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fb5d2b27640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc128520 con 0x7fb5cc12e9f0 2026-02-25T17:21:27.989 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fb5d2b27640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5cc128bf0 con 0x7fb5cc06cb80 2026-02-25T17:21:27.989 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe5444d5640 1 -- 10.20.193.76:0/2049721155 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52c0095d0 con 0x7fe53c12b080 2026-02-25T17:21:27.989 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.955+0000 7fe522ffd640 1 -- 10.20.193.76:0/2049721155 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe530013690 con 0x7fe53c12b080 2026-02-25T17:21:27.989 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fe5444d5640 1 -- 10.20.193.76:0/2049721155 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe53c098530 con 0x7fe53c12b080 2026-02-25T17:21:27.990 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fb5d089c640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb5cc06cb80 0x7fb5cc124d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.990 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fb5d109d640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb5cc12e9f0 0x7fb5cc1257e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.990 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fb5d089c640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb5cc06cb80 0x7fb5cc124d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39132/0 (socket says 10.20.193.76:39132) 2026-02-25T17:21:27.990 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fb5d089c640 1 -- 10.20.193.76:0/1393699844 learned_addr learned my addr 10.20.193.76:0/1393699844 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:27.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fb5c3fff640 1 --2- 10.20.193.76:0/1393699844 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb5cc06d4a0 0x7fb5cc1252a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fb5d089c640 1 -- 10.20.193.76:0/1393699844 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb5cc12e9f0 msgr2=0x7fb5cc1257e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fb5d089c640 1 --2- 10.20.193.76:0/1393699844 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb5cc12e9f0 0x7fb5cc1257e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fb5d089c640 1 -- 10.20.193.76:0/1393699844 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb5cc06d4a0 msgr2=0x7fb5cc1252a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fb5d089c640 1 --2- 10.20.193.76:0/1393699844 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb5cc06d4a0 0x7fb5cc1252a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fb5d089c640 1 -- 10.20.193.76:0/1393699844 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc009500 con 0x7fb5cc06cb80 2026-02-25T17:21:27.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fb5c3fff640 1 --2- 10.20.193.76:0/1393699844 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb5cc06d4a0 0x7fb5cc1252a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-25T17:21:27.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fee9c065640 1 -- 10.20.193.76:0/3970746829 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9412b460 con 0x7fee9412b080 2026-02-25T17:21:27.991 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fb5d089c640 1 --2- 10.20.193.76:0/1393699844 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb5cc06cb80 0x7fb5cc124d60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00ebe0 tx=0x7fb5bc00c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7f4180c86640 1 Processor -- start 2026-02-25T17:21:27.992 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7f4180c86640 1 -- start start 2026-02-25T17:21:27.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fb5c17fa640 1 -- 10.20.193.76:0/1393699844 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc00cc40 con 0x7fb5cc06cb80 2026-02-25T17:21:27.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fb5c17fa640 1 -- 10.20.193.76:0/1393699844 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc00cda0 con 0x7fb5cc06cb80 2026-02-25T17:21:27.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fb5d2b27640 1 -- 10.20.193.76:0/1393699844 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c8009a70 con 0x7fb5cc06cb80 2026-02-25T17:21:27.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fb5c17fa640 1 -- 10.20.193.76:0/1393699844 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc013690 con 0x7fb5cc06cb80 2026-02-25T17:21:27.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fb5d2b27640 1 -- 10.20.193.76:0/1393699844 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5cc1c4bc0 con 0x7fb5cc06cb80 2026-02-25T17:21:27.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fe5444d5640 1 -- 10.20.193.76:0/2049721155 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53c098810 con 0x7fe53c12b080 2026-02-25T17:21:27.993 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fee827fc640 1 -- 10.20.193.76:0/3970746829 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fee88011070 con 0x7fee9412b080 2026-02-25T17:21:27.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7f4180c86640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f417c06cee0 0x7f417c123f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7f4180c86640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f417c06d820 0x7f417c124470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7f4180c86640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f417c098ce0 0x7f417c1249b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:27.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7f4180c86640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c126710 con 0x7f417c06cee0 2026-02-25T17:21:27.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7f4180c86640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417c072430 con 0x7f417c098ce0 2026-02-25T17:21:27.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7f4180c86640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f417c125170 con 0x7f417c06d820 2026-02-25T17:21:27.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7f4179d74640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f417c06d820 0x7f417c124470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7f417a575640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f417c06cee0 0x7f417c123f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.994 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7f417ad76640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f417c098ce0 0x7f417c1249b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:27.995 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7f417a575640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f417c06cee0 0x7f417c123f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:35884/0 (socket says 10.20.193.76:35884) 2026-02-25T17:21:27.995 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7f4179d74640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f417c06d820 0x7f417c124470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39138/0 (socket says 10.20.193.76:39138) 2026-02-25T17:21:27.995 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7f417a575640 1 -- 10.20.193.76:0/109321600 learned_addr learned my addr 10.20.193.76:0/109321600 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:27.995 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fe522ffd640 1 -- 10.20.193.76:0/2049721155 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fe530011070 con 0x7fe53c12b080 2026-02-25T17:21:27.995 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7fee827fc640 1 -- 10.20.193.76:0/3970746829 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7fee88066c40 con 0x7fee9412b080 2026-02-25T17:21:27.995 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7f4179d74640 1 -- 10.20.193.76:0/109321600 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f417c098ce0 msgr2=0x7f417c1249b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.995 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7f4179d74640 1 --2- 10.20.193.76:0/109321600 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f417c098ce0 0x7f417c1249b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.996 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7f4179d74640 1 -- 10.20.193.76:0/109321600 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f417c06cee0 msgr2=0x7f417c123f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:27.996 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7f4179d74640 1 --2- 10.20.193.76:0/109321600 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f417c06cee0 0x7f417c123f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:27.996 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7f4179d74640 1 -- 10.20.193.76:0/109321600 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41700095d0 con 0x7f417c06d820 2026-02-25T17:21:27.996 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.956+0000 7f417ad76640 1 --2- 10.20.193.76:0/109321600 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f417c098ce0 0x7f417c1249b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:27.996 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.957+0000 7f4179d74640 1 --2- 10.20.193.76:0/109321600 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f417c06d820 0x7f417c124470 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f416400e8a0 tx=0x7f416400ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:27.996 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.957+0000 7fb5d2b27640 1 -- 10.20.193.76:0/1393699844 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5cc0683e0 con 0x7fb5cc06cb80 2026-02-25T17:21:27.996 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.957+0000 7f4162ffd640 1 -- 10.20.193.76:0/109321600 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164009530 con 0x7f417c06d820 2026-02-25T17:21:27.996 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.957+0000 7fe522ffd640 1 -- 10.20.193.76:0/2049721155 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7fe5300669d0 con 0x7fe53c12b080 2026-02-25T17:21:27.997 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.957+0000 7f4162ffd640 1 -- 10.20.193.76:0/109321600 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416400c940 con 0x7f417c06d820 2026-02-25T17:21:27.997 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.957+0000 7f4162ffd640 1 -- 10.20.193.76:0/109321600 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416400ccd0 con 0x7f417c06d820 2026-02-25T17:21:27.997 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.957+0000 7f4180c86640 1 -- 10.20.193.76:0/109321600 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f417c126910 con 0x7f417c06d820 2026-02-25T17:21:27.997 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.957+0000 7f4180c86640 1 -- 10.20.193.76:0/109321600 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417c126270 con 0x7f417c06d820 2026-02-25T17:21:27.997 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.957+0000 7fb5c17fa640 1 -- 10.20.193.76:0/1393699844 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fb5bc011070 con 0x7fb5cc06cb80 2026-02-25T17:21:27.997 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.957+0000 7fb5c17fa640 1 -- 10.20.193.76:0/1393699844 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7fb5bc066a40 con 0x7fb5cc06cb80 2026-02-25T17:21:27.998 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.957+0000 7f4162ffd640 1 -- 10.20.193.76:0/109321600 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f4164011070 con 0x7f417c06d820 2026-02-25T17:21:27.998 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.957+0000 7f4180c86640 1 -- 10.20.193.76:0/109321600 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417c06d2e0 con 0x7f417c06d820 2026-02-25T17:21:27.998 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.958+0000 7f4162ffd640 1 -- 10.20.193.76:0/109321600 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7f41640667b0 con 0x7f417c06d820 2026-02-25T17:21:27.998 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.958+0000 7fee827fc640 1 -- 10.20.193.76:0/3970746829 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7fee880405c0 con 0x7fee9412b080 2026-02-25T17:21:27.998 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.958+0000 7fe522ffd640 1 -- 10.20.193.76:0/2049721155 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7fe53c098810 con 0x7fe53c12b080 2026-02-25T17:21:27.999 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.959+0000 7fb5c17fa640 1 -- 10.20.193.76:0/1393699844 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7fb5bc040320 con 0x7fb5cc06cb80 2026-02-25T17:21:27.999 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:27.962+0000 7f4162ffd640 1 -- 10.20.193.76:0/109321600 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f4164040250 con 0x7f417c06d820 2026-02-25T17:21:28.026 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.024+0000 7fe5444d5640 1 -- 10.20.193.76:0/2049721155 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe53c098810 con 0x7fe53c12b080 2026-02-25T17:21:28.027 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.024+0000 7fe522ffd640 1 -- 10.20.193.76:0/2049721155 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe53c098810 con 0x7fe53c12b080 2026-02-25T17:21:28.027 INFO:teuthology.orchestra.run.trial076.stdout:94489280514 2026-02-25T17:21:28.028 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.025+0000 7fb5d2b27640 1 -- 10.20.193.76:0/1393699844 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb5cc06cf60 con 0x7fb5cc06cb80 2026-02-25T17:21:28.028 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.025+0000 7fb5c17fa640 1 -- 10.20.193.76:0/1393699844 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb5bc017030 con 0x7fb5cc06cb80 2026-02-25T17:21:28.028 INFO:teuthology.orchestra.run.trial076.stdout:103079215106 2026-02-25T17:21:28.029 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.025+0000 7fe5444d5640 1 -- 10.20.193.76:0/2049721155 >> v1:10.20.193.76:6800/1563581135 conn(0x7fe50c04f880 legacy=0x7fe50c051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:28.029 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.025+0000 7fe5444d5640 1 -- 10.20.193.76:0/2049721155 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe53c12b080 msgr2=0x7fe53c12cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:28.029 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.025+0000 7fe5444d5640 1 --2- 10.20.193.76:0/2049721155 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe53c12b080 0x7fe53c12cad0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe53000ec10 tx=0x7fe53000c520 comp rx=0 tx=0).stop 2026-02-25T17:21:28.029 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.025+0000 7fe5444d5640 1 -- 10.20.193.76:0/2049721155 shutdown_connections 2026-02-25T17:21:28.029 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.025+0000 7fe5444d5640 1 --2- 10.20.193.76:0/2049721155 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe53c12b9a0 0x7fe53c12d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:28.029 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.025+0000 7fe5444d5640 1 --2- 10.20.193.76:0/2049721155 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe53c12b080 0x7fe53c12cad0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:28.029 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.025+0000 7fe5444d5640 1 --2- 10.20.193.76:0/2049721155 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe53c0989b0 0x7fe53c12c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:28.029 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.025+0000 7fe5444d5640 1 -- 10.20.193.76:0/2049721155 >> 10.20.193.76:0/2049721155 conn(0x7fe53c09a960 msgr2=0x7fe53c132d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:28.030 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.025+0000 7fe5444d5640 1 -- 10.20.193.76:0/2049721155 shutdown_connections 2026-02-25T17:21:28.030 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.025+0000 7fe5444d5640 1 -- 10.20.193.76:0/2049721155 wait complete. 2026-02-25T17:21:28.030 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.026+0000 7fb5d2b27640 1 -- 10.20.193.76:0/1393699844 >> v1:10.20.193.76:6800/1563581135 conn(0x7fb59c04f880 legacy=0x7fb59c051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:28.030 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.026+0000 7fb5d2b27640 1 -- 10.20.193.76:0/1393699844 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb5cc06cb80 msgr2=0x7fb5cc124d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:28.030 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.026+0000 7fb5d2b27640 1 --2- 10.20.193.76:0/1393699844 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb5cc06cb80 0x7fb5cc124d60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00ebe0 tx=0x7fb5bc00c520 comp rx=0 tx=0).stop 2026-02-25T17:21:28.030 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.026+0000 7fb5d2b27640 1 -- 10.20.193.76:0/1393699844 shutdown_connections 2026-02-25T17:21:28.030 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.026+0000 7fb5d2b27640 1 --2- 10.20.193.76:0/1393699844 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fb5cc12e9f0 0x7fb5cc1257e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:28.031 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.026+0000 7fb5d2b27640 1 --2- 10.20.193.76:0/1393699844 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fb5cc06d4a0 0x7fb5cc1252a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:28.031 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.026+0000 7fb5d2b27640 1 --2- 10.20.193.76:0/1393699844 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fb5cc06cb80 0x7fb5cc124d60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:28.031 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.026+0000 7fb5d2b27640 1 -- 10.20.193.76:0/1393699844 >> 10.20.193.76:0/1393699844 conn(0x7fb5cc09eb10 msgr2=0x7fb5cc09b590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:28.031 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.026+0000 7fb5d2b27640 1 -- 10.20.193.76:0/1393699844 shutdown_connections 2026-02-25T17:21:28.031 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.026+0000 7fb5d2b27640 1 -- 10.20.193.76:0/1393699844 wait complete. 2026-02-25T17:21:28.031 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.026+0000 7fee9c065640 1 -- 10.20.193.76:0/3970746829 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fee94068270 con 0x7fee9412b080 2026-02-25T17:21:28.031 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.027+0000 7fee827fc640 1 -- 10.20.193.76:0/3970746829 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7fee88017030 con 0x7fee9412b080 2026-02-25T17:21:28.031 INFO:teuthology.orchestra.run.trial076.stdout:1 2026-02-25T17:21:28.032 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.027+0000 7f4180c86640 1 -- 10.20.193.76:0/109321600 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f417c0679f0 con 0x7f417c06d820 2026-02-25T17:21:28.032 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.027+0000 7f4162ffd640 1 -- 10.20.193.76:0/109321600 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4164017070 con 0x7f417c06d820 2026-02-25T17:21:28.032 INFO:teuthology.orchestra.run.trial076.stdout:98784247810 2026-02-25T17:21:28.033 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.028+0000 7fee9c065640 1 -- 10.20.193.76:0/3970746829 >> v1:10.20.193.76:6800/1563581135 conn(0x7fee6404f880 legacy=0x7fee64051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:28.033 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.028+0000 7fee9c065640 1 -- 10.20.193.76:0/3970746829 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fee9412b080 msgr2=0x7fee9412cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:28.033 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.028+0000 7fee9c065640 1 --2- 10.20.193.76:0/3970746829 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fee9412b080 0x7fee9412cad0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee8800ebb0 tx=0x7fee8800c520 comp rx=0 tx=0).stop 2026-02-25T17:21:28.033 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.028+0000 7fee9c065640 1 -- 10.20.193.76:0/3970746829 shutdown_connections 2026-02-25T17:21:28.033 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.028+0000 7fee9c065640 1 --2- 10.20.193.76:0/3970746829 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fee9412b9a0 0x7fee9412d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:28.033 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.028+0000 7fee9c065640 1 --2- 10.20.193.76:0/3970746829 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fee9412b080 0x7fee9412cad0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:28.033 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.028+0000 7fee9c065640 1 --2- 10.20.193.76:0/3970746829 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fee940989b0 0x7fee9412c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:28.033 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.028+0000 7fee9c065640 1 -- 10.20.193.76:0/3970746829 >> 10.20.193.76:0/3970746829 conn(0x7fee9409a960 msgr2=0x7fee9406f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:28.033 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.028+0000 7fee9c065640 1 -- 10.20.193.76:0/3970746829 shutdown_connections 2026-02-25T17:21:28.033 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.028+0000 7fee9c065640 1 -- 10.20.193.76:0/3970746829 wait complete. 2026-02-25T17:21:28.034 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.029+0000 7f4180c86640 1 -- 10.20.193.76:0/109321600 >> v1:10.20.193.76:6800/1563581135 conn(0x7f414804f880 legacy=0x7f4148051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:28.034 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.029+0000 7f4180c86640 1 -- 10.20.193.76:0/109321600 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f417c06d820 msgr2=0x7f417c124470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:28.034 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.029+0000 7f4180c86640 1 --2- 10.20.193.76:0/109321600 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f417c06d820 0x7f417c124470 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f416400e8a0 tx=0x7f416400ed70 comp rx=0 tx=0).stop 2026-02-25T17:21:28.034 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.029+0000 7f4180c86640 1 -- 10.20.193.76:0/109321600 shutdown_connections 2026-02-25T17:21:28.034 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.029+0000 7f4180c86640 1 --2- 10.20.193.76:0/109321600 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f417c098ce0 0x7f417c1249b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:28.034 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.029+0000 7f4180c86640 1 --2- 10.20.193.76:0/109321600 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f417c06d820 0x7f417c124470 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:28.034 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.029+0000 7f4180c86640 1 --2- 10.20.193.76:0/109321600 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f417c06cee0 0x7f417c123f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:28.034 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.029+0000 7f4180c86640 1 -- 10.20.193.76:0/109321600 >> 10.20.193.76:0/109321600 conn(0x7f417c09cd70 msgr2=0x7f417c099870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:28.034 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.029+0000 7f4180c86640 1 -- 10.20.193.76:0/109321600 shutdown_connections 2026-02-25T17:21:28.034 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:28.029+0000 7f4180c86640 1 -- 10.20.193.76:0/109321600 wait complete. 2026-02-25T17:21:28.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280514 for osd.0 2026-02-25T17:21:28.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182403 got 1 for osd.3 2026-02-25T17:21:28.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215107 got 103079215106 for osd.2 2026-02-25T17:21:28.039 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247811 got 98784247810 for osd.1 2026-02-25T17:21:29.039 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-25T17:21:29.040 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-25T17:21:29.041 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-25T17:21:29.042 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-25T17:21:29.112 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7f296c758640 1 Processor -- start 2026-02-25T17:21:29.112 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7f296c758640 1 -- start start 2026-02-25T17:21:29.113 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7fe45addc640 1 Processor -- start 2026-02-25T17:21:29.113 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7fe45addc640 1 -- start start 2026-02-25T17:21:29.114 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7f296c758640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f296406c9a0 0x7f296406cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.114 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7f296c758640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f29640990e0 0x7f296406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.114 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7f296c758640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f296406d800 0x7f2964134fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.115 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7f296c758640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f296406e8c0 con 0x7f296406d800 2026-02-25T17:21:29.115 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7f296c758640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296409ecc0 con 0x7f296406c9a0 2026-02-25T17:21:29.115 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7f296c758640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2964061360 con 0x7f29640990e0 2026-02-25T17:21:29.115 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7f296a4cd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f296406c9a0 0x7f296406cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.115 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7f296a4cd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f296406c9a0 0x7f296406cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50596/0 (socket says 10.20.193.76:50596) 2026-02-25T17:21:29.115 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7f296a4cd640 1 -- 10.20.193.76:0/640116796 learned_addr learned my addr 10.20.193.76:0/640116796 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:29.115 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7f2969ccc640 1 --2- 10.20.193.76:0/640116796 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f29640990e0 0x7f296406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.115 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7f296acce640 1 --2- 10.20.193.76:0/640116796 >> v2:10.20.193.76:3300/0 conn(0x7f296406d800 0x7f2964134fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.116 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7fe45addc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe454096cc0 0x7fe4540970a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.116 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7fe45addc640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fe454094740 0x7fe454094b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.117 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7fe45addc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe454095060 0x7fe454135390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.117 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7fe45addc640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4540616e0 con 0x7fe454094740 2026-02-25T17:21:29.117 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7fe45addc640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4540964c0 con 0x7fe454096cc0 2026-02-25T17:21:29.117 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7fe45addc640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4540967d0 con 0x7fe454095060 2026-02-25T17:21:29.117 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7fe458b51640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe454096cc0 0x7fe4540970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.117 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7fe459352640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe454095060 0x7fe454135390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.117 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7fe44bfff640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fe454094740 0x7fe454094b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.117 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7fe458b51640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe454096cc0 0x7fe4540970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50606/0 (socket says 10.20.193.76:50606) 2026-02-25T17:21:29.117 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7fe459352640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe454095060 0x7fe454135390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39146/0 (socket says 10.20.193.76:39146) 2026-02-25T17:21:29.118 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7fe458b51640 1 -- 10.20.193.76:0/1023364842 learned_addr learned my addr 10.20.193.76:0/1023364842 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:29.118 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7f296a4cd640 1 -- 10.20.193.76:0/640116796 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f29640990e0 msgr2=0x7f296406d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:29.118 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7f296a4cd640 1 --2- 10.20.193.76:0/640116796 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f29640990e0 0x7f296406d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7f296a4cd640 1 -- 10.20.193.76:0/640116796 >> v2:10.20.193.76:3300/0 conn(0x7f296406d800 msgr2=0x7f2964134fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:29.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7f296a4cd640 1 --2- 10.20.193.76:0/640116796 >> v2:10.20.193.76:3300/0 conn(0x7f296406d800 0x7f2964134fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7f296a4cd640 1 -- 10.20.193.76:0/640116796 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296406dc90 con 0x7f296406c9a0 2026-02-25T17:21:29.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7f296acce640 1 --2- 10.20.193.76:0/640116796 >> v2:10.20.193.76:3300/0 conn(0x7f296406d800 0x7f2964134fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:29.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7f2969ccc640 1 --2- 10.20.193.76:0/640116796 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f29640990e0 0x7f296406d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:29.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7fe459352640 1 -- 10.20.193.76:0/1023364842 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe454096cc0 msgr2=0x7fe4540970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:29.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7fe459352640 1 --2- 10.20.193.76:0/1023364842 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe454096cc0 0x7fe4540970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7fe459352640 1 -- 10.20.193.76:0/1023364842 >> v2:10.20.193.76:3300/0 conn(0x7fe454094740 msgr2=0x7fe454094b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:29.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7fe459352640 1 --2- 10.20.193.76:0/1023364842 >> v2:10.20.193.76:3300/0 conn(0x7fe454094740 0x7fe454094b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.110+0000 7fe459352640 1 -- 10.20.193.76:0/1023364842 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe454095510 con 0x7fe454095060 2026-02-25T17:21:29.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7f296a4cd640 1 --2- 10.20.193.76:0/640116796 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f296406c9a0 0x7f296406cd80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f29540099a0 tx=0x7f295402ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f249217f754bb804 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:29.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7f29694cb640 1 -- 10.20.193.76:0/640116796 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295402fac0 con 0x7f296406c9a0 2026-02-25T17:21:29.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7f29694cb640 1 -- 10.20.193.76:0/640116796 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295402fc20 con 0x7f296406c9a0 2026-02-25T17:21:29.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7f29694cb640 1 -- 10.20.193.76:0/640116796 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954037440 con 0x7f296406c9a0 2026-02-25T17:21:29.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7fe459352640 1 --2- 10.20.193.76:0/1023364842 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe454095060 0x7fe454135390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe450009d90 tx=0x7fe45002f190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d77f6b10fea21373 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:29.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7fe44b7fe640 1 -- 10.20.193.76:0/1023364842 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe450006ea0 con 0x7fe454095060 2026-02-25T17:21:29.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7fe44b7fe640 1 -- 10.20.193.76:0/1023364842 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45002fdc0 con 0x7fe454095060 2026-02-25T17:21:29.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7fe44b7fe640 1 -- 10.20.193.76:0/1023364842 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe450037660 con 0x7fe454095060 2026-02-25T17:21:29.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7f296c758640 1 -- 10.20.193.76:0/640116796 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f296406c9a0 msgr2=0x7f296406cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7f296c758640 1 --2- 10.20.193.76:0/640116796 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f296406c9a0 0x7f296406cd80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f29540099a0 tx=0x7f295402ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:29.123 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7f7653c1e640 1 Processor -- start 2026-02-25T17:21:29.123 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7f296c758640 1 -- 10.20.193.76:0/640116796 shutdown_connections 2026-02-25T17:21:29.123 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7f296c758640 1 --2- 10.20.193.76:0/640116796 >> v2:10.20.193.76:3300/0 conn(0x7f296406d800 0x7f2964134fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.123 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7f296c758640 1 --2- 10.20.193.76:0/640116796 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f29640990e0 0x7f296406d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.123 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7f296c758640 1 --2- 10.20.193.76:0/640116796 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f296406c9a0 0x7f296406cd80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.123 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7f296c758640 1 -- 10.20.193.76:0/640116796 >> 10.20.193.76:0/640116796 conn(0x7f296409d120 msgr2=0x7f296409d530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:29.124 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7f7653c1e640 1 -- start start 2026-02-25T17:21:29.124 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7f296c758640 1 -- 10.20.193.76:0/640116796 shutdown_connections 2026-02-25T17:21:29.124 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7f296c758640 1 -- 10.20.193.76:0/640116796 wait complete. 2026-02-25T17:21:29.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7fe45addc640 1 -- 10.20.193.76:0/1023364842 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe454095060 msgr2=0x7fe454135390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7fe45addc640 1 --2- 10.20.193.76:0/1023364842 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe454095060 0x7fe454135390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe450009d90 tx=0x7fe45002f190 comp rx=0 tx=0).stop 2026-02-25T17:21:29.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7fe45addc640 1 -- 10.20.193.76:0/1023364842 shutdown_connections 2026-02-25T17:21:29.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7fe45addc640 1 --2- 10.20.193.76:0/1023364842 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe454095060 0x7fe454135390 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7fe45addc640 1 --2- 10.20.193.76:0/1023364842 >> v2:10.20.193.76:3300/0 conn(0x7fe454094740 0x7fe454094b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7fe45addc640 1 --2- 10.20.193.76:0/1023364842 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe454096cc0 0x7fe4540970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7fe45addc640 1 -- 10.20.193.76:0/1023364842 >> 10.20.193.76:0/1023364842 conn(0x7fe45409d1d0 msgr2=0x7fe45409d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:29.126 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7f7653c1e640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f764c12e530 0x7f764c12e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.126 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7fe45addc640 1 -- 10.20.193.76:0/1023364842 shutdown_connections 2026-02-25T17:21:29.126 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7f7653c1e640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f764c12ee50 0x7f764c097b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.127 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7fe45addc640 1 -- 10.20.193.76:0/1023364842 wait complete. 2026-02-25T17:21:29.128 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7f7653c1e640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764c06d420 con 0x7f764c09d390 2026-02-25T17:21:29.128 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7f7653c1e640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f764c09b050 con 0x7f764c12e530 2026-02-25T17:21:29.128 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.111+0000 7f7653c1e640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f764c06da80 con 0x7f764c12ee50 2026-02-25T17:21:29.128 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f7652194640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f764c12ee50 0x7f764c097b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.128 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f7651993640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f764c12e530 0x7f764c12e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.128 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f7651192640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f764c09d390 0x7f764c097460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:60942/0 (socket says 10.20.193.76:60942) 2026-02-25T17:21:29.128 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f7652194640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f764c12ee50 0x7f764c097b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39154/0 (socket says 10.20.193.76:39154) 2026-02-25T17:21:29.128 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f7651192640 1 -- 10.20.193.76:0/2516097035 learned_addr learned my addr 10.20.193.76:0/2516097035 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:29.128 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f7651993640 1 -- 10.20.193.76:0/2516097035 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f764c12ee50 msgr2=0x7f764c097b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:29.129 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f7651993640 1 --2- 10.20.193.76:0/2516097035 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f764c12ee50 0x7f764c097b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.129 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f7651993640 1 -- 10.20.193.76:0/2516097035 >> v1:10.20.193.76:6789/0 conn(0x7f764c09d390 legacy=0x7f764c097460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.129 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f7650991640 1 -- 10.20.193.76:0/2516097035 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884986782 0 0) 0x7f764c06d420 con 0x7f764c09d390 2026-02-25T17:21:29.129 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f7651993640 1 -- 10.20.193.76:0/2516097035 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c12f2c0 con 0x7f764c12e530 2026-02-25T17:21:29.129 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f296c758640 1 Processor -- start 2026-02-25T17:21:29.129 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7fe45addc640 1 Processor -- start 2026-02-25T17:21:29.130 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f296c758640 1 -- start start 2026-02-25T17:21:29.130 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7fe45addc640 1 -- start start 2026-02-25T17:21:29.130 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f7651993640 1 --2- 10.20.193.76:0/2516097035 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f764c12e530 0x7f764c12e910 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f763c0098a0 tx=0x7f763c02ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e455f677fdfc630a server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:29.131 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7fe45addc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe454094740 0x7fe454123d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.131 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7fe45addc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe454095060 0x7fe454124240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.131 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7fe45addc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe454096cc0 0x7fe454124780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.131 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7fe45addc640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe454135580 con 0x7fe454094740 2026-02-25T17:21:29.131 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7fe45addc640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4541274e0 con 0x7fe454095060 2026-02-25T17:21:29.131 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7fe45addc640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4540938f0 con 0x7fe454096cc0 2026-02-25T17:21:29.132 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f296c758640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f296406c9a0 0x7f2964124130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.132 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f296c758640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f296406d800 0x7f2964124670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.132 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f7650991640 1 -- 10.20.193.76:0/2516097035 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c02fa40 con 0x7f764c12e530 2026-02-25T17:21:29.133 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f296c758640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f29640990e0 0x7f2964124bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.133 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f296c758640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2964126bd0 con 0x7f296406c9a0 2026-02-25T17:21:29.133 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f296c758640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2964126160 con 0x7f29640990e0 2026-02-25T17:21:29.133 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f296c758640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29640726f0 con 0x7f296406d800 2026-02-25T17:21:29.134 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f7650991640 1 -- 10.20.193.76:0/2516097035 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c02fba0 con 0x7f764c12e530 2026-02-25T17:21:29.134 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f7650991640 1 -- 10.20.193.76:0/2516097035 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c037440 con 0x7f764c12e530 2026-02-25T17:21:29.134 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7fe44bfff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe454095060 0x7fe454124240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.134 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7fe458b51640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe454094740 0x7fe454123d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.134 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7fe459352640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe454096cc0 0x7fe454124780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.135 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7fe44bfff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe454095060 0x7fe454124240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50618/0 (socket says 10.20.193.76:50618) 2026-02-25T17:21:29.135 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7fe458b51640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe454094740 0x7fe454123d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:35908/0 (socket says 10.20.193.76:35908) 2026-02-25T17:21:29.135 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7fe44bfff640 1 -- 10.20.193.76:0/1827123609 learned_addr learned my addr 10.20.193.76:0/1827123609 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:29.135 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f296a4cd640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f296406c9a0 0x7f2964124130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.135 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f296acce640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f29640990e0 0x7f2964124bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.135 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f296a4cd640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f296406c9a0 0x7f2964124130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:35922/0 (socket says 10.20.193.76:35922) 2026-02-25T17:21:29.136 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f296a4cd640 1 -- 10.20.193.76:0/3472945753 learned_addr learned my addr 10.20.193.76:0/3472945753 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:29.136 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7f2969ccc640 1 --2- 10.20.193.76:0/3472945753 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f296406d800 0x7f2964124670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.136 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7fe44bfff640 1 -- 10.20.193.76:0/1827123609 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe454096cc0 msgr2=0x7fe454124780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.136 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7fe44bfff640 1 --2- 10.20.193.76:0/1827123609 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe454096cc0 0x7fe454124780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.136 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.112+0000 7fe44bfff640 1 -- 10.20.193.76:0/1827123609 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe454094740 msgr2=0x7fe454123d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.137 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7fe44bfff640 1 --2- 10.20.193.76:0/1827123609 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe454094740 0x7fe454123d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.137 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7fe44bfff640 1 -- 10.20.193.76:0/1827123609 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe450009a70 con 0x7fe454095060 2026-02-25T17:21:29.137 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7fe458b51640 1 --2- 10.20.193.76:0/1827123609 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe454094740 0x7fe454123d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:29.137 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f296acce640 1 -- 10.20.193.76:0/3472945753 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f296406d800 msgr2=0x7f2964124670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.137 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f296acce640 1 --2- 10.20.193.76:0/3472945753 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f296406d800 0x7f2964124670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.137 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f296acce640 1 -- 10.20.193.76:0/3472945753 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f296406c9a0 msgr2=0x7f2964124130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.138 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f296acce640 1 --2- 10.20.193.76:0/3472945753 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f296406c9a0 0x7f2964124130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.138 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f296acce640 1 -- 10.20.193.76:0/3472945753 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2960009a70 con 0x7f29640990e0 2026-02-25T17:21:29.138 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7fe44bfff640 1 --2- 10.20.193.76:0/1827123609 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe454095060 0x7fe454124240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00ebe0 tx=0x7fe43c00c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:29.138 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f296acce640 1 --2- 10.20.193.76:0/3472945753 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f29640990e0 0x7f2964124bb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f296000eed0 tx=0x7f296000b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:29.139 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7fe4497fa640 1 -- 10.20.193.76:0/1827123609 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c009770 con 0x7fe454095060 2026-02-25T17:21:29.139 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7fe45addc640 1 -- 10.20.193.76:0/1827123609 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4541257e0 con 0x7fe454095060 2026-02-25T17:21:29.139 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f7653c1e640 1 -- 10.20.193.76:0/2516097035 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f764c12e530 msgr2=0x7f764c12e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.139 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f7653c1e640 1 --2- 10.20.193.76:0/2516097035 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f764c12e530 0x7f764c12e910 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f763c0098a0 tx=0x7f763c02ed80 comp rx=0 tx=0).stop 2026-02-25T17:21:29.140 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f7653c1e640 1 -- 10.20.193.76:0/2516097035 shutdown_connections 2026-02-25T17:21:29.140 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f7653c1e640 1 --2- 10.20.193.76:0/2516097035 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f764c12ee50 0x7f764c097b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.140 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f7653c1e640 1 --2- 10.20.193.76:0/2516097035 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f764c12e530 0x7f764c12e910 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.140 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f7653c1e640 1 -- 10.20.193.76:0/2516097035 >> 10.20.193.76:0/2516097035 conn(0x7f764c09e130 msgr2=0x7f764c09ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:29.140 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7fe4497fa640 1 -- 10.20.193.76:0/1827123609 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c00cc40 con 0x7fe454095060 2026-02-25T17:21:29.140 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f7653c1e640 1 -- 10.20.193.76:0/2516097035 shutdown_connections 2026-02-25T17:21:29.141 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f7653c1e640 1 -- 10.20.193.76:0/2516097035 wait complete. 2026-02-25T17:21:29.141 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f294affd640 1 -- 10.20.193.76:0/3472945753 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960010040 con 0x7f29640990e0 2026-02-25T17:21:29.141 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f294affd640 1 -- 10.20.193.76:0/3472945753 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296000bca0 con 0x7f29640990e0 2026-02-25T17:21:29.141 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7fe4497fa640 1 -- 10.20.193.76:0/1827123609 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c013470 con 0x7fe454095060 2026-02-25T17:21:29.142 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f294affd640 1 -- 10.20.193.76:0/3472945753 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960006ea0 con 0x7f29640990e0 2026-02-25T17:21:29.142 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f296c758640 1 -- 10.20.193.76:0/3472945753 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2958009500 con 0x7f29640990e0 2026-02-25T17:21:29.142 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7fe45addc640 1 -- 10.20.193.76:0/1827123609 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe454124cc0 con 0x7fe454095060 2026-02-25T17:21:29.143 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f296c758640 1 -- 10.20.193.76:0/3472945753 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29540095d0 con 0x7f29640990e0 2026-02-25T17:21:29.143 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f9626627640 1 Processor -- start 2026-02-25T17:21:29.143 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7fe45addc640 1 -- 10.20.193.76:0/1827123609 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe454126890 con 0x7fe454095060 2026-02-25T17:21:29.144 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f9626627640 1 -- start start 2026-02-25T17:21:29.144 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.113+0000 7f7653c1e640 1 Processor -- start 2026-02-25T17:21:29.144 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f7653c1e640 1 -- start start 2026-02-25T17:21:29.145 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f296c758640 1 -- 10.20.193.76:0/3472945753 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f296406cd80 con 0x7f29640990e0 2026-02-25T17:21:29.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f9626627640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f962012e530 0x7f962012e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f9626627640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f962012ee50 0x7f9620097b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f9626627640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f962006d420 con 0x7f962009d390 2026-02-25T17:21:29.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f9626627640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962009b050 con 0x7f962012ee50 2026-02-25T17:21:29.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f9626627640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f962006da80 con 0x7f962012e530 2026-02-25T17:21:29.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f961ffff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f962012e530 0x7f962012e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f961f7fe640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f962009d390 0x7f9620097460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:60950/0 (socket says 10.20.193.76:60950) 2026-02-25T17:21:29.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f961ffff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f962012e530 0x7f962012e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39190/0 (socket says 10.20.193.76:39190) 2026-02-25T17:21:29.146 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f961f7fe640 1 -- 10.20.193.76:0/1841887783 learned_addr learned my addr 10.20.193.76:0/1841887783 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:29.147 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7fe4497fa640 1 -- 10.20.193.76:0/1827123609 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fe43c011070 con 0x7fe454095060 2026-02-25T17:21:29.147 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f9624b9d640 1 --2- 10.20.193.76:0/1841887783 >> v2:10.20.193.76:3300/0 conn(0x7f962012ee50 0x7f9620097b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.147 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f294affd640 1 -- 10.20.193.76:0/3472945753 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f296001d410 con 0x7f29640990e0 2026-02-25T17:21:29.148 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f7653c1e640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f764c09d390 0x7f764c097a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.148 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f7653c1e640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f764c12e530 0x7f764c12fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.148 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f7653c1e640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f764c12ee50 0x7f764c12fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.148 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f7653c1e640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c132360 con 0x7f764c12e530 2026-02-25T17:21:29.148 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f7653c1e640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c12bc90 con 0x7f764c12ee50 2026-02-25T17:21:29.148 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f7653c1e640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f764c09b270 con 0x7f764c09d390 2026-02-25T17:21:29.149 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f7651993640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f764c09d390 0x7f764c097a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.149 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f7651192640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f764c12e530 0x7f764c12fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.149 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f7651993640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f764c09d390 0x7f764c097a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39196/0 (socket says 10.20.193.76:39196) 2026-02-25T17:21:29.149 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f7651993640 1 -- 10.20.193.76:0/1011600008 learned_addr learned my addr 10.20.193.76:0/1011600008 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:29.149 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f961ffff640 1 -- 10.20.193.76:0/1841887783 >> v2:10.20.193.76:3300/0 conn(0x7f962012ee50 msgr2=0x7f9620097b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:29.149 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f961effd640 1 -- 10.20.193.76:0/1841887783 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529798404 0 0) 0x7f962006d420 con 0x7f962009d390 2026-02-25T17:21:29.149 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f961ffff640 1 --2- 10.20.193.76:0/1841887783 >> v2:10.20.193.76:3300/0 conn(0x7f962012ee50 0x7f9620097b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.150 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f7652194640 1 --2- 10.20.193.76:0/1011600008 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f764c12ee50 0x7f764c12fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.150 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f961ffff640 1 -- 10.20.193.76:0/1841887783 >> v1:10.20.193.76:6789/0 conn(0x7f962009d390 legacy=0x7f9620097460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.150 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f961ffff640 1 -- 10.20.193.76:0/1841887783 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962012f280 con 0x7f962012e530 2026-02-25T17:21:29.151 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f7651993640 1 -- 10.20.193.76:0/1011600008 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f764c12ee50 msgr2=0x7f764c12fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.151 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f7651993640 1 --2- 10.20.193.76:0/1011600008 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f764c12ee50 0x7f764c12fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.151 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f7651993640 1 -- 10.20.193.76:0/1011600008 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f764c12e530 msgr2=0x7f764c12fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.151 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f7651993640 1 --2- 10.20.193.76:0/1011600008 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f764c12e530 0x7f764c12fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.151 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f7651993640 1 -- 10.20.193.76:0/1011600008 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c009500 con 0x7f764c09d390 2026-02-25T17:21:29.151 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f294affd640 1 -- 10.20.193.76:0/3472945753 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7f2960066e90 con 0x7f29640990e0 2026-02-25T17:21:29.152 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f7651993640 1 --2- 10.20.193.76:0/1011600008 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f764c09d390 0x7f764c097a30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f763c009130 tx=0x7f763c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:29.152 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7fe4497fa640 1 -- 10.20.193.76:0/1827123609 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7fe43c066cf0 con 0x7fe454095060 2026-02-25T17:21:29.152 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f961ffff640 1 --2- 10.20.193.76:0/1841887783 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f962012e530 0x7f962012e910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f960c0098a0 tx=0x7f960c02ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1da811d213b43e6c server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:29.153 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f763a7fc640 1 -- 10.20.193.76:0/1011600008 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c042650 con 0x7f764c09d390 2026-02-25T17:21:29.153 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f763a7fc640 1 -- 10.20.193.76:0/1011600008 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c0427d0 con 0x7f764c09d390 2026-02-25T17:21:29.153 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f763a7fc640 1 -- 10.20.193.76:0/1011600008 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c042b80 con 0x7f764c09d390 2026-02-25T17:21:29.153 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f7653c1e640 1 -- 10.20.193.76:0/1011600008 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764c12b540 con 0x7f764c09d390 2026-02-25T17:21:29.153 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.114+0000 7f961effd640 1 -- 10.20.193.76:0/1841887783 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c02fa40 con 0x7f962012e530 2026-02-25T17:21:29.153 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.115+0000 7f961effd640 1 -- 10.20.193.76:0/1841887783 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c02fba0 con 0x7f962012e530 2026-02-25T17:21:29.153 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.115+0000 7f961effd640 1 -- 10.20.193.76:0/1841887783 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c037440 con 0x7f962012e530 2026-02-25T17:21:29.154 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.115+0000 7f7653c1e640 1 -- 10.20.193.76:0/1011600008 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764c131b40 con 0x7f764c09d390 2026-02-25T17:21:29.154 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.115+0000 7f9626627640 1 -- 10.20.193.76:0/1841887783 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f962012e530 msgr2=0x7f962012e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.154 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.115+0000 7f9626627640 1 --2- 10.20.193.76:0/1841887783 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f962012e530 0x7f962012e910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f960c0098a0 tx=0x7f960c02ed80 comp rx=0 tx=0).stop 2026-02-25T17:21:29.154 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.115+0000 7f9626627640 1 -- 10.20.193.76:0/1841887783 shutdown_connections 2026-02-25T17:21:29.154 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.115+0000 7f9626627640 1 --2- 10.20.193.76:0/1841887783 >> v2:10.20.193.76:3300/0 conn(0x7f962012ee50 0x7f9620097b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.154 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.115+0000 7f9626627640 1 --2- 10.20.193.76:0/1841887783 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f962012e530 0x7f962012e910 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.155 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.115+0000 7f9626627640 1 -- 10.20.193.76:0/1841887783 >> 10.20.193.76:0/1841887783 conn(0x7f962009e130 msgr2=0x7f962009ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:29.155 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.115+0000 7f9626627640 1 -- 10.20.193.76:0/1841887783 shutdown_connections 2026-02-25T17:21:29.155 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.115+0000 7f9626627640 1 -- 10.20.193.76:0/1841887783 wait complete. 2026-02-25T17:21:29.155 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.115+0000 7f7653c1e640 1 -- 10.20.193.76:0/1011600008 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764c131710 con 0x7f764c09d390 2026-02-25T17:21:29.155 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.115+0000 7f763a7fc640 1 -- 10.20.193.76:0/1011600008 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f763c052020 con 0x7f764c09d390 2026-02-25T17:21:29.155 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.115+0000 7f9626627640 1 Processor -- start 2026-02-25T17:21:29.155 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.115+0000 7f9626627640 1 -- start start 2026-02-25T17:21:29.156 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.116+0000 7f763a7fc640 1 -- 10.20.193.76:0/1011600008 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7f763c08c1b0 con 0x7f764c09d390 2026-02-25T17:21:29.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.116+0000 7f9626627640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f962009d390 0x7f9620134cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.116+0000 7f9626627640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f962012e530 0x7f96201351f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.116+0000 7f9626627640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f962012ee50 0x7f962012fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:29.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.116+0000 7f9626627640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9620132200 con 0x7f962012e530 2026-02-25T17:21:29.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.116+0000 7f9626627640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96201327a0 con 0x7f962009d390 2026-02-25T17:21:29.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.116+0000 7f9626627640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96201329d0 con 0x7f962012ee50 2026-02-25T17:21:29.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.116+0000 7f961ffff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f962009d390 0x7f9620134cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.116+0000 7f9624b9d640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f962012ee50 0x7f962012fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.116+0000 7f961ffff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f962009d390 0x7f9620134cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50648/0 (socket says 10.20.193.76:50648) 2026-02-25T17:21:29.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.116+0000 7f961ffff640 1 -- 10.20.193.76:0/2453147739 learned_addr learned my addr 10.20.193.76:0/2453147739 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:29.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.116+0000 7f961f7fe640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f962012e530 0x7f96201351f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:29.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.116+0000 7f961ffff640 1 -- 10.20.193.76:0/2453147739 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f962012ee50 msgr2=0x7f962012fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.116+0000 7f961ffff640 1 --2- 10.20.193.76:0/2453147739 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f962012ee50 0x7f962012fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.116+0000 7f961ffff640 1 -- 10.20.193.76:0/2453147739 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f962012e530 msgr2=0x7f96201351f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.116+0000 7f961ffff640 1 --2- 10.20.193.76:0/2453147739 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f962012e530 0x7f96201351f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.157 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.116+0000 7f961ffff640 1 -- 10.20.193.76:0/2453147739 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c009500 con 0x7f962009d390 2026-02-25T17:21:29.158 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.116+0000 7f961ffff640 1 --2- 10.20.193.76:0/2453147739 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f962009d390 0x7f9620134cb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f960c0099d0 tx=0x7f960c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:29.158 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.116+0000 7fe4497fa640 1 -- 10.20.193.76:0/1827123609 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7fe454126890 con 0x7fe454095060 2026-02-25T17:21:29.158 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.118+0000 7f763a7fc640 1 -- 10.20.193.76:0/1011600008 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f763c0699d0 con 0x7f764c09d390 2026-02-25T17:21:29.158 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.118+0000 7f961cff9640 1 -- 10.20.193.76:0/2453147739 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c040870 con 0x7f962009d390 2026-02-25T17:21:29.158 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.118+0000 7f961cff9640 1 -- 10.20.193.76:0/2453147739 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c0409f0 con 0x7f962009d390 2026-02-25T17:21:29.159 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.118+0000 7f9626627640 1 -- 10.20.193.76:0/2453147739 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9620131a40 con 0x7f962009d390 2026-02-25T17:21:29.159 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.118+0000 7f961cff9640 1 -- 10.20.193.76:0/2453147739 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c040da0 con 0x7f962009d390 2026-02-25T17:21:29.159 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.118+0000 7f294affd640 1 -- 10.20.193.76:0/3472945753 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f2960040710 con 0x7f29640990e0 2026-02-25T17:21:29.159 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.118+0000 7f9626627640 1 -- 10.20.193.76:0/2453147739 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962012bd40 con 0x7f962009d390 2026-02-25T17:21:29.159 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.119+0000 7f9626627640 1 -- 10.20.193.76:0/2453147739 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962012e910 con 0x7f962009d390 2026-02-25T17:21:29.159 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.119+0000 7f961cff9640 1 -- 10.20.193.76:0/2453147739 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f960c04c460 con 0x7f962009d390 2026-02-25T17:21:29.160 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.119+0000 7f961cff9640 1 -- 10.20.193.76:0/2453147739 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7f960c069b30 con 0x7f962009d390 2026-02-25T17:21:29.160 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.121+0000 7f961cff9640 1 -- 10.20.193.76:0/2453147739 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f960c0668d0 con 0x7f962009d390 2026-02-25T17:21:29.185 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.182+0000 7fe45addc640 1 -- 10.20.193.76:0/1827123609 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe454126890 con 0x7fe454095060 2026-02-25T17:21:29.185 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.183+0000 7fe4497fa640 1 -- 10.20.193.76:0/1827123609 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe454126890 con 0x7fe454095060 2026-02-25T17:21:29.185 INFO:teuthology.orchestra.run.trial076.stdout:94489280514 2026-02-25T17:21:29.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.184+0000 7fe45addc640 1 -- 10.20.193.76:0/1827123609 >> v1:10.20.193.76:6800/1563581135 conn(0x7fe42404f880 legacy=0x7fe424051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.184+0000 7fe45addc640 1 -- 10.20.193.76:0/1827123609 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe454095060 msgr2=0x7fe454124240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.184+0000 7fe45addc640 1 --2- 10.20.193.76:0/1827123609 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe454095060 0x7fe454124240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00ebe0 tx=0x7fe43c00c520 comp rx=0 tx=0).stop 2026-02-25T17:21:29.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.184+0000 7fe45addc640 1 -- 10.20.193.76:0/1827123609 shutdown_connections 2026-02-25T17:21:29.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.184+0000 7fe45addc640 1 --2- 10.20.193.76:0/1827123609 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe454096cc0 0x7fe454124780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.184+0000 7fe45addc640 1 --2- 10.20.193.76:0/1827123609 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe454095060 0x7fe454124240 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.184+0000 7fe45addc640 1 --2- 10.20.193.76:0/1827123609 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe454094740 0x7fe454123d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.184+0000 7fe45addc640 1 -- 10.20.193.76:0/1827123609 >> 10.20.193.76:0/1827123609 conn(0x7fe45409d1d0 msgr2=0x7fe454091dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:29.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.184+0000 7fe45addc640 1 -- 10.20.193.76:0/1827123609 shutdown_connections 2026-02-25T17:21:29.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.184+0000 7fe45addc640 1 -- 10.20.193.76:0/1827123609 wait complete. 2026-02-25T17:21:29.188 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.186+0000 7f296c758640 1 -- 10.20.193.76:0/3472945753 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f29641273c0 con 0x7f29640990e0 2026-02-25T17:21:29.188 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.186+0000 7f294affd640 1 -- 10.20.193.76:0/3472945753 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+2 (secure 0 0 0) 0x7f2960068030 con 0x7f29640990e0 2026-02-25T17:21:29.188 INFO:teuthology.orchestra.run.trial076.stdout:1 2026-02-25T17:21:29.189 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.187+0000 7f9626627640 1 -- 10.20.193.76:0/2453147739 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f96200681d0 con 0x7f962009d390 2026-02-25T17:21:29.189 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.187+0000 7f961cff9640 1 -- 10.20.193.76:0/2453147739 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f960c066a70 con 0x7f962009d390 2026-02-25T17:21:29.189 INFO:teuthology.orchestra.run.trial076.stdout:103079215106 2026-02-25T17:21:29.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.187+0000 7f296c758640 1 -- 10.20.193.76:0/3472945753 >> v1:10.20.193.76:6800/1563581135 conn(0x7f293404f880 legacy=0x7f2934051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.187+0000 7f296c758640 1 -- 10.20.193.76:0/3472945753 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f29640990e0 msgr2=0x7f2964124bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.187+0000 7f296c758640 1 --2- 10.20.193.76:0/3472945753 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f29640990e0 0x7f2964124bb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f296000eed0 tx=0x7f296000b480 comp rx=0 tx=0).stop 2026-02-25T17:21:29.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.187+0000 7f296c758640 1 -- 10.20.193.76:0/3472945753 shutdown_connections 2026-02-25T17:21:29.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.187+0000 7f296c758640 1 --2- 10.20.193.76:0/3472945753 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f29640990e0 0x7f2964124bb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.187+0000 7f296c758640 1 --2- 10.20.193.76:0/3472945753 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f296406d800 0x7f2964124670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.187+0000 7f296c758640 1 --2- 10.20.193.76:0/3472945753 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f296406c9a0 0x7f2964124130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.187+0000 7f296c758640 1 -- 10.20.193.76:0/3472945753 >> 10.20.193.76:0/3472945753 conn(0x7f296409d120 msgr2=0x7f2964099880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:29.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.187+0000 7f7653c1e640 1 -- 10.20.193.76:0/1011600008 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f764c12e910 con 0x7f764c09d390 2026-02-25T17:21:29.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.187+0000 7f296c758640 1 -- 10.20.193.76:0/3472945753 shutdown_connections 2026-02-25T17:21:29.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.188+0000 7f296c758640 1 -- 10.20.193.76:0/3472945753 wait complete. 2026-02-25T17:21:29.192 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.188+0000 7f763a7fc640 1 -- 10.20.193.76:0/1011600008 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f763c03c090 con 0x7f764c09d390 2026-02-25T17:21:29.192 INFO:teuthology.orchestra.run.trial076.stdout:98784247810 2026-02-25T17:21:29.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.188+0000 7f9626627640 1 -- 10.20.193.76:0/2453147739 >> v1:10.20.193.76:6800/1563581135 conn(0x7f95f004f880 legacy=0x7f95f0051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.188+0000 7f9626627640 1 -- 10.20.193.76:0/2453147739 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f962009d390 msgr2=0x7f9620134cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.188+0000 7f9626627640 1 --2- 10.20.193.76:0/2453147739 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f962009d390 0x7f9620134cb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f960c0099d0 tx=0x7f960c0047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.188+0000 7f9626627640 1 -- 10.20.193.76:0/2453147739 shutdown_connections 2026-02-25T17:21:29.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.188+0000 7f9626627640 1 --2- 10.20.193.76:0/2453147739 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f962012ee50 0x7f962012fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.188+0000 7f9626627640 1 --2- 10.20.193.76:0/2453147739 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f962012e530 0x7f96201351f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.188+0000 7f9626627640 1 --2- 10.20.193.76:0/2453147739 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f962009d390 0x7f9620134cb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.188+0000 7f9626627640 1 -- 10.20.193.76:0/2453147739 >> 10.20.193.76:0/2453147739 conn(0x7f962009e130 msgr2=0x7f9620098c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:29.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.188+0000 7f9626627640 1 -- 10.20.193.76:0/2453147739 shutdown_connections 2026-02-25T17:21:29.193 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.188+0000 7f9626627640 1 -- 10.20.193.76:0/2453147739 wait complete. 2026-02-25T17:21:29.194 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.189+0000 7f7653c1e640 1 -- 10.20.193.76:0/1011600008 >> v1:10.20.193.76:6800/1563581135 conn(0x7f761c04f880 legacy=0x7f761c051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.194 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.189+0000 7f7653c1e640 1 -- 10.20.193.76:0/1011600008 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f764c09d390 msgr2=0x7f764c097a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:29.195 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.189+0000 7f7653c1e640 1 --2- 10.20.193.76:0/1011600008 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f764c09d390 0x7f764c097a30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f763c009130 tx=0x7f763c0047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.195 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.189+0000 7f7653c1e640 1 -- 10.20.193.76:0/1011600008 shutdown_connections 2026-02-25T17:21:29.195 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.189+0000 7f7653c1e640 1 --2- 10.20.193.76:0/1011600008 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f764c12ee50 0x7f764c12fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.195 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.189+0000 7f7653c1e640 1 --2- 10.20.193.76:0/1011600008 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f764c12e530 0x7f764c12fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.195 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.189+0000 7f7653c1e640 1 --2- 10.20.193.76:0/1011600008 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f764c09d390 0x7f764c097a30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:29.195 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.189+0000 7f7653c1e640 1 -- 10.20.193.76:0/1011600008 >> 10.20.193.76:0/1011600008 conn(0x7f764c09e130 msgr2=0x7f764c09fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:29.195 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.189+0000 7f7653c1e640 1 -- 10.20.193.76:0/1011600008 shutdown_connections 2026-02-25T17:21:29.195 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:29.189+0000 7f7653c1e640 1 -- 10.20.193.76:0/1011600008 wait complete. 2026-02-25T17:21:29.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280514 for osd.0 2026-02-25T17:21:29.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215107 got 103079215106 for osd.2 2026-02-25T17:21:29.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182403 got 1 for osd.3 2026-02-25T17:21:29.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247811 got 98784247810 for osd.1 2026-02-25T17:21:30.197 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-25T17:21:30.198 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-25T17:21:30.199 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-25T17:21:30.201 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-25T17:21:30.267 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.264+0000 7f3a4d449640 1 Processor -- start 2026-02-25T17:21:30.267 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.264+0000 7f3a4d449640 1 -- start start 2026-02-25T17:21:30.268 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.264+0000 7fe9a3bd7640 1 Processor -- start 2026-02-25T17:21:30.269 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.264+0000 7fe9a3bd7640 1 -- start start 2026-02-25T17:21:30.270 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.264+0000 7f3a4d449640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3a4806f4e0 0x7f3a4806f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.270 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.264+0000 7f3a4d449640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f3a4806fe00 0x7f3a48097460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.270 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.264+0000 7f3a4d449640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3a480979a0 0x7f3a48097e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.270 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.264+0000 7f3a4d449640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a48075540 con 0x7f3a4806fe00 2026-02-25T17:21:30.270 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.264+0000 7f3a4d449640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4804eb10 con 0x7f3a480979a0 2026-02-25T17:21:30.271 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.264+0000 7f3a4d449640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a48070a50 con 0x7f3a4806f4e0 2026-02-25T17:21:30.272 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.264+0000 7fe9a3bd7640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fe99c0716c0 0x7fe99c071aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.272 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fe9a3bd7640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe99c12c8f0 0x7fe99c12cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.272 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fe9a3bd7640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe99c09fb90 con 0x7fe99c071fe0 2026-02-25T17:21:30.272 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fe9a3bd7640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe99c070e80 con 0x7fe99c0716c0 2026-02-25T17:21:30.273 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7f3a467fc640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f3a4806fe00 0x7f3a48097460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.273 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7f3a46ffd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3a4806f4e0 0x7f3a4806f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.273 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7f3a477fe640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3a480979a0 0x7f3a48097e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.274 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fe9a3bd7640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c071190 con 0x7fe99c12c8f0 2026-02-25T17:21:30.274 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7f3a46ffd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3a4806f4e0 0x7f3a4806f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39220/0 (socket says 10.20.193.76:39220) 2026-02-25T17:21:30.275 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7f3a477fe640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3a480979a0 0x7f3a48097e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50660/0 (socket says 10.20.193.76:50660) 2026-02-25T17:21:30.275 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7f3a46ffd640 1 -- 10.20.193.76:0/1040166740 learned_addr learned my addr 10.20.193.76:0/1040166740 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:30.276 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fe9a194c640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fe99c0716c0 0x7fe99c071aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.276 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fe9a214d640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe99c12c8f0 0x7fe99c12cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.276 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fe9a194c640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fe99c0716c0 0x7fe99c071aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:35970/0 (socket says 10.20.193.76:35970) 2026-02-25T17:21:30.276 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fe9a114b640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7fe99c071fe0 0x7fe99c12c1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:60962/0 (socket says 10.20.193.76:60962) 2026-02-25T17:21:30.276 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fe9a194c640 1 -- 10.20.193.76:0/1874927044 learned_addr learned my addr 10.20.193.76:0/1874927044 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:30.277 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fd92470b640 1 Processor -- start 2026-02-25T17:21:30.278 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7f3a477fe640 1 -- 10.20.193.76:0/1040166740 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3a4806f4e0 msgr2=0x7f3a4806f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:30.278 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7f3a477fe640 1 --2- 10.20.193.76:0/1040166740 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3a4806f4e0 0x7f3a4806f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.278 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7f3a477fe640 1 -- 10.20.193.76:0/1040166740 >> v2:10.20.193.76:3300/0 conn(0x7f3a4806fe00 msgr2=0x7f3a48097460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:30.278 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7f3a477fe640 1 --2- 10.20.193.76:0/1040166740 >> v2:10.20.193.76:3300/0 conn(0x7f3a4806fe00 0x7f3a48097460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.279 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7f3a477fe640 1 -- 10.20.193.76:0/1040166740 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4806bd70 con 0x7f3a480979a0 2026-02-25T17:21:30.279 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7f3a467fc640 1 --2- 10.20.193.76:0/1040166740 >> v2:10.20.193.76:3300/0 conn(0x7f3a4806fe00 0x7f3a48097460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:30.280 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fe9a194c640 1 -- 10.20.193.76:0/1874927044 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe99c12c8f0 msgr2=0x7fe99c12cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:30.280 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fe9a194c640 1 --2- 10.20.193.76:0/1874927044 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe99c12c8f0 0x7fe99c12cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.280 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fe9a194c640 1 -- 10.20.193.76:0/1874927044 >> v1:10.20.193.76:6789/0 conn(0x7fe99c071fe0 legacy=0x7fe99c12c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.280 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fe9a194c640 1 -- 10.20.193.76:0/1874927044 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c0723f0 con 0x7fe99c0716c0 2026-02-25T17:21:30.280 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fe9a214d640 1 --2- 10.20.193.76:0/1874927044 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe99c12c8f0 0x7fe99c12cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:30.281 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fd92470b640 1 -- start start 2026-02-25T17:21:30.281 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7f3a477fe640 1 --2- 10.20.193.76:0/1040166740 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3a480979a0 0x7f3a48097e10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009df0 tx=0x7f3a3802f200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e8252a061f55b06 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:30.282 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fd92470b640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd91c12c440 0x7fd91c12c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.282 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fd92470b640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fd91c12cd60 0x7fd91c06b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.283 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fd92470b640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91c0719b0 con 0x7fd91c06bd90 2026-02-25T17:21:30.283 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fd92470b640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91c0723b0 con 0x7fd91c12cd60 2026-02-25T17:21:30.283 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fe9a194c640 1 --2- 10.20.193.76:0/1874927044 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe99c0716c0 0x7fe99c071aa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009970 tx=0x7fe98c02ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996cb4c079ed2a10 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:30.284 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fd92470b640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c12c220 con 0x7fd91c12c440 2026-02-25T17:21:30.285 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7f3a45ffb640 1 -- 10.20.193.76:0/1040166740 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38006ea0 con 0x7f3a480979a0 2026-02-25T17:21:30.285 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7f3a45ffb640 1 -- 10.20.193.76:0/1040166740 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3802fe30 con 0x7f3a480979a0 2026-02-25T17:21:30.285 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7f3a45ffb640 1 -- 10.20.193.76:0/1040166740 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a38037660 con 0x7f3a480979a0 2026-02-25T17:21:30.286 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fd921c7f640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fd91c12cd60 0x7fd91c06b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.286 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fd922c81640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7fd91c06bd90 0x7fd91c133510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:60976/0 (socket says 10.20.193.76:60976) 2026-02-25T17:21:30.286 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fd922c81640 1 -- 10.20.193.76:0/3836414999 learned_addr learned my addr 10.20.193.76:0/3836414999 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:30.286 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fd922480640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd91c12c440 0x7fd91c12c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.287 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fe9a094a640 1 -- 10.20.193.76:0/1874927044 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c02fb10 con 0x7fe99c0716c0 2026-02-25T17:21:30.287 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fe9a094a640 1 -- 10.20.193.76:0/1874927044 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98c02fc70 con 0x7fe99c0716c0 2026-02-25T17:21:30.287 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.265+0000 7fe9a094a640 1 -- 10.20.193.76:0/1874927044 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c037440 con 0x7fe99c0716c0 2026-02-25T17:21:30.289 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fd921c7f640 1 -- 10.20.193.76:0/3836414999 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd91c12c440 msgr2=0x7fd91c12c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:30.289 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fd921c7f640 1 --2- 10.20.193.76:0/3836414999 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd91c12c440 0x7fd91c12c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.289 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fd921c7f640 1 -- 10.20.193.76:0/3836414999 >> v1:10.20.193.76:6789/0 conn(0x7fd91c06bd90 legacy=0x7fd91c133510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.289 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fd92147e640 1 -- 10.20.193.76:0/3836414999 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283298695 0 0) 0x7fd91c0719b0 con 0x7fd91c06bd90 2026-02-25T17:21:30.289 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fd921c7f640 1 -- 10.20.193.76:0/3836414999 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c114ba0 con 0x7fd91c12cd60 2026-02-25T17:21:30.290 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fd922480640 1 --2- 10.20.193.76:0/3836414999 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd91c12c440 0x7fd91c12c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:30.291 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7f3a4d449640 1 -- 10.20.193.76:0/1040166740 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3a480979a0 msgr2=0x7f3a48097e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.291 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7f3a4d449640 1 --2- 10.20.193.76:0/1040166740 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3a480979a0 0x7f3a48097e10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009df0 tx=0x7f3a3802f200 comp rx=0 tx=0).stop 2026-02-25T17:21:30.291 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7f3a4d449640 1 -- 10.20.193.76:0/1040166740 shutdown_connections 2026-02-25T17:21:30.292 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7f3a4d449640 1 --2- 10.20.193.76:0/1040166740 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3a480979a0 0x7f3a48097e10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.292 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7f3a4d449640 1 --2- 10.20.193.76:0/1040166740 >> v2:10.20.193.76:3300/0 conn(0x7f3a4806fe00 0x7f3a48097460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.292 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7f3a4d449640 1 --2- 10.20.193.76:0/1040166740 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3a4806f4e0 0x7f3a4806f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.292 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7f3a4d449640 1 -- 10.20.193.76:0/1040166740 >> 10.20.193.76:0/1040166740 conn(0x7f3a4809db70 msgr2=0x7f3a4809df80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:30.292 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7f3a4d449640 1 -- 10.20.193.76:0/1040166740 shutdown_connections 2026-02-25T17:21:30.292 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7f3a4d449640 1 -- 10.20.193.76:0/1040166740 wait complete. 2026-02-25T17:21:30.294 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fe9a3bd7640 1 -- 10.20.193.76:0/1874927044 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe99c0716c0 msgr2=0x7fe99c071aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.294 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fe9a3bd7640 1 --2- 10.20.193.76:0/1874927044 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe99c0716c0 0x7fe99c071aa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009970 tx=0x7fe98c02ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:30.294 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fe9a3bd7640 1 -- 10.20.193.76:0/1874927044 shutdown_connections 2026-02-25T17:21:30.294 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fe9a3bd7640 1 --2- 10.20.193.76:0/1874927044 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe99c12c8f0 0x7fe99c12cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.294 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fe9a3bd7640 1 --2- 10.20.193.76:0/1874927044 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe99c0716c0 0x7fe99c071aa0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.295 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fe9a3bd7640 1 -- 10.20.193.76:0/1874927044 >> 10.20.193.76:0/1874927044 conn(0x7fe99c09ed20 msgr2=0x7fe99c09f130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:30.295 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fe9a3bd7640 1 -- 10.20.193.76:0/1874927044 shutdown_connections 2026-02-25T17:21:30.295 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fe9a3bd7640 1 -- 10.20.193.76:0/1874927044 wait complete. 2026-02-25T17:21:30.296 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fd921c7f640 1 --2- 10.20.193.76:0/3836414999 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd91c12cd60 0x7fd91c06b850 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd9100098a0 tx=0x7fd91002ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a34bad1cefb994 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:30.296 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fd92147e640 1 -- 10.20.193.76:0/3836414999 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91002fa40 con 0x7fd91c12cd60 2026-02-25T17:21:30.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fd92147e640 1 -- 10.20.193.76:0/3836414999 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91002fba0 con 0x7fd91c12cd60 2026-02-25T17:21:30.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fd92147e640 1 -- 10.20.193.76:0/3836414999 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910037440 con 0x7fd91c12cd60 2026-02-25T17:21:30.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fd92470b640 1 -- 10.20.193.76:0/3836414999 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd91c12cd60 msgr2=0x7fd91c06b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.297 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fd92470b640 1 --2- 10.20.193.76:0/3836414999 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd91c12cd60 0x7fd91c06b850 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd9100098a0 tx=0x7fd91002ed80 comp rx=0 tx=0).stop 2026-02-25T17:21:30.298 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7f3a4d449640 1 Processor -- start 2026-02-25T17:21:30.298 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fd92470b640 1 -- 10.20.193.76:0/3836414999 shutdown_connections 2026-02-25T17:21:30.299 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fd92470b640 1 --2- 10.20.193.76:0/3836414999 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd91c12cd60 0x7fd91c06b850 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.299 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fd92470b640 1 --2- 10.20.193.76:0/3836414999 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd91c12c440 0x7fd91c12c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.299 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fd92470b640 1 -- 10.20.193.76:0/3836414999 >> 10.20.193.76:0/3836414999 conn(0x7fd91c09ba70 msgr2=0x7fd91c09be80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:30.299 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fd92470b640 1 -- 10.20.193.76:0/3836414999 shutdown_connections 2026-02-25T17:21:30.299 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7f3a4d449640 1 -- start start 2026-02-25T17:21:30.300 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fd92470b640 1 -- 10.20.193.76:0/3836414999 wait complete. 2026-02-25T17:21:30.300 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.266+0000 7fe9a3bd7640 1 Processor -- start 2026-02-25T17:21:30.300 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a3bd7640 1 -- start start 2026-02-25T17:21:30.302 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a4d449640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3a4806f4e0 0x7f3a48123710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.302 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a4d449640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3a4806fe00 0x7f3a48123c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.302 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a4d449640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3a480979a0 0x7f3a48124190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.302 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a4d449640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a48124ed0 con 0x7f3a4806fe00 2026-02-25T17:21:30.302 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a4d449640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a48129b00 con 0x7f3a480979a0 2026-02-25T17:21:30.302 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a4d449640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a480722a0 con 0x7f3a4806f4e0 2026-02-25T17:21:30.302 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a467fc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3a4806fe00 0x7f3a48123c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.302 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a46ffd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3a4806f4e0 0x7f3a48123710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.302 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a467fc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3a4806fe00 0x7f3a48123c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:35992/0 (socket says 10.20.193.76:35992) 2026-02-25T17:21:30.302 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a467fc640 1 -- 10.20.193.76:0/689811851 learned_addr learned my addr 10.20.193.76:0/689811851 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:30.302 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a477fe640 1 --2- 10.20.193.76:0/689811851 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3a480979a0 0x7f3a48124190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.303 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a3bd7640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe99c0716c0 0x7fe99c131da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.303 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a3bd7640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe99c071fe0 0x7fe99c1322e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.303 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a3bd7640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe99c12c8f0 0x7fe99c132820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.303 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a3bd7640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c130880 con 0x7fe99c071fe0 2026-02-25T17:21:30.303 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a3bd7640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c1312a0 con 0x7fe99c0716c0 2026-02-25T17:21:30.303 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a3bd7640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c0729b0 con 0x7fe99c12c8f0 2026-02-25T17:21:30.304 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a46ffd640 1 -- 10.20.193.76:0/689811851 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3a480979a0 msgr2=0x7f3a48124190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.304 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a46ffd640 1 --2- 10.20.193.76:0/689811851 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3a480979a0 0x7f3a48124190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.304 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a46ffd640 1 -- 10.20.193.76:0/689811851 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3a4806fe00 msgr2=0x7f3a48123c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.304 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a46ffd640 1 --2- 10.20.193.76:0/689811851 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3a4806fe00 0x7f3a48123c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.304 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fd92470b640 1 Processor -- start 2026-02-25T17:21:30.305 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a46ffd640 1 -- 10.20.193.76:0/689811851 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a30009500 con 0x7f3a4806f4e0 2026-02-25T17:21:30.305 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a467fc640 1 --2- 10.20.193.76:0/689811851 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3a4806fe00 0x7f3a48123c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:30.305 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a194c640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe99c0716c0 0x7fe99c131da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.305 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a114b640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe99c071fe0 0x7fe99c1322e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.305 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a214d640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe99c12c8f0 0x7fe99c132820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.305 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a194c640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe99c0716c0 0x7fe99c131da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50686/0 (socket says 10.20.193.76:50686) 2026-02-25T17:21:30.305 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a194c640 1 -- 10.20.193.76:0/1851437347 learned_addr learned my addr 10.20.193.76:0/1851437347 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:30.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a46ffd640 1 --2- 10.20.193.76:0/689811851 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3a4806f4e0 0x7f3a48123710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c006dc0 tx=0x7f3a3c00ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:30.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fd92470b640 1 -- start start 2026-02-25T17:21:30.306 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a277fe640 1 -- 10.20.193.76:0/689811851 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c00c8b0 con 0x7f3a4806f4e0 2026-02-25T17:21:30.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a114b640 1 -- 10.20.193.76:0/1851437347 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe99c12c8f0 msgr2=0x7fe99c132820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a114b640 1 --2- 10.20.193.76:0/1851437347 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe99c12c8f0 0x7fe99c132820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a114b640 1 -- 10.20.193.76:0/1851437347 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe99c0716c0 msgr2=0x7fe99c131da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a114b640 1 --2- 10.20.193.76:0/1851437347 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe99c0716c0 0x7fe99c131da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.307 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a114b640 1 -- 10.20.193.76:0/1851437347 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe998009a70 con 0x7fe99c071fe0 2026-02-25T17:21:30.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a277fe640 1 -- 10.20.193.76:0/689811851 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c00ca10 con 0x7f3a4806f4e0 2026-02-25T17:21:30.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a194c640 1 --2- 10.20.193.76:0/1851437347 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe99c0716c0 0x7fe99c131da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:30.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a4d449640 1 -- 10.20.193.76:0/689811851 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a38009a70 con 0x7f3a4806f4e0 2026-02-25T17:21:30.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a277fe640 1 -- 10.20.193.76:0/689811851 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c00cda0 con 0x7f3a4806f4e0 2026-02-25T17:21:30.308 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7f3a4d449640 1 -- 10.20.193.76:0/689811851 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a48126140 con 0x7f3a4806f4e0 2026-02-25T17:21:30.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a114b640 1 --2- 10.20.193.76:0/1851437347 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe99c071fe0 0x7fe99c1322e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe99000c700 tx=0x7fe99000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:30.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fd92470b640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd91c06bd90 0x7fd91c06f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.309 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe98a7fc640 1 -- 10.20.193.76:0/1851437347 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe990004ae0 con 0x7fe99c071fe0 2026-02-25T17:21:30.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fd92470b640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd91c12c440 0x7fd91c06fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fd92470b640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd91c12cd60 0x7fd91c1c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fd92470b640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c071080 con 0x7fd91c12cd60 2026-02-25T17:21:30.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fd92470b640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c071520 con 0x7fd91c06bd90 2026-02-25T17:21:30.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fd92470b640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c11d890 con 0x7fd91c12c440 2026-02-25T17:21:30.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe98a7fc640 1 -- 10.20.193.76:0/1851437347 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe990004c40 con 0x7fe99c071fe0 2026-02-25T17:21:30.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a3bd7640 1 -- 10.20.193.76:0/1851437347 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98c0095d0 con 0x7fe99c071fe0 2026-02-25T17:21:30.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe98a7fc640 1 -- 10.20.193.76:0/1851437347 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe990003550 con 0x7fe99c071fe0 2026-02-25T17:21:30.310 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fe9a3bd7640 1 -- 10.20.193.76:0/1851437347 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99c12f4d0 con 0x7fe99c071fe0 2026-02-25T17:21:30.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fd922c81640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd91c12cd60 0x7fd91c1c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fd922480640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd91c06bd90 0x7fd91c06f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fd921c7f640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd91c12c440 0x7fd91c06fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fd922c81640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd91c12cd60 0x7fd91c1c4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:36010/0 (socket says 10.20.193.76:36010) 2026-02-25T17:21:30.311 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fd922c81640 1 -- 10.20.193.76:0/271521639 learned_addr learned my addr 10.20.193.76:0/271521639 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:30.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fd922c81640 1 -- 10.20.193.76:0/271521639 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd91c12c440 msgr2=0x7fd91c06fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fd922c81640 1 --2- 10.20.193.76:0/271521639 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd91c12c440 0x7fd91c06fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fd922c81640 1 -- 10.20.193.76:0/271521639 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd91c06bd90 msgr2=0x7fd91c06f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fd922c81640 1 --2- 10.20.193.76:0/271521639 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd91c06bd90 0x7fd91c06f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.267+0000 7fd922c81640 1 -- 10.20.193.76:0/271521639 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c009500 con 0x7fd91c12cd60 2026-02-25T17:21:30.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.268+0000 7fd921c7f640 1 --2- 10.20.193.76:0/271521639 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd91c12c440 0x7fd91c06fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:30.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.268+0000 7fd922480640 1 --2- 10.20.193.76:0/271521639 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd91c06bd90 0x7fd91c06f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:30.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.268+0000 7fd922c81640 1 --2- 10.20.193.76:0/271521639 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd91c12cd60 0x7fd91c1c4f10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd91800cc50 tx=0x7fd91800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:30.312 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.268+0000 7f3a4d449640 1 -- 10.20.193.76:0/689811851 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a48097460 con 0x7f3a4806f4e0 2026-02-25T17:21:30.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.268+0000 7fd902ffd640 1 -- 10.20.193.76:0/271521639 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91800ce70 con 0x7fd91c12cd60 2026-02-25T17:21:30.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.268+0000 7fd902ffd640 1 -- 10.20.193.76:0/271521639 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9180070d0 con 0x7fd91c12cd60 2026-02-25T17:21:30.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.268+0000 7fd902ffd640 1 -- 10.20.193.76:0/271521639 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9180074a0 con 0x7fd91c12cd60 2026-02-25T17:21:30.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.268+0000 7fd92470b640 1 -- 10.20.193.76:0/271521639 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd910009500 con 0x7fd91c12cd60 2026-02-25T17:21:30.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.268+0000 7fd92470b640 1 -- 10.20.193.76:0/271521639 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91c11c470 con 0x7fd91c12cd60 2026-02-25T17:21:30.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.268+0000 7f3a277fe640 1 -- 10.20.193.76:0/689811851 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f3a3c011070 con 0x7f3a4806f4e0 2026-02-25T17:21:30.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.268+0000 7fe9a3bd7640 1 -- 10.20.193.76:0/1851437347 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99c071aa0 con 0x7fe99c071fe0 2026-02-25T17:21:30.313 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.268+0000 7fe98a7fc640 1 -- 10.20.193.76:0/1851437347 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fe990007070 con 0x7fe99c071fe0 2026-02-25T17:21:30.314 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.268+0000 7f3a277fe640 1 -- 10.20.193.76:0/689811851 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7f3a3c0666d0 con 0x7f3a4806f4e0 2026-02-25T17:21:30.314 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.268+0000 7fd92470b640 1 -- 10.20.193.76:0/271521639 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91c12c820 con 0x7fd91c12cd60 2026-02-25T17:21:30.314 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.268+0000 7fe98a7fc640 1 -- 10.20.193.76:0/1851437347 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7fe990065d10 con 0x7fe99c071fe0 2026-02-25T17:21:30.314 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.269+0000 7fd902ffd640 1 -- 10.20.193.76:0/271521639 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fd918007600 con 0x7fd91c12cd60 2026-02-25T17:21:30.314 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.269+0000 7fd902ffd640 1 -- 10.20.193.76:0/271521639 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7fd918066650 con 0x7fd91c12cd60 2026-02-25T17:21:30.315 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.270+0000 7f3a277fe640 1 -- 10.20.193.76:0/689811851 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f3a3c040170 con 0x7f3a4806f4e0 2026-02-25T17:21:30.315 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.270+0000 7fe98a7fc640 1 -- 10.20.193.76:0/1851437347 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7fe99003f690 con 0x7fe99c071fe0 2026-02-25T17:21:30.315 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.272+0000 7fd902ffd640 1 -- 10.20.193.76:0/271521639 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7fd91803fff0 con 0x7fd91c12cd60 2026-02-25T17:21:30.317 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.309+0000 7fe4bf5e5640 1 Processor -- start 2026-02-25T17:21:30.317 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.309+0000 7fe4bf5e5640 1 -- start start 2026-02-25T17:21:30.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.309+0000 7fe4bf5e5640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe4b806dfd0 0x7fe4b806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.309+0000 7fe4bf5e5640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe4b80987e0 0x7fe4b8134710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.309+0000 7fe4bf5e5640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b809d9a0 con 0x7fe4b806e8f0 2026-02-25T17:21:30.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.309+0000 7fe4bf5e5640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b8099190 con 0x7fe4b80987e0 2026-02-25T17:21:30.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.309+0000 7fe4bf5e5640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b808c910 con 0x7fe4b806dfd0 2026-02-25T17:21:30.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.309+0000 7fe4bdb5b640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe4b80987e0 0x7fe4b8134710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.309+0000 7fe4bd35a640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe4b806dfd0 0x7fe4b806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.309+0000 7fe4bdb5b640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe4b80987e0 0x7fe4b8134710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50710/0 (socket says 10.20.193.76:50710) 2026-02-25T17:21:30.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.309+0000 7fe4bdb5b640 1 -- 10.20.193.76:0/2645473985 learned_addr learned my addr 10.20.193.76:0/2645473985 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:30.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.310+0000 7fe4bdb5b640 1 -- 10.20.193.76:0/2645473985 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe4b806dfd0 msgr2=0x7fe4b806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:30.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.310+0000 7fe4bdb5b640 1 --2- 10.20.193.76:0/2645473985 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe4b806dfd0 0x7fe4b806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.310+0000 7fe4bdb5b640 1 -- 10.20.193.76:0/2645473985 >> v1:10.20.193.76:6789/0 conn(0x7fe4b806e8f0 legacy=0x7fe4b80980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.310+0000 7fe4bdb5b640 1 -- 10.20.193.76:0/2645473985 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b8072260 con 0x7fe4b80987e0 2026-02-25T17:21:30.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.310+0000 7fe4bdb5b640 1 --2- 10.20.193.76:0/2645473985 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe4b80987e0 0x7fe4b8134710 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009eb0 tx=0x7fe4b402f310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7b95143d029c13e server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:30.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.310+0000 7fe4a7fff640 1 -- 10.20.193.76:0/2645473985 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4006ea0 con 0x7fe4b80987e0 2026-02-25T17:21:30.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.310+0000 7fe4a7fff640 1 -- 10.20.193.76:0/2645473985 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b402fd30 con 0x7fe4b80987e0 2026-02-25T17:21:30.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.310+0000 7fe4a7fff640 1 -- 10.20.193.76:0/2645473985 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b402fea0 con 0x7fe4b80987e0 2026-02-25T17:21:30.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.310+0000 7fe4bf5e5640 1 -- 10.20.193.76:0/2645473985 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe4b80987e0 msgr2=0x7fe4b8134710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.310+0000 7fe4bf5e5640 1 --2- 10.20.193.76:0/2645473985 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe4b80987e0 0x7fe4b8134710 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4009eb0 tx=0x7fe4b402f310 comp rx=0 tx=0).stop 2026-02-25T17:21:30.318 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.310+0000 7fe4bf5e5640 1 -- 10.20.193.76:0/2645473985 shutdown_connections 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.310+0000 7fe4bf5e5640 1 --2- 10.20.193.76:0/2645473985 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe4b80987e0 0x7fe4b8134710 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.310+0000 7fe4bf5e5640 1 --2- 10.20.193.76:0/2645473985 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe4b806dfd0 0x7fe4b806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.310+0000 7fe4bf5e5640 1 -- 10.20.193.76:0/2645473985 >> 10.20.193.76:0/2645473985 conn(0x7fe4b809a960 msgr2=0x7fe4b809ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.310+0000 7fe4bf5e5640 1 -- 10.20.193.76:0/2645473985 shutdown_connections 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.310+0000 7fe4bf5e5640 1 -- 10.20.193.76:0/2645473985 wait complete. 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4bf5e5640 1 Processor -- start 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4bf5e5640 1 -- start start 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4bf5e5640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe4b806dfd0 0x7fe4b8095350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4bf5e5640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe4b806e8f0 0x7fe4b8095890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4bf5e5640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe4b80987e0 0x7fe4b806f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4bf5e5640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b8071480 con 0x7fe4b806dfd0 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4bf5e5640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b8095dd0 con 0x7fe4b80987e0 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4bf5e5640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b8126b10 con 0x7fe4b806e8f0 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4bd35a640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe4b806dfd0 0x7fe4b8095350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4bd35a640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe4b806dfd0 0x7fe4b8095350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:36018/0 (socket says 10.20.193.76:36018) 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4bdb5b640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe4b80987e0 0x7fe4b806f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4bd35a640 1 -- 10.20.193.76:0/1221226549 learned_addr learned my addr 10.20.193.76:0/1221226549 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4bcb59640 1 --2- 10.20.193.76:0/1221226549 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe4b806e8f0 0x7fe4b8095890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4bdb5b640 1 -- 10.20.193.76:0/1221226549 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe4b806e8f0 msgr2=0x7fe4b8095890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4bdb5b640 1 --2- 10.20.193.76:0/1221226549 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe4b806e8f0 0x7fe4b8095890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.319 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4bdb5b640 1 -- 10.20.193.76:0/1221226549 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe4b806dfd0 msgr2=0x7fe4b8095350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.320 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4bdb5b640 1 --2- 10.20.193.76:0/1221226549 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe4b806dfd0 0x7fe4b8095350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.320 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4bdb5b640 1 -- 10.20.193.76:0/1221226549 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b4009b30 con 0x7fe4b80987e0 2026-02-25T17:21:30.320 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4bdb5b640 1 --2- 10.20.193.76:0/1221226549 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe4b80987e0 0x7fe4b806f9d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4035000 tx=0x7fe4b4004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:30.320 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4a5ffb640 1 -- 10.20.193.76:0/1221226549 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b402fea0 con 0x7fe4b80987e0 2026-02-25T17:21:30.320 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4a5ffb640 1 -- 10.20.193.76:0/1221226549 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b4009510 con 0x7fe4b80987e0 2026-02-25T17:21:30.320 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4bf5e5640 1 -- 10.20.193.76:0/1221226549 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b8125bd0 con 0x7fe4b80987e0 2026-02-25T17:21:30.320 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.311+0000 7fe4a5ffb640 1 -- 10.20.193.76:0/1221226549 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b40438c0 con 0x7fe4b80987e0 2026-02-25T17:21:30.320 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.312+0000 7fe4bf5e5640 1 -- 10.20.193.76:0/1221226549 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b8125e90 con 0x7fe4b80987e0 2026-02-25T17:21:30.320 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.312+0000 7fe4bf5e5640 1 -- 10.20.193.76:0/1221226549 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b8125090 con 0x7fe4b80987e0 2026-02-25T17:21:30.320 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.312+0000 7fe4a5ffb640 1 -- 10.20.193.76:0/1221226549 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fe4b4053020 con 0x7fe4b80987e0 2026-02-25T17:21:30.320 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.312+0000 7fe4a5ffb640 1 -- 10.20.193.76:0/1221226549 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7fe4b408c230 con 0x7fe4b80987e0 2026-02-25T17:21:30.320 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.314+0000 7fe4a5ffb640 1 -- 10.20.193.76:0/1221226549 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7fe4b40699c0 con 0x7fe4b80987e0 2026-02-25T17:21:30.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.335+0000 7f3a4d449640 1 -- 10.20.193.76:0/689811851 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3a48067960 con 0x7f3a4806f4e0 2026-02-25T17:21:30.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.336+0000 7f3a277fe640 1 -- 10.20.193.76:0/689811851 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3a3c017070 con 0x7f3a4806f4e0 2026-02-25T17:21:30.338 INFO:teuthology.orchestra.run.trial076.stdout:94489280515 2026-02-25T17:21:30.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.336+0000 7fe9a3bd7640 1 -- 10.20.193.76:0/1851437347 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe99c068290 con 0x7fe99c071fe0 2026-02-25T17:21:30.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.336+0000 7fe98a7fc640 1 -- 10.20.193.76:0/1851437347 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe990018020 con 0x7fe99c071fe0 2026-02-25T17:21:30.338 INFO:teuthology.orchestra.run.trial076.stdout:107374182403 2026-02-25T17:21:30.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.337+0000 7f3a4d449640 1 -- 10.20.193.76:0/689811851 >> v1:10.20.193.76:6800/1563581135 conn(0x7f3a1404f8b0 legacy=0x7f3a14051d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.337+0000 7f3a4d449640 1 -- 10.20.193.76:0/689811851 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3a4806f4e0 msgr2=0x7f3a48123710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.337+0000 7f3a4d449640 1 --2- 10.20.193.76:0/689811851 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3a4806f4e0 0x7f3a48123710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c006dc0 tx=0x7f3a3c00ed70 comp rx=0 tx=0).stop 2026-02-25T17:21:30.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.337+0000 7f3a4d449640 1 -- 10.20.193.76:0/689811851 shutdown_connections 2026-02-25T17:21:30.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.337+0000 7f3a4d449640 1 --2- 10.20.193.76:0/689811851 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f3a480979a0 0x7f3a48124190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.337+0000 7f3a4d449640 1 --2- 10.20.193.76:0/689811851 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f3a4806fe00 0x7f3a48123c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.337+0000 7f3a4d449640 1 --2- 10.20.193.76:0/689811851 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f3a4806f4e0 0x7f3a48123710 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.337+0000 7f3a4d449640 1 -- 10.20.193.76:0/689811851 >> 10.20.193.76:0/689811851 conn(0x7f3a4809db70 msgr2=0x7f3a48098fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:30.340 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.337+0000 7f3a4d449640 1 -- 10.20.193.76:0/689811851 shutdown_connections 2026-02-25T17:21:30.340 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.337+0000 7f3a4d449640 1 -- 10.20.193.76:0/689811851 wait complete. 2026-02-25T17:21:30.340 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.338+0000 7fe9a3bd7640 1 -- 10.20.193.76:0/1851437347 >> v1:10.20.193.76:6800/1563581135 conn(0x7fe96c04f880 legacy=0x7fe96c051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.340 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.338+0000 7fe9a3bd7640 1 -- 10.20.193.76:0/1851437347 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe99c071fe0 msgr2=0x7fe99c1322e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.340 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.338+0000 7fe9a3bd7640 1 --2- 10.20.193.76:0/1851437347 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe99c071fe0 0x7fe99c1322e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe99000c700 tx=0x7fe99000cbd0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.340 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.338+0000 7fe9a3bd7640 1 -- 10.20.193.76:0/1851437347 shutdown_connections 2026-02-25T17:21:30.340 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.338+0000 7fe9a3bd7640 1 --2- 10.20.193.76:0/1851437347 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe99c12c8f0 0x7fe99c132820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.340 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.338+0000 7fe9a3bd7640 1 --2- 10.20.193.76:0/1851437347 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe99c071fe0 0x7fe99c1322e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.340 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.338+0000 7fe9a3bd7640 1 --2- 10.20.193.76:0/1851437347 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe99c0716c0 0x7fe99c131da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.341 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.338+0000 7fe9a3bd7640 1 -- 10.20.193.76:0/1851437347 >> 10.20.193.76:0/1851437347 conn(0x7fe99c09ed20 msgr2=0x7fe99c09ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:30.341 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.338+0000 7fe9a3bd7640 1 -- 10.20.193.76:0/1851437347 shutdown_connections 2026-02-25T17:21:30.341 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.338+0000 7fe9a3bd7640 1 -- 10.20.193.76:0/1851437347 wait complete. 2026-02-25T17:21:30.341 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.339+0000 7fd92470b640 1 -- 10.20.193.76:0/271521639 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd91c11cc20 con 0x7fd91c12cd60 2026-02-25T17:21:30.341 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.339+0000 7fd902ffd640 1 -- 10.20.193.76:0/271521639 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd918018030 con 0x7fd91c12cd60 2026-02-25T17:21:30.342 INFO:teuthology.orchestra.run.trial076.stdout:103079215107 2026-02-25T17:21:30.343 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.341+0000 7fd92470b640 1 -- 10.20.193.76:0/271521639 >> v1:10.20.193.76:6800/1563581135 conn(0x7fd8ec04f8b0 legacy=0x7fd8ec051d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.343 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.341+0000 7fd92470b640 1 -- 10.20.193.76:0/271521639 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd91c12cd60 msgr2=0x7fd91c1c4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.343 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.341+0000 7fd92470b640 1 --2- 10.20.193.76:0/271521639 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd91c12cd60 0x7fd91c1c4f10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd91800cc50 tx=0x7fd91800a430 comp rx=0 tx=0).stop 2026-02-25T17:21:30.343 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.341+0000 7fd92470b640 1 -- 10.20.193.76:0/271521639 shutdown_connections 2026-02-25T17:21:30.343 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.341+0000 7fd92470b640 1 --2- 10.20.193.76:0/271521639 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fd91c12cd60 0x7fd91c1c4f10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.343 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.341+0000 7fd92470b640 1 --2- 10.20.193.76:0/271521639 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fd91c12c440 0x7fd91c06fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.344 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.341+0000 7fd92470b640 1 --2- 10.20.193.76:0/271521639 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fd91c06bd90 0x7fd91c06f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.344 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.341+0000 7fd92470b640 1 -- 10.20.193.76:0/271521639 >> 10.20.193.76:0/271521639 conn(0x7fd91c09ba70 msgr2=0x7fd91c06e070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:30.344 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.341+0000 7fd92470b640 1 -- 10.20.193.76:0/271521639 shutdown_connections 2026-02-25T17:21:30.344 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.341+0000 7fd92470b640 1 -- 10.20.193.76:0/271521639 wait complete. 2026-02-25T17:21:30.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 107374182403 got 107374182403 for osd.3 2026-02-25T17:21:30.348 DEBUG:teuthology.parallel:result is None 2026-02-25T17:21:30.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280515 got 94489280515 for osd.0 2026-02-25T17:21:30.349 DEBUG:teuthology.parallel:result is None 2026-02-25T17:21:30.351 INFO:tasks.ceph.ceph_manager.ceph:need seq 103079215107 got 103079215107 for osd.2 2026-02-25T17:21:30.351 DEBUG:teuthology.parallel:result is None 2026-02-25T17:21:30.383 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.381+0000 7fe4bf5e5640 1 -- 10.20.193.76:0/1221226549 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe4b8071f00 con 0x7fe4b80987e0 2026-02-25T17:21:30.383 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.381+0000 7fe4a5ffb640 1 -- 10.20.193.76:0/1221226549 <== mon.1 v2:10.20.193.76:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe4b4047070 con 0x7fe4b80987e0 2026-02-25T17:21:30.384 INFO:teuthology.orchestra.run.trial076.stdout:98784247811 2026-02-25T17:21:30.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.382+0000 7fe4bf5e5640 1 -- 10.20.193.76:0/1221226549 >> v1:10.20.193.76:6800/1563581135 conn(0x7fe48804f8b0 legacy=0x7fe488051d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.382+0000 7fe4bf5e5640 1 -- 10.20.193.76:0/1221226549 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe4b80987e0 msgr2=0x7fe4b806f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.382+0000 7fe4bf5e5640 1 --2- 10.20.193.76:0/1221226549 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe4b80987e0 0x7fe4b806f9d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4035000 tx=0x7fe4b4004b40 comp rx=0 tx=0).stop 2026-02-25T17:21:30.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.382+0000 7fe4bf5e5640 1 -- 10.20.193.76:0/1221226549 shutdown_connections 2026-02-25T17:21:30.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.382+0000 7fe4bf5e5640 1 --2- 10.20.193.76:0/1221226549 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe4b80987e0 0x7fe4b806f9d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.382+0000 7fe4bf5e5640 1 --2- 10.20.193.76:0/1221226549 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe4b806e8f0 0x7fe4b8095890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.382+0000 7fe4bf5e5640 1 --2- 10.20.193.76:0/1221226549 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe4b806dfd0 0x7fe4b8095350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.382+0000 7fe4bf5e5640 1 -- 10.20.193.76:0/1221226549 >> 10.20.193.76:0/1221226549 conn(0x7fe4b809a960 msgr2=0x7fe4b80963d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:30.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.382+0000 7fe4bf5e5640 1 -- 10.20.193.76:0/1221226549 shutdown_connections 2026-02-25T17:21:30.385 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.382+0000 7fe4bf5e5640 1 -- 10.20.193.76:0/1221226549 wait complete. 2026-02-25T17:21:30.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 98784247811 got 98784247811 for osd.1 2026-02-25T17:21:30.393 DEBUG:teuthology.parallel:result is None 2026-02-25T17:21:30.393 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-25T17:21:30.393 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T17:21:30.505 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.498+0000 7fce5e62c640 1 Processor -- start 2026-02-25T17:21:30.505 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.498+0000 7fce5e62c640 1 -- start start 2026-02-25T17:21:30.505 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.498+0000 7fce5e62c640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce5806f210 0x7fce58070b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.505 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.498+0000 7fce5e62c640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce5806fcc0 0x7fce58071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.505 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.498+0000 7fce5e62c640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fce580715b0 0x7fce58134c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.506 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.498+0000 7fce5e62c640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce5809d9a0 con 0x7fce580715b0 2026-02-25T17:21:30.506 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.498+0000 7fce5e62c640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce58070560 con 0x7fce5806fcc0 2026-02-25T17:21:30.506 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.498+0000 7fce5e62c640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce580992e0 con 0x7fce5806f210 2026-02-25T17:21:30.506 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce5cba2640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fce580715b0 0x7fce58134c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.506 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce57fff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce5806f210 0x7fce58070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.506 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce5cba2640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fce580715b0 0x7fce58134c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:36030/0 (socket says 10.20.193.76:36030) 2026-02-25T17:21:30.506 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce5cba2640 1 -- 10.20.193.76:0/4096156474 learned_addr learned my addr 10.20.193.76:0/4096156474 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:30.506 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce577fe640 1 --2- 10.20.193.76:0/4096156474 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce5806fcc0 0x7fce58071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.506 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce5cba2640 1 -- 10.20.193.76:0/4096156474 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce5806f210 msgr2=0x7fce58070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:30.506 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce5cba2640 1 --2- 10.20.193.76:0/4096156474 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce5806f210 0x7fce58070b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.506 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce5cba2640 1 -- 10.20.193.76:0/4096156474 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce5806fcc0 msgr2=0x7fce58071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:30.506 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce5cba2640 1 --2- 10.20.193.76:0/4096156474 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce5806fcc0 0x7fce58071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.507 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce5cba2640 1 -- 10.20.193.76:0/4096156474 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce58070870 con 0x7fce580715b0 2026-02-25T17:21:30.507 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce5cba2640 1 --2- 10.20.193.76:0/4096156474 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fce580715b0 0x7fce58134c20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009e50 tx=0x7fce4c02f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4887851ed04c674f server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:30.507 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce56ffd640 1 -- 10.20.193.76:0/4096156474 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c006ea0 con 0x7fce580715b0 2026-02-25T17:21:30.507 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce56ffd640 1 -- 10.20.193.76:0/4096156474 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4c02fc80 con 0x7fce580715b0 2026-02-25T17:21:30.507 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce56ffd640 1 -- 10.20.193.76:0/4096156474 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c0373f0 con 0x7fce580715b0 2026-02-25T17:21:30.507 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce5e62c640 1 -- 10.20.193.76:0/4096156474 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fce580715b0 msgr2=0x7fce58134c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.507 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce5e62c640 1 --2- 10.20.193.76:0/4096156474 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fce580715b0 0x7fce58134c20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009e50 tx=0x7fce4c02f260 comp rx=0 tx=0).stop 2026-02-25T17:21:30.507 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce5e62c640 1 -- 10.20.193.76:0/4096156474 shutdown_connections 2026-02-25T17:21:30.507 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce5e62c640 1 --2- 10.20.193.76:0/4096156474 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fce580715b0 0x7fce58134c20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.507 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce5e62c640 1 --2- 10.20.193.76:0/4096156474 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce5806fcc0 0x7fce58071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.507 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce5e62c640 1 --2- 10.20.193.76:0/4096156474 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce5806f210 0x7fce58070b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.507 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce5e62c640 1 -- 10.20.193.76:0/4096156474 >> 10.20.193.76:0/4096156474 conn(0x7fce5809a960 msgr2=0x7fce5809ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:30.508 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.499+0000 7fce5e62c640 1 -- 10.20.193.76:0/4096156474 shutdown_connections 2026-02-25T17:21:30.508 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.500+0000 7fce5e62c640 1 -- 10.20.193.76:0/4096156474 wait complete. 2026-02-25T17:21:30.508 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.500+0000 7fce5e62c640 1 Processor -- start 2026-02-25T17:21:30.508 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.500+0000 7fce5e62c640 1 -- start start 2026-02-25T17:21:30.508 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.500+0000 7fce5e62c640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce5806f210 0x7fce58123880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.508 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.500+0000 7fce5e62c640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fce5806fcc0 0x7fce58123dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.508 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.500+0000 7fce5e62c640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce580715b0 0x7fce58124300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.508 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.500+0000 7fce5e62c640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce58125cd0 con 0x7fce5806fcc0 2026-02-25T17:21:30.508 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.500+0000 7fce5e62c640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce581265b0 con 0x7fce5806f210 2026-02-25T17:21:30.508 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.500+0000 7fce5e62c640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce58071f90 con 0x7fce580715b0 2026-02-25T17:21:30.508 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.500+0000 7fce577fe640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fce5806fcc0 0x7fce58123dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.508 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.500+0000 7fce57fff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce5806f210 0x7fce58123880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.509 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.500+0000 7fce577fe640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fce5806fcc0 0x7fce58123dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:36034/0 (socket says 10.20.193.76:36034) 2026-02-25T17:21:30.509 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.500+0000 7fce577fe640 1 -- 10.20.193.76:0/1641556498 learned_addr learned my addr 10.20.193.76:0/1641556498 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:30.509 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.500+0000 7fce5cba2640 1 --2- 10.20.193.76:0/1641556498 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce580715b0 0x7fce58124300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.509 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.501+0000 7fce577fe640 1 -- 10.20.193.76:0/1641556498 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce580715b0 msgr2=0x7fce58124300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.509 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.501+0000 7fce577fe640 1 --2- 10.20.193.76:0/1641556498 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce580715b0 0x7fce58124300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.509 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.501+0000 7fce577fe640 1 -- 10.20.193.76:0/1641556498 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce5806f210 msgr2=0x7fce58123880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.509 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.501+0000 7fce577fe640 1 --2- 10.20.193.76:0/1641556498 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce5806f210 0x7fce58123880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.509 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.501+0000 7fce577fe640 1 -- 10.20.193.76:0/1641556498 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c009b30 con 0x7fce5806fcc0 2026-02-25T17:21:30.509 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.501+0000 7fce57fff640 1 --2- 10.20.193.76:0/1641556498 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce5806f210 0x7fce58123880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:30.509 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.501+0000 7fce577fe640 1 --2- 10.20.193.76:0/1641556498 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fce5806fcc0 0x7fce58123dc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fce4800ebb0 tx=0x7fce4800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:30.509 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.501+0000 7fce54ff9640 1 -- 10.20.193.76:0/1641556498 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce48009770 con 0x7fce5806fcc0 2026-02-25T17:21:30.509 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.501+0000 7fce54ff9640 1 -- 10.20.193.76:0/1641556498 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4800eec0 con 0x7fce5806fcc0 2026-02-25T17:21:30.510 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.501+0000 7fce5e62c640 1 -- 10.20.193.76:0/1641556498 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce581270f0 con 0x7fce5806fcc0 2026-02-25T17:21:30.510 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.501+0000 7fce54ff9640 1 -- 10.20.193.76:0/1641556498 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4800ce60 con 0x7fce5806fcc0 2026-02-25T17:21:30.510 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.501+0000 7fce5e62c640 1 -- 10.20.193.76:0/1641556498 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce58124a20 con 0x7fce5806fcc0 2026-02-25T17:21:30.510 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.501+0000 7fce5e62c640 1 -- 10.20.193.76:0/1641556498 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce580008d0 con 0x7fce5806fcc0 2026-02-25T17:21:30.510 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.501+0000 7fce54ff9640 1 -- 10.20.193.76:0/1641556498 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fce48011070 con 0x7fce5806fcc0 2026-02-25T17:21:30.510 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.502+0000 7fce54ff9640 1 -- 10.20.193.76:0/1641556498 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7fce48066930 con 0x7fce5806fcc0 2026-02-25T17:21:30.510 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.504+0000 7fce54ff9640 1 -- 10.20.193.76:0/1641556498 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7fce48040210 con 0x7fce5806fcc0 2026-02-25T17:21:30.570 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.568+0000 7fce5e62c640 1 -- 10.20.193.76:0/1641556498 --> v1:10.20.193.76:6800/1563581135 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce58070a90 con 0x7fce2804f880 2026-02-25T17:21:30.571 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.568+0000 7fce54ff9640 1 -- 10.20.193.76:0/1641556498 <== mgr.14104 v1:10.20.193.76:6800/1563581135 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34763 (unknown 2965378022 0 1226315223) 0x7fce58070a90 con 0x7fce2804f880 2026-02-25T17:21:30.572 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:30.574 INFO:teuthology.orchestra.run.trial076.stderr:dumped all 2026-02-25T17:21:30.575 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.569+0000 7fce5e62c640 1 -- 10.20.193.76:0/1641556498 >> v1:10.20.193.76:6800/1563581135 conn(0x7fce2804f880 legacy=0x7fce28051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.575 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.569+0000 7fce5e62c640 1 -- 10.20.193.76:0/1641556498 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fce5806fcc0 msgr2=0x7fce58123dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.575 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.569+0000 7fce5e62c640 1 --2- 10.20.193.76:0/1641556498 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fce5806fcc0 0x7fce58123dc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fce4800ebb0 tx=0x7fce4800c520 comp rx=0 tx=0).stop 2026-02-25T17:21:30.575 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.569+0000 7fce5e62c640 1 -- 10.20.193.76:0/1641556498 shutdown_connections 2026-02-25T17:21:30.575 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.569+0000 7fce5e62c640 1 --2- 10.20.193.76:0/1641556498 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fce580715b0 0x7fce58124300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.576 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.569+0000 7fce5e62c640 1 --2- 10.20.193.76:0/1641556498 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fce5806fcc0 0x7fce58123dc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.576 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.569+0000 7fce5e62c640 1 --2- 10.20.193.76:0/1641556498 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fce5806f210 0x7fce58123880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.576 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.569+0000 7fce5e62c640 1 -- 10.20.193.76:0/1641556498 >> 10.20.193.76:0/1641556498 conn(0x7fce5809a960 msgr2=0x7fce58092f20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:30.576 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.569+0000 7fce5e62c640 1 -- 10.20.193.76:0/1641556498 shutdown_connections 2026-02-25T17:21:30.576 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.569+0000 7fce5e62c640 1 -- 10.20.193.76:0/1641556498 wait complete. 2026-02-25T17:21:30.580 INFO:teuthology.orchestra.run.trial076.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2026-02-25T17:21:29.047401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":111928,"kb_used_data":2096,"kb_used_omap":17,"kb_used_meta":109742,"kb_avail":377375432,"statfs":{"total":386547056640,"available":386432442368,"internally_reserved":0,"allocated":2146304,"data_stored":1517688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18185,"internal_metadata":112376055},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.854886"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199182+0000","last_change":"2026-02-25T17:21:24.194818+0000","last_active":"2026-02-25T17:21:26.199182+0000","last_peered":"2026-02-25T17:21:26.199182+0000","last_clean":"2026-02-25T17:21:26.199182+0000","last_became_active":"2026-02-25T17:21:24.194619+0000","last_became_peered":"2026-02-25T17:21:24.194619+0000","last_unstale":"2026-02-25T17:21:26.199182+0000","last_undegraded":"2026-02-25T17:21:26.199182+0000","last_fullsized":"2026-02-25T17:21:26.199182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:59:31.300444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198898+0000","last_change":"2026-02-25T17:21:24.194618+0000","last_active":"2026-02-25T17:21:26.198898+0000","last_peered":"2026-02-25T17:21:26.198898+0000","last_clean":"2026-02-25T17:21:26.198898+0000","last_became_active":"2026-02-25T17:21:24.194411+0000","last_became_peered":"2026-02-25T17:21:24.194411+0000","last_unstale":"2026-02-25T17:21:26.198898+0000","last_undegraded":"2026-02-25T17:21:26.198898+0000","last_fullsized":"2026-02-25T17:21:26.198898+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:40:43.331156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000395898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199198+0000","last_change":"2026-02-25T17:21:24.195559+0000","last_active":"2026-02-25T17:21:26.199198+0000","last_peered":"2026-02-25T17:21:26.199198+0000","last_clean":"2026-02-25T17:21:26.199198+0000","last_became_active":"2026-02-25T17:21:24.195473+0000","last_became_peered":"2026-02-25T17:21:24.195473+0000","last_unstale":"2026-02-25T17:21:26.199198+0000","last_undegraded":"2026-02-25T17:21:26.199198+0000","last_fullsized":"2026-02-25T17:21:26.199198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:22:24.234703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026897200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198922+0000","last_change":"2026-02-25T17:21:24.194793+0000","last_active":"2026-02-25T17:21:26.198922+0000","last_peered":"2026-02-25T17:21:26.198922+0000","last_clean":"2026-02-25T17:21:26.198922+0000","last_became_active":"2026-02-25T17:21:24.194561+0000","last_became_peered":"2026-02-25T17:21:24.194561+0000","last_unstale":"2026-02-25T17:21:26.198922+0000","last_undegraded":"2026-02-25T17:21:26.198922+0000","last_fullsized":"2026-02-25T17:21:26.198922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:02:43.748049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038440700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"16'79","reported_seq":149,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198864+0000","last_change":"2026-02-25T17:21:24.195059+0000","last_active":"2026-02-25T17:21:26.198864+0000","last_peered":"2026-02-25T17:21:26.198864+0000","last_clean":"2026-02-25T17:21:26.198864+0000","last_became_active":"2026-02-25T17:21:24.194928+0000","last_became_peered":"2026-02-25T17:21:24.194928+0000","last_unstale":"2026-02-25T17:21:26.198864+0000","last_undegraded":"2026-02-25T17:21:26.198864+0000","last_fullsized":"2026-02-25T17:21:26.198864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:21:32.983159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199155+0000","last_change":"2026-02-25T17:21:23.192944+0000","last_active":"2026-02-25T17:21:26.199155+0000","last_peered":"2026-02-25T17:21:26.199155+0000","last_clean":"2026-02-25T17:21:26.199155+0000","last_became_active":"2026-02-25T17:21:23.192745+0000","last_became_peered":"2026-02-25T17:21:23.192745+0000","last_unstale":"2026-02-25T17:21:26.199155+0000","last_undegraded":"2026-02-25T17:21:26.199155+0000","last_fullsized":"2026-02-25T17:21:26.199155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:12:01.863576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033429400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.391364+0000","last_change":"2026-02-25T17:21:22.189219+0000","last_active":"2026-02-25T17:21:26.391364+0000","last_peered":"2026-02-25T17:21:26.391364+0000","last_clean":"2026-02-25T17:21:26.391364+0000","last_became_active":"2026-02-25T17:21:22.189043+0000","last_became_peered":"2026-02-25T17:21:22.189043+0000","last_unstale":"2026-02-25T17:21:26.391364+0000","last_undegraded":"2026-02-25T17:21:26.391364+0000","last_fullsized":"2026-02-25T17:21:26.391364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:14:12.733416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083336499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198893+0000","last_change":"2026-02-25T17:21:24.194744+0000","last_active":"2026-02-25T17:21:26.198893+0000","last_peered":"2026-02-25T17:21:26.198893+0000","last_clean":"2026-02-25T17:21:26.198893+0000","last_became_active":"2026-02-25T17:21:24.194527+0000","last_became_peered":"2026-02-25T17:21:24.194527+0000","last_unstale":"2026-02-25T17:21:26.198893+0000","last_undegraded":"2026-02-25T17:21:26.198893+0000","last_fullsized":"2026-02-25T17:21:26.198893+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:08:42.357152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054556799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199174+0000","last_change":"2026-02-25T17:21:22.188981+0000","last_active":"2026-02-25T17:21:26.199174+0000","last_peered":"2026-02-25T17:21:26.199174+0000","last_clean":"2026-02-25T17:21:26.199174+0000","last_became_active":"2026-02-25T17:21:22.188810+0000","last_became_peered":"2026-02-25T17:21:22.188810+0000","last_unstale":"2026-02-25T17:21:26.199174+0000","last_undegraded":"2026-02-25T17:21:26.199174+0000","last_fullsized":"2026-02-25T17:21:26.199174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:20:57.540380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056038500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":25,"seq":107374182403,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28288,"kb_used_data":812,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94343552,"statfs":{"total":96636764160,"available":96607797248,"internally_reserved":0,"allocated":831488,"data_stored":674090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4549,"internal_metadata":28110395},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.14399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]}]},{"osd":2,"up_from":24,"seq":103079215107,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":228,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":233472,"data_stored":83106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":28110400},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.11799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20499999999999999}]}]},{"osd":1,"up_from":23,"seq":98784247811,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":824,"kb_used_omap":4,"kb_used_meta":27387,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":843776,"data_stored":677704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4548,"internal_metadata":28044860},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]}]},{"osd":0,"up_from":22,"seq":94489280515,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":232,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":237568,"data_stored":82788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":28110400},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T17:21:30.583 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T17:21:30.654 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.648+0000 7f27de900640 1 Processor -- start 2026-02-25T17:21:30.654 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.648+0000 7f27de900640 1 -- start start 2026-02-25T17:21:30.654 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.648+0000 7f27de900640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f27d806f210 0x7f27d8070b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.654 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.648+0000 7f27de900640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f27d806fcc0 0x7f27d8071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.654 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.648+0000 7f27de900640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f27d80715b0 0x7f27d8134c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.655 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.648+0000 7f27de900640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d809d9a0 con 0x7f27d806f210 2026-02-25T17:21:30.655 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.648+0000 7f27de900640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d8070560 con 0x7f27d806fcc0 2026-02-25T17:21:30.655 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.648+0000 7f27de900640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27d80992e0 con 0x7f27d80715b0 2026-02-25T17:21:30.655 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.648+0000 7f27dce76640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f27d80715b0 0x7f27d8134c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.655 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.648+0000 7f27d7fff640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f27d806f210 0x7f27d8070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.655 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.648+0000 7f27d77fe640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f27d806fcc0 0x7f27d8071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.655 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.648+0000 7f27dce76640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f27d80715b0 0x7f27d8134c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39310/0 (socket says 10.20.193.76:39310) 2026-02-25T17:21:30.655 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.648+0000 7f27d7fff640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f27d806f210 0x7f27d8070b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:36036/0 (socket says 10.20.193.76:36036) 2026-02-25T17:21:30.655 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.648+0000 7f27dce76640 1 -- 10.20.193.76:0/2002766767 learned_addr learned my addr 10.20.193.76:0/2002766767 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:30.655 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.648+0000 7f27dce76640 1 -- 10.20.193.76:0/2002766767 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f27d806fcc0 msgr2=0x7f27d8071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:30.655 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.648+0000 7f27dce76640 1 --2- 10.20.193.76:0/2002766767 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f27d806fcc0 0x7f27d8071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.655 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.648+0000 7f27dce76640 1 -- 10.20.193.76:0/2002766767 >> v2:10.20.193.76:3300/0 conn(0x7f27d806f210 msgr2=0x7f27d8070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:30.656 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.648+0000 7f27dce76640 1 --2- 10.20.193.76:0/2002766767 >> v2:10.20.193.76:3300/0 conn(0x7f27d806f210 0x7f27d8070b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.656 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.648+0000 7f27dce76640 1 -- 10.20.193.76:0/2002766767 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d8070870 con 0x7f27d80715b0 2026-02-25T17:21:30.656 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.649+0000 7f27dce76640 1 --2- 10.20.193.76:0/2002766767 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f27d80715b0 0x7f27d8134c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f27cc009e80 tx=0x7f27cc02f250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a4d6743b63a0f7a server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:30.656 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.649+0000 7f27d6ffd640 1 -- 10.20.193.76:0/2002766767 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc006ea0 con 0x7f27d80715b0 2026-02-25T17:21:30.656 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.649+0000 7f27d6ffd640 1 -- 10.20.193.76:0/2002766767 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27cc02fc70 con 0x7f27d80715b0 2026-02-25T17:21:30.656 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.649+0000 7f27d6ffd640 1 -- 10.20.193.76:0/2002766767 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0373f0 con 0x7f27d80715b0 2026-02-25T17:21:30.656 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.649+0000 7f27de900640 1 -- 10.20.193.76:0/2002766767 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f27d80715b0 msgr2=0x7f27d8134c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.656 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.649+0000 7f27de900640 1 --2- 10.20.193.76:0/2002766767 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f27d80715b0 0x7f27d8134c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f27cc009e80 tx=0x7f27cc02f250 comp rx=0 tx=0).stop 2026-02-25T17:21:30.656 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.649+0000 7f27de900640 1 -- 10.20.193.76:0/2002766767 shutdown_connections 2026-02-25T17:21:30.656 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.649+0000 7f27de900640 1 --2- 10.20.193.76:0/2002766767 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f27d80715b0 0x7f27d8134c20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.656 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.649+0000 7f27de900640 1 --2- 10.20.193.76:0/2002766767 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f27d806fcc0 0x7f27d8071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.656 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.649+0000 7f27de900640 1 --2- 10.20.193.76:0/2002766767 >> v2:10.20.193.76:3300/0 conn(0x7f27d806f210 0x7f27d8070b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.657 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.649+0000 7f27de900640 1 -- 10.20.193.76:0/2002766767 >> 10.20.193.76:0/2002766767 conn(0x7f27d809a960 msgr2=0x7f27d809ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:30.657 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.649+0000 7f27de900640 1 -- 10.20.193.76:0/2002766767 shutdown_connections 2026-02-25T17:21:30.657 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.649+0000 7f27de900640 1 -- 10.20.193.76:0/2002766767 wait complete. 2026-02-25T17:21:30.657 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27de900640 1 Processor -- start 2026-02-25T17:21:30.657 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27de900640 1 -- start start 2026-02-25T17:21:30.657 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27de900640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f27d806f210 0x7f27d8123ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.657 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27de900640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f27d806fcc0 0x7f27d81240e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.657 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27de900640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f27d80715b0 0x7f27d8124620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.657 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27de900640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d8071f90 con 0x7f27d80715b0 2026-02-25T17:21:30.657 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27de900640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d8124b60 con 0x7f27d806f210 2026-02-25T17:21:30.657 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27de900640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27d8125c20 con 0x7f27d806fcc0 2026-02-25T17:21:30.657 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27d7fff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f27d806f210 0x7f27d8123ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27d77fe640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f27d806fcc0 0x7f27d81240e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27dce76640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f27d80715b0 0x7f27d8124620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27d77fe640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f27d806fcc0 0x7f27d81240e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39316/0 (socket says 10.20.193.76:39316) 2026-02-25T17:21:30.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27d77fe640 1 -- 10.20.193.76:0/1989558158 learned_addr learned my addr 10.20.193.76:0/1989558158 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:30.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27d7fff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f27d806f210 0x7f27d8123ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50748/0 (socket says 10.20.193.76:50748) 2026-02-25T17:21:30.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27d7fff640 1 -- 10.20.193.76:0/1989558158 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f27d806fcc0 msgr2=0x7f27d81240e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27d7fff640 1 --2- 10.20.193.76:0/1989558158 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f27d806fcc0 0x7f27d81240e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27d7fff640 1 -- 10.20.193.76:0/1989558158 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f27d80715b0 msgr2=0x7f27d8124620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27d7fff640 1 --2- 10.20.193.76:0/1989558158 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f27d80715b0 0x7f27d8124620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27d7fff640 1 -- 10.20.193.76:0/1989558158 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc009b30 con 0x7f27d806f210 2026-02-25T17:21:30.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27dce76640 1 --2- 10.20.193.76:0/1989558158 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f27d80715b0 0x7f27d8124620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:30.659 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27d7fff640 1 --2- 10.20.193.76:0/1989558158 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f27d806f210 0x7f27d8123ba0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f27c400e9b0 tx=0x7f27c400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:30.659 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27d4ff9640 1 -- 10.20.193.76:0/1989558158 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c400ca00 con 0x7f27d806f210 2026-02-25T17:21:30.659 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27d4ff9640 1 -- 10.20.193.76:0/1989558158 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c400cb60 con 0x7f27d806f210 2026-02-25T17:21:30.659 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27de900640 1 -- 10.20.193.76:0/1989558158 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d8126690 con 0x7f27d806f210 2026-02-25T17:21:30.659 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27d4ff9640 1 -- 10.20.193.76:0/1989558158 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4013470 con 0x7f27d806f210 2026-02-25T17:21:30.659 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.650+0000 7f27de900640 1 -- 10.20.193.76:0/1989558158 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d81cb770 con 0x7f27d806f210 2026-02-25T17:21:30.659 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.651+0000 7f27de900640 1 -- 10.20.193.76:0/1989558158 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d80008d0 con 0x7f27d806f210 2026-02-25T17:21:30.659 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.651+0000 7f27d4ff9640 1 -- 10.20.193.76:0/1989558158 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f27c4011070 con 0x7f27d806f210 2026-02-25T17:21:30.659 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.651+0000 7f27d4ff9640 1 -- 10.20.193.76:0/1989558158 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7f27c4066850 con 0x7f27d806f210 2026-02-25T17:21:30.660 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.653+0000 7f27d4ff9640 1 -- 10.20.193.76:0/1989558158 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f27c40401d0 con 0x7f27d806f210 2026-02-25T17:21:30.719 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.716+0000 7f27de900640 1 -- 10.20.193.76:0/1989558158 --> v1:10.20.193.76:6800/1563581135 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27d809be50 con 0x7f27a804f880 2026-02-25T17:21:30.720 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.717+0000 7f27d4ff9640 1 -- 10.20.193.76:0/1989558158 <== mgr.14104 v1:10.20.193.76:6800/1563581135 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34763 (unknown 2965378022 0 1226315223) 0x7f27d809be50 con 0x7f27a804f880 2026-02-25T17:21:30.720 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:30.721 INFO:teuthology.orchestra.run.trial076.stderr:dumped all 2026-02-25T17:21:30.721 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.718+0000 7f27de900640 1 -- 10.20.193.76:0/1989558158 >> v1:10.20.193.76:6800/1563581135 conn(0x7f27a804f880 legacy=0x7f27a8051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.721 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.718+0000 7f27de900640 1 -- 10.20.193.76:0/1989558158 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f27d806f210 msgr2=0x7f27d8123ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.722 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.718+0000 7f27de900640 1 --2- 10.20.193.76:0/1989558158 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f27d806f210 0x7f27d8123ba0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f27c400e9b0 tx=0x7f27c400ee80 comp rx=0 tx=0).stop 2026-02-25T17:21:30.722 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.718+0000 7f27de900640 1 -- 10.20.193.76:0/1989558158 shutdown_connections 2026-02-25T17:21:30.722 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.718+0000 7f27de900640 1 --2- 10.20.193.76:0/1989558158 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f27d80715b0 0x7f27d8124620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.722 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.718+0000 7f27de900640 1 --2- 10.20.193.76:0/1989558158 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f27d806fcc0 0x7f27d81240e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.722 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.718+0000 7f27de900640 1 --2- 10.20.193.76:0/1989558158 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f27d806f210 0x7f27d8123ba0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.722 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.718+0000 7f27de900640 1 -- 10.20.193.76:0/1989558158 >> 10.20.193.76:0/1989558158 conn(0x7f27d809a960 msgr2=0x7f27d8092f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:30.722 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.718+0000 7f27de900640 1 -- 10.20.193.76:0/1989558158 shutdown_connections 2026-02-25T17:21:30.722 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.718+0000 7f27de900640 1 -- 10.20.193.76:0/1989558158 wait complete. 2026-02-25T17:21:30.727 INFO:teuthology.orchestra.run.trial076.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2026-02-25T17:21:29.047401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":111928,"kb_used_data":2096,"kb_used_omap":17,"kb_used_meta":109742,"kb_avail":377375432,"statfs":{"total":386547056640,"available":386432442368,"internally_reserved":0,"allocated":2146304,"data_stored":1517688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18185,"internal_metadata":112376055},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.854886"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199182+0000","last_change":"2026-02-25T17:21:24.194818+0000","last_active":"2026-02-25T17:21:26.199182+0000","last_peered":"2026-02-25T17:21:26.199182+0000","last_clean":"2026-02-25T17:21:26.199182+0000","last_became_active":"2026-02-25T17:21:24.194619+0000","last_became_peered":"2026-02-25T17:21:24.194619+0000","last_unstale":"2026-02-25T17:21:26.199182+0000","last_undegraded":"2026-02-25T17:21:26.199182+0000","last_fullsized":"2026-02-25T17:21:26.199182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:59:31.300444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198898+0000","last_change":"2026-02-25T17:21:24.194618+0000","last_active":"2026-02-25T17:21:26.198898+0000","last_peered":"2026-02-25T17:21:26.198898+0000","last_clean":"2026-02-25T17:21:26.198898+0000","last_became_active":"2026-02-25T17:21:24.194411+0000","last_became_peered":"2026-02-25T17:21:24.194411+0000","last_unstale":"2026-02-25T17:21:26.198898+0000","last_undegraded":"2026-02-25T17:21:26.198898+0000","last_fullsized":"2026-02-25T17:21:26.198898+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:40:43.331156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000395898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199198+0000","last_change":"2026-02-25T17:21:24.195559+0000","last_active":"2026-02-25T17:21:26.199198+0000","last_peered":"2026-02-25T17:21:26.199198+0000","last_clean":"2026-02-25T17:21:26.199198+0000","last_became_active":"2026-02-25T17:21:24.195473+0000","last_became_peered":"2026-02-25T17:21:24.195473+0000","last_unstale":"2026-02-25T17:21:26.199198+0000","last_undegraded":"2026-02-25T17:21:26.199198+0000","last_fullsized":"2026-02-25T17:21:26.199198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:22:24.234703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026897200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198922+0000","last_change":"2026-02-25T17:21:24.194793+0000","last_active":"2026-02-25T17:21:26.198922+0000","last_peered":"2026-02-25T17:21:26.198922+0000","last_clean":"2026-02-25T17:21:26.198922+0000","last_became_active":"2026-02-25T17:21:24.194561+0000","last_became_peered":"2026-02-25T17:21:24.194561+0000","last_unstale":"2026-02-25T17:21:26.198922+0000","last_undegraded":"2026-02-25T17:21:26.198922+0000","last_fullsized":"2026-02-25T17:21:26.198922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:02:43.748049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038440700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"16'79","reported_seq":149,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198864+0000","last_change":"2026-02-25T17:21:24.195059+0000","last_active":"2026-02-25T17:21:26.198864+0000","last_peered":"2026-02-25T17:21:26.198864+0000","last_clean":"2026-02-25T17:21:26.198864+0000","last_became_active":"2026-02-25T17:21:24.194928+0000","last_became_peered":"2026-02-25T17:21:24.194928+0000","last_unstale":"2026-02-25T17:21:26.198864+0000","last_undegraded":"2026-02-25T17:21:26.198864+0000","last_fullsized":"2026-02-25T17:21:26.198864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:21:32.983159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199155+0000","last_change":"2026-02-25T17:21:23.192944+0000","last_active":"2026-02-25T17:21:26.199155+0000","last_peered":"2026-02-25T17:21:26.199155+0000","last_clean":"2026-02-25T17:21:26.199155+0000","last_became_active":"2026-02-25T17:21:23.192745+0000","last_became_peered":"2026-02-25T17:21:23.192745+0000","last_unstale":"2026-02-25T17:21:26.199155+0000","last_undegraded":"2026-02-25T17:21:26.199155+0000","last_fullsized":"2026-02-25T17:21:26.199155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:12:01.863576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033429400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.391364+0000","last_change":"2026-02-25T17:21:22.189219+0000","last_active":"2026-02-25T17:21:26.391364+0000","last_peered":"2026-02-25T17:21:26.391364+0000","last_clean":"2026-02-25T17:21:26.391364+0000","last_became_active":"2026-02-25T17:21:22.189043+0000","last_became_peered":"2026-02-25T17:21:22.189043+0000","last_unstale":"2026-02-25T17:21:26.391364+0000","last_undegraded":"2026-02-25T17:21:26.391364+0000","last_fullsized":"2026-02-25T17:21:26.391364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:14:12.733416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083336499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198893+0000","last_change":"2026-02-25T17:21:24.194744+0000","last_active":"2026-02-25T17:21:26.198893+0000","last_peered":"2026-02-25T17:21:26.198893+0000","last_clean":"2026-02-25T17:21:26.198893+0000","last_became_active":"2026-02-25T17:21:24.194527+0000","last_became_peered":"2026-02-25T17:21:24.194527+0000","last_unstale":"2026-02-25T17:21:26.198893+0000","last_undegraded":"2026-02-25T17:21:26.198893+0000","last_fullsized":"2026-02-25T17:21:26.198893+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:08:42.357152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054556799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199174+0000","last_change":"2026-02-25T17:21:22.188981+0000","last_active":"2026-02-25T17:21:26.199174+0000","last_peered":"2026-02-25T17:21:26.199174+0000","last_clean":"2026-02-25T17:21:26.199174+0000","last_became_active":"2026-02-25T17:21:22.188810+0000","last_became_peered":"2026-02-25T17:21:22.188810+0000","last_unstale":"2026-02-25T17:21:26.199174+0000","last_undegraded":"2026-02-25T17:21:26.199174+0000","last_fullsized":"2026-02-25T17:21:26.199174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:20:57.540380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056038500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":25,"seq":107374182403,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28288,"kb_used_data":812,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94343552,"statfs":{"total":96636764160,"available":96607797248,"internally_reserved":0,"allocated":831488,"data_stored":674090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4549,"internal_metadata":28110395},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.14399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]}]},{"osd":2,"up_from":24,"seq":103079215107,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":228,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":233472,"data_stored":83106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":28110400},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.11799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20499999999999999}]}]},{"osd":1,"up_from":23,"seq":98784247811,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":824,"kb_used_omap":4,"kb_used_meta":27387,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":843776,"data_stored":677704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4548,"internal_metadata":28044860},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]}]},{"osd":0,"up_from":22,"seq":94489280515,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":232,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":237568,"data_stored":82788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":28110400},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T17:21:30.729 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-25T17:21:30.729 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-25T17:21:30.729 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-25T17:21:30.729 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-25T17:21:30.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.793+0000 7fe689762640 1 Processor -- start 2026-02-25T17:21:30.804 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.794+0000 7fe689762640 1 -- start start 2026-02-25T17:21:30.804 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.794+0000 7fe689762640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe68406dfd0 0x7fe68406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.804 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.794+0000 7fe689762640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe68406e8f0 0x7fe6840980d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.804 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.794+0000 7fe689762640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe68409d9a0 con 0x7fe684098610 2026-02-25T17:21:30.804 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.794+0000 7fe689762640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe684099190 con 0x7fe68406dfd0 2026-02-25T17:21:30.805 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.794+0000 7fe689762640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe68408c910 con 0x7fe68406e8f0 2026-02-25T17:21:30.805 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.794+0000 7fe682ffd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe68406dfd0 0x7fe68406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.805 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.794+0000 7fe6827fc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe68406e8f0 0x7fe6840980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.805 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.794+0000 7fe682ffd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe68406dfd0 0x7fe68406e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50758/0 (socket says 10.20.193.76:50758) 2026-02-25T17:21:30.805 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.794+0000 7fe682ffd640 1 -- 10.20.193.76:0/2621530752 learned_addr learned my addr 10.20.193.76:0/2621530752 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:30.805 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.794+0000 7fe6837fe640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7fe684098610 0x7fe684133700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:32774/0 (socket says 10.20.193.76:32774) 2026-02-25T17:21:30.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.794+0000 7fe682ffd640 1 -- 10.20.193.76:0/2621530752 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe68406e8f0 msgr2=0x7fe6840980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:30.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.794+0000 7fe682ffd640 1 --2- 10.20.193.76:0/2621530752 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe68406e8f0 0x7fe6840980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.794+0000 7fe682ffd640 1 -- 10.20.193.76:0/2621530752 >> v1:10.20.193.76:6789/0 conn(0x7fe684098610 legacy=0x7fe684133700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.794+0000 7fe682ffd640 1 -- 10.20.193.76:0/2621530752 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe684072260 con 0x7fe68406dfd0 2026-02-25T17:21:30.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.795+0000 7fe682ffd640 1 --2- 10.20.193.76:0/2621530752 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe68406dfd0 0x7fe68406e3b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe6780099a0 tx=0x7fe67802ef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=778f74b8f8367a4 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:30.806 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.795+0000 7fe681ffb640 1 -- 10.20.193.76:0/2621530752 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67802fb80 con 0x7fe68406dfd0 2026-02-25T17:21:30.807 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.795+0000 7fe681ffb640 1 -- 10.20.193.76:0/2621530752 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67802fce0 con 0x7fe68406dfd0 2026-02-25T17:21:30.807 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.795+0000 7fe681ffb640 1 -- 10.20.193.76:0/2621530752 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe678037660 con 0x7fe68406dfd0 2026-02-25T17:21:30.807 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.795+0000 7fe689762640 1 -- 10.20.193.76:0/2621530752 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe68406dfd0 msgr2=0x7fe68406e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.807 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.795+0000 7fe689762640 1 --2- 10.20.193.76:0/2621530752 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe68406dfd0 0x7fe68406e3b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe6780099a0 tx=0x7fe67802ef50 comp rx=0 tx=0).stop 2026-02-25T17:21:30.807 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.795+0000 7fe689762640 1 -- 10.20.193.76:0/2621530752 shutdown_connections 2026-02-25T17:21:30.807 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.795+0000 7fe689762640 1 --2- 10.20.193.76:0/2621530752 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe68406e8f0 0x7fe6840980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.795+0000 7fe689762640 1 --2- 10.20.193.76:0/2621530752 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe68406dfd0 0x7fe68406e3b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.795+0000 7fe689762640 1 -- 10.20.193.76:0/2621530752 >> 10.20.193.76:0/2621530752 conn(0x7fe68409a960 msgr2=0x7fe68409ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:30.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.795+0000 7fe689762640 1 -- 10.20.193.76:0/2621530752 shutdown_connections 2026-02-25T17:21:30.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.795+0000 7fe689762640 1 -- 10.20.193.76:0/2621530752 wait complete. 2026-02-25T17:21:30.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe689762640 1 Processor -- start 2026-02-25T17:21:30.808 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe689762640 1 -- start start 2026-02-25T17:21:30.809 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe689762640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe68406dfd0 0x7fe68406f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.809 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe689762640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe68406e8f0 0x7fe68406ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.809 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe689762640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe684098610 0x7fe684070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:30.809 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe689762640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe684124e80 con 0x7fe68406e8f0 2026-02-25T17:21:30.809 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe689762640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe684071310 con 0x7fe68406dfd0 2026-02-25T17:21:30.809 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe689762640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe684124980 con 0x7fe684098610 2026-02-25T17:21:30.810 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe682ffd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe68406dfd0 0x7fe68406f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.810 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe6837fe640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe684098610 0x7fe684070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.810 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe6827fc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe68406e8f0 0x7fe68406ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:30.810 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe682ffd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe68406dfd0 0x7fe68406f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50762/0 (socket says 10.20.193.76:50762) 2026-02-25T17:21:30.810 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe682ffd640 1 -- 10.20.193.76:0/3096422057 learned_addr learned my addr 10.20.193.76:0/3096422057 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:30.810 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe6827fc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe68406e8f0 0x7fe68406ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:36064/0 (socket says 10.20.193.76:36064) 2026-02-25T17:21:30.811 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe6837fe640 1 -- 10.20.193.76:0/3096422057 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe68406dfd0 msgr2=0x7fe68406f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.811 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe6837fe640 1 --2- 10.20.193.76:0/3096422057 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe68406dfd0 0x7fe68406f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.811 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe6837fe640 1 -- 10.20.193.76:0/3096422057 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe68406e8f0 msgr2=0x7fe68406ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.811 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe6837fe640 1 --2- 10.20.193.76:0/3096422057 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe68406e8f0 0x7fe68406ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.811 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe6837fe640 1 -- 10.20.193.76:0/3096422057 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6780095d0 con 0x7fe684098610 2026-02-25T17:21:30.811 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe6837fe640 1 --2- 10.20.193.76:0/3096422057 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe684098610 0x7fe684070450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe67400caa0 tx=0x7fe67400cf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:30.812 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe6637fe640 1 -- 10.20.193.76:0/3096422057 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67400ac40 con 0x7fe684098610 2026-02-25T17:21:30.812 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe6637fe640 1 -- 10.20.193.76:0/3096422057 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67400ada0 con 0x7fe684098610 2026-02-25T17:21:30.812 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe689762640 1 -- 10.20.193.76:0/3096422057 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe684095c60 con 0x7fe684098610 2026-02-25T17:21:30.812 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe6637fe640 1 -- 10.20.193.76:0/3096422057 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe674012600 con 0x7fe684098610 2026-02-25T17:21:30.812 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.796+0000 7fe689762640 1 -- 10.20.193.76:0/3096422057 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe684125e40 con 0x7fe684098610 2026-02-25T17:21:30.812 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.797+0000 7fe689762640 1 -- 10.20.193.76:0/3096422057 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe684098ed0 con 0x7fe684098610 2026-02-25T17:21:30.813 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.797+0000 7fe6637fe640 1 -- 10.20.193.76:0/3096422057 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fe674012760 con 0x7fe684098610 2026-02-25T17:21:30.813 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.797+0000 7fe6637fe640 1 -- 10.20.193.76:0/3096422057 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7fe6740667c0 con 0x7fe684098610 2026-02-25T17:21:30.813 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.799+0000 7fe6637fe640 1 -- 10.20.193.76:0/3096422057 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7fe6740400a0 con 0x7fe684098610 2026-02-25T17:21:30.877 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.874+0000 7fe689762640 1 -- 10.20.193.76:0/3096422057 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe684068270 con 0x7fe684098610 2026-02-25T17:21:30.877 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.874+0000 7fe6637fe640 1 -- 10.20.193.76:0/3096422057 <== mon.2 v2:10.20.193.76:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe674017070 con 0x7fe684098610 2026-02-25T17:21:30.877 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:30.878 INFO:teuthology.orchestra.run.trial076.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-25T17:21:30.878 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.875+0000 7fe689762640 1 -- 10.20.193.76:0/3096422057 >> v1:10.20.193.76:6800/1563581135 conn(0x7fe65004f880 legacy=0x7fe650051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.879 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.875+0000 7fe689762640 1 -- 10.20.193.76:0/3096422057 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe684098610 msgr2=0x7fe684070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:30.879 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.875+0000 7fe689762640 1 --2- 10.20.193.76:0/3096422057 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe684098610 0x7fe684070450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe67400caa0 tx=0x7fe67400cf70 comp rx=0 tx=0).stop 2026-02-25T17:21:30.879 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.875+0000 7fe689762640 1 -- 10.20.193.76:0/3096422057 shutdown_connections 2026-02-25T17:21:30.879 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.875+0000 7fe689762640 1 --2- 10.20.193.76:0/3096422057 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe684098610 0x7fe684070450 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.879 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.875+0000 7fe689762640 1 --2- 10.20.193.76:0/3096422057 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe68406e8f0 0x7fe68406ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.879 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.875+0000 7fe689762640 1 --2- 10.20.193.76:0/3096422057 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe68406dfd0 0x7fe68406f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:30.879 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.875+0000 7fe689762640 1 -- 10.20.193.76:0/3096422057 >> 10.20.193.76:0/3096422057 conn(0x7fe68409a960 msgr2=0x7fe68406bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:30.879 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.875+0000 7fe689762640 1 -- 10.20.193.76:0/3096422057 shutdown_connections 2026-02-25T17:21:30.879 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:30.875+0000 7fe689762640 1 -- 10.20.193.76:0/3096422057 wait complete. 2026-02-25T17:21:30.885 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-25T17:21:30.885 INFO:teuthology.run_tasks:Running task print... 2026-02-25T17:21:30.901 INFO:teuthology.task.print:**** done ceph.restart 2026-02-25T17:21:30.902 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2026-02-25T17:21:30.918 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2026-02-25T17:21:30.934 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2026-02-25T17:21:30.952 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-25T17:21:30.968 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-25T17:21:30.969 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T17:21:31.038 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.032+0000 7f64de28a640 1 Processor -- start 2026-02-25T17:21:31.039 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.032+0000 7f64de28a640 1 -- start start 2026-02-25T17:21:31.039 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.032+0000 7f64de28a640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f64d806dfd0 0x7f64d806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.039 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.032+0000 7f64de28a640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f64d806e8f0 0x7f64d80980d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.039 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.032+0000 7f64de28a640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f64d8098610 0x7f64d8098ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.039 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.032+0000 7f64de28a640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d8099190 con 0x7f64d806e8f0 2026-02-25T17:21:31.039 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.032+0000 7f64de28a640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d808c910 con 0x7f64d806dfd0 2026-02-25T17:21:31.039 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.032+0000 7f64de28a640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64d808c700 con 0x7f64d8098610 2026-02-25T17:21:31.039 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.032+0000 7f64dc800640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f64d8098610 0x7f64d8098ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.039 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.032+0000 7f64d7fff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f64d806dfd0 0x7f64d806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.040 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.032+0000 7f64d77fe640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f64d806e8f0 0x7f64d80980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.040 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.032+0000 7f64d77fe640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f64d806e8f0 0x7f64d80980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:36080/0 (socket says 10.20.193.76:36080) 2026-02-25T17:21:31.040 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.032+0000 7f64d77fe640 1 -- 10.20.193.76:0/4284047155 learned_addr learned my addr 10.20.193.76:0/4284047155 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:31.040 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.032+0000 7f64dc800640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f64d8098610 0x7f64d8098ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39348/0 (socket says 10.20.193.76:39348) 2026-02-25T17:21:31.040 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.032+0000 7f64d7fff640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f64d806dfd0 0x7f64d806e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50778/0 (socket says 10.20.193.76:50778) 2026-02-25T17:21:31.040 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.033+0000 7f64d77fe640 1 -- 10.20.193.76:0/4284047155 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f64d8098610 msgr2=0x7f64d8098ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:31.040 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.033+0000 7f64d77fe640 1 --2- 10.20.193.76:0/4284047155 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f64d8098610 0x7f64d8098ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.040 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.033+0000 7f64d77fe640 1 -- 10.20.193.76:0/4284047155 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f64d806dfd0 msgr2=0x7f64d806e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:31.040 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.033+0000 7f64d77fe640 1 --2- 10.20.193.76:0/4284047155 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f64d806dfd0 0x7f64d806e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.040 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.033+0000 7f64d77fe640 1 -- 10.20.193.76:0/4284047155 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d809d9a0 con 0x7f64d806e8f0 2026-02-25T17:21:31.040 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.033+0000 7f64dc800640 1 --2- 10.20.193.76:0/4284047155 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f64d8098610 0x7f64d8098ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:31.041 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.033+0000 7f64d77fe640 1 --2- 10.20.193.76:0/4284047155 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f64d806e8f0 0x7f64d80980d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009970 tx=0x7f64c802eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71bf634751220617 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:31.041 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.033+0000 7f64d6ffd640 1 -- 10.20.193.76:0/4284047155 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c802fb50 con 0x7f64d806e8f0 2026-02-25T17:21:31.041 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.033+0000 7f64d6ffd640 1 -- 10.20.193.76:0/4284047155 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c802fcb0 con 0x7f64d806e8f0 2026-02-25T17:21:31.041 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.033+0000 7f64d6ffd640 1 -- 10.20.193.76:0/4284047155 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8037660 con 0x7f64d806e8f0 2026-02-25T17:21:31.041 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.033+0000 7f64de28a640 1 -- 10.20.193.76:0/4284047155 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f64d806e8f0 msgr2=0x7f64d80980d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.041 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.033+0000 7f64de28a640 1 --2- 10.20.193.76:0/4284047155 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f64d806e8f0 0x7f64d80980d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009970 tx=0x7f64c802eee0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.041 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.033+0000 7f64de28a640 1 -- 10.20.193.76:0/4284047155 shutdown_connections 2026-02-25T17:21:31.041 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.033+0000 7f64de28a640 1 --2- 10.20.193.76:0/4284047155 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f64d8098610 0x7f64d8098ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.041 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.033+0000 7f64de28a640 1 --2- 10.20.193.76:0/4284047155 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f64d806e8f0 0x7f64d80980d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.041 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.033+0000 7f64de28a640 1 --2- 10.20.193.76:0/4284047155 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f64d806dfd0 0x7f64d806e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.041 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.033+0000 7f64de28a640 1 -- 10.20.193.76:0/4284047155 >> 10.20.193.76:0/4284047155 conn(0x7f64d809a960 msgr2=0x7f64d809ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:31.041 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.033+0000 7f64de28a640 1 -- 10.20.193.76:0/4284047155 shutdown_connections 2026-02-25T17:21:31.042 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.033+0000 7f64de28a640 1 -- 10.20.193.76:0/4284047155 wait complete. 2026-02-25T17:21:31.042 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64de28a640 1 Processor -- start 2026-02-25T17:21:31.042 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64de28a640 1 -- start start 2026-02-25T17:21:31.042 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64de28a640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f64d806dfd0 0x7f64d81c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.042 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64de28a640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f64d806e8f0 0x7f64d81c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.042 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64de28a640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f64d8098610 0x7f64d8131be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.042 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64de28a640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d8070670 con 0x7f64d806e8f0 2026-02-25T17:21:31.042 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64de28a640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d80711a0 con 0x7f64d8098610 2026-02-25T17:21:31.042 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64de28a640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64d8095f90 con 0x7f64d806dfd0 2026-02-25T17:21:31.042 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64d77fe640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f64d806e8f0 0x7f64d81c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.042 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64d7fff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f64d806dfd0 0x7f64d81c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.042 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64d77fe640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f64d806e8f0 0x7f64d81c5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:36084/0 (socket says 10.20.193.76:36084) 2026-02-25T17:21:31.043 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64dc800640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f64d8098610 0x7f64d8131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.043 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64d77fe640 1 -- 10.20.193.76:0/1209577038 learned_addr learned my addr 10.20.193.76:0/1209577038 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:31.043 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64d7fff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f64d806dfd0 0x7f64d81c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39350/0 (socket says 10.20.193.76:39350) 2026-02-25T17:21:31.043 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64d77fe640 1 -- 10.20.193.76:0/1209577038 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f64d806dfd0 msgr2=0x7f64d81c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.043 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64d77fe640 1 --2- 10.20.193.76:0/1209577038 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f64d806dfd0 0x7f64d81c57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.043 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64d77fe640 1 -- 10.20.193.76:0/1209577038 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f64d8098610 msgr2=0x7f64d8131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.043 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64d77fe640 1 --2- 10.20.193.76:0/1209577038 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f64d8098610 0x7f64d8131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.043 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64d77fe640 1 -- 10.20.193.76:0/1209577038 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc009a70 con 0x7f64d806e8f0 2026-02-25T17:21:31.043 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64d7fff640 1 --2- 10.20.193.76:0/1209577038 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f64d806dfd0 0x7f64d81c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:31.043 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64d77fe640 1 --2- 10.20.193.76:0/1209577038 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f64d806e8f0 0x7f64d81c5d20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009aa0 tx=0x7f64c80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:31.043 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64d4ff9640 1 -- 10.20.193.76:0/1209577038 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8040660 con 0x7f64d806e8f0 2026-02-25T17:21:31.043 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.034+0000 7f64d4ff9640 1 -- 10.20.193.76:0/1209577038 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c80407c0 con 0x7f64d806e8f0 2026-02-25T17:21:31.043 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.035+0000 7f64de28a640 1 -- 10.20.193.76:0/1209577038 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c80095d0 con 0x7f64d806e8f0 2026-02-25T17:21:31.044 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.035+0000 7f64d4ff9640 1 -- 10.20.193.76:0/1209577038 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8040b70 con 0x7f64d806e8f0 2026-02-25T17:21:31.044 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.035+0000 7f64de28a640 1 -- 10.20.193.76:0/1209577038 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d8070120 con 0x7f64d806e8f0 2026-02-25T17:21:31.044 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.035+0000 7f64de28a640 1 -- 10.20.193.76:0/1209577038 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d80980d0 con 0x7f64d806e8f0 2026-02-25T17:21:31.044 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.035+0000 7f64d4ff9640 1 -- 10.20.193.76:0/1209577038 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f64c8049020 con 0x7f64d806e8f0 2026-02-25T17:21:31.044 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.035+0000 7f64d4ff9640 1 -- 10.20.193.76:0/1209577038 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7f64c808bc80 con 0x7f64d806e8f0 2026-02-25T17:21:31.044 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.037+0000 7f64d4ff9640 1 -- 10.20.193.76:0/1209577038 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f64c8065710 con 0x7f64d806e8f0 2026-02-25T17:21:31.103 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.100+0000 7f64de28a640 1 -- 10.20.193.76:0/1209577038 --> v1:10.20.193.76:6800/1563581135 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f64d812c960 con 0x7f64a804f880 2026-02-25T17:21:31.104 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.101+0000 7f64d4ff9640 1 -- 10.20.193.76:0/1209577038 <== mgr.14104 v1:10.20.193.76:6800/1563581135 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34749 (unknown 2965378022 0 1888316965) 0x7f64d812c960 con 0x7f64a804f880 2026-02-25T17:21:31.105 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:31.107 INFO:teuthology.orchestra.run.trial076.stderr:dumped all 2026-02-25T17:21:31.107 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.102+0000 7f64de28a640 1 -- 10.20.193.76:0/1209577038 >> v1:10.20.193.76:6800/1563581135 conn(0x7f64a804f880 legacy=0x7f64a8051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.107 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.102+0000 7f64de28a640 1 -- 10.20.193.76:0/1209577038 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f64d806e8f0 msgr2=0x7f64d81c5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.107 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.102+0000 7f64de28a640 1 --2- 10.20.193.76:0/1209577038 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f64d806e8f0 0x7f64d81c5d20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f64c8009aa0 tx=0x7f64c80047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.108 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.102+0000 7f64de28a640 1 -- 10.20.193.76:0/1209577038 shutdown_connections 2026-02-25T17:21:31.108 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.102+0000 7f64de28a640 1 --2- 10.20.193.76:0/1209577038 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f64d8098610 0x7f64d8131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.108 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.102+0000 7f64de28a640 1 --2- 10.20.193.76:0/1209577038 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f64d806e8f0 0x7f64d81c5d20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.108 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.102+0000 7f64de28a640 1 --2- 10.20.193.76:0/1209577038 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f64d806dfd0 0x7f64d81c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.108 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.102+0000 7f64de28a640 1 -- 10.20.193.76:0/1209577038 >> 10.20.193.76:0/1209577038 conn(0x7f64d809a960 msgr2=0x7f64d8096250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:31.108 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.102+0000 7f64de28a640 1 -- 10.20.193.76:0/1209577038 shutdown_connections 2026-02-25T17:21:31.109 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.102+0000 7f64de28a640 1 -- 10.20.193.76:0/1209577038 wait complete. 2026-02-25T17:21:31.112 INFO:teuthology.orchestra.run.trial076.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2026-02-25T17:21:31.047594+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":111940,"kb_used_data":2104,"kb_used_omap":17,"kb_used_meta":109742,"kb_avail":377375420,"statfs":{"total":386547056640,"available":386432430080,"internally_reserved":0,"allocated":2154496,"data_stored":1521283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18185,"internal_metadata":112376055},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000584"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199182+0000","last_change":"2026-02-25T17:21:24.194818+0000","last_active":"2026-02-25T17:21:26.199182+0000","last_peered":"2026-02-25T17:21:26.199182+0000","last_clean":"2026-02-25T17:21:26.199182+0000","last_became_active":"2026-02-25T17:21:24.194619+0000","last_became_peered":"2026-02-25T17:21:24.194619+0000","last_unstale":"2026-02-25T17:21:26.199182+0000","last_undegraded":"2026-02-25T17:21:26.199182+0000","last_fullsized":"2026-02-25T17:21:26.199182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:59:31.300444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198898+0000","last_change":"2026-02-25T17:21:24.194618+0000","last_active":"2026-02-25T17:21:26.198898+0000","last_peered":"2026-02-25T17:21:26.198898+0000","last_clean":"2026-02-25T17:21:26.198898+0000","last_became_active":"2026-02-25T17:21:24.194411+0000","last_became_peered":"2026-02-25T17:21:24.194411+0000","last_unstale":"2026-02-25T17:21:26.198898+0000","last_undegraded":"2026-02-25T17:21:26.198898+0000","last_fullsized":"2026-02-25T17:21:26.198898+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:40:43.331156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000395898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199198+0000","last_change":"2026-02-25T17:21:24.195559+0000","last_active":"2026-02-25T17:21:26.199198+0000","last_peered":"2026-02-25T17:21:26.199198+0000","last_clean":"2026-02-25T17:21:26.199198+0000","last_became_active":"2026-02-25T17:21:24.195473+0000","last_became_peered":"2026-02-25T17:21:24.195473+0000","last_unstale":"2026-02-25T17:21:26.199198+0000","last_undegraded":"2026-02-25T17:21:26.199198+0000","last_fullsized":"2026-02-25T17:21:26.199198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:22:24.234703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026897200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198922+0000","last_change":"2026-02-25T17:21:24.194793+0000","last_active":"2026-02-25T17:21:26.198922+0000","last_peered":"2026-02-25T17:21:26.198922+0000","last_clean":"2026-02-25T17:21:26.198922+0000","last_became_active":"2026-02-25T17:21:24.194561+0000","last_became_peered":"2026-02-25T17:21:24.194561+0000","last_unstale":"2026-02-25T17:21:26.198922+0000","last_undegraded":"2026-02-25T17:21:26.198922+0000","last_fullsized":"2026-02-25T17:21:26.198922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:02:43.748049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038440700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"16'79","reported_seq":149,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198864+0000","last_change":"2026-02-25T17:21:24.195059+0000","last_active":"2026-02-25T17:21:26.198864+0000","last_peered":"2026-02-25T17:21:26.198864+0000","last_clean":"2026-02-25T17:21:26.198864+0000","last_became_active":"2026-02-25T17:21:24.194928+0000","last_became_peered":"2026-02-25T17:21:24.194928+0000","last_unstale":"2026-02-25T17:21:26.198864+0000","last_undegraded":"2026-02-25T17:21:26.198864+0000","last_fullsized":"2026-02-25T17:21:26.198864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:21:32.983159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199155+0000","last_change":"2026-02-25T17:21:23.192944+0000","last_active":"2026-02-25T17:21:26.199155+0000","last_peered":"2026-02-25T17:21:26.199155+0000","last_clean":"2026-02-25T17:21:26.199155+0000","last_became_active":"2026-02-25T17:21:23.192745+0000","last_became_peered":"2026-02-25T17:21:23.192745+0000","last_unstale":"2026-02-25T17:21:26.199155+0000","last_undegraded":"2026-02-25T17:21:26.199155+0000","last_fullsized":"2026-02-25T17:21:26.199155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:12:01.863576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033429400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.391364+0000","last_change":"2026-02-25T17:21:22.189219+0000","last_active":"2026-02-25T17:21:26.391364+0000","last_peered":"2026-02-25T17:21:26.391364+0000","last_clean":"2026-02-25T17:21:26.391364+0000","last_became_active":"2026-02-25T17:21:22.189043+0000","last_became_peered":"2026-02-25T17:21:22.189043+0000","last_unstale":"2026-02-25T17:21:26.391364+0000","last_undegraded":"2026-02-25T17:21:26.391364+0000","last_fullsized":"2026-02-25T17:21:26.391364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:14:12.733416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083336499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198893+0000","last_change":"2026-02-25T17:21:24.194744+0000","last_active":"2026-02-25T17:21:26.198893+0000","last_peered":"2026-02-25T17:21:26.198893+0000","last_clean":"2026-02-25T17:21:26.198893+0000","last_became_active":"2026-02-25T17:21:24.194527+0000","last_became_peered":"2026-02-25T17:21:24.194527+0000","last_unstale":"2026-02-25T17:21:26.198893+0000","last_undegraded":"2026-02-25T17:21:26.198893+0000","last_fullsized":"2026-02-25T17:21:26.198893+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:08:42.357152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054556799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199174+0000","last_change":"2026-02-25T17:21:22.188981+0000","last_active":"2026-02-25T17:21:26.199174+0000","last_peered":"2026-02-25T17:21:26.199174+0000","last_clean":"2026-02-25T17:21:26.199174+0000","last_became_active":"2026-02-25T17:21:22.188810+0000","last_became_peered":"2026-02-25T17:21:22.188810+0000","last_unstale":"2026-02-25T17:21:26.199174+0000","last_undegraded":"2026-02-25T17:21:26.199174+0000","last_fullsized":"2026-02-25T17:21:26.199174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:20:57.540380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056038500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":25,"seq":107374182403,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28288,"kb_used_data":812,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94343552,"statfs":{"total":96636764160,"available":96607797248,"internally_reserved":0,"allocated":831488,"data_stored":674090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4549,"internal_metadata":28110395},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.14399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]}]},{"osd":2,"up_from":24,"seq":103079215107,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":228,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":233472,"data_stored":83106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":28110400},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.11799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20499999999999999}]}]},{"osd":1,"up_from":23,"seq":98784247812,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":824,"kb_used_omap":4,"kb_used_meta":27387,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":843776,"data_stored":677704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4548,"internal_metadata":28044860},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]}]},{"osd":0,"up_from":22,"seq":94489280516,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":240,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":245760,"data_stored":86383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":28110400},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T17:21:31.115 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T17:21:31.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.179+0000 7f2cc11b1640 1 Processor -- start 2026-02-25T17:21:31.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.180+0000 7f2cc11b1640 1 -- start start 2026-02-25T17:21:31.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.180+0000 7f2cc11b1640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f2cbc12b220 0x7f2cbc12b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.180+0000 7f2cc11b1640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2cbc06c100 0x7f2cbc06c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.180+0000 7f2cc11b1640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2cbc06caf0 0x7f2cbc135630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.186 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.180+0000 7f2cc11b1640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cbc06d880 con 0x7f2cbc12b220 2026-02-25T17:21:31.187 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.180+0000 7f2cc11b1640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc12ad40 con 0x7f2cbc06caf0 2026-02-25T17:21:31.187 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.180+0000 7f2cc11b1640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc06cf80 con 0x7f2cbc06c100 2026-02-25T17:21:31.187 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.180+0000 7f2cba575640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2cbc06c100 0x7f2cbc06c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.187 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.180+0000 7f2cbad76640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f2cbc12b220 0x7f2cbc12b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.187 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.180+0000 7f2cbb577640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2cbc06caf0 0x7f2cbc135630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.187 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.180+0000 7f2cba575640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2cbc06c100 0x7f2cbc06c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39358/0 (socket says 10.20.193.76:39358) 2026-02-25T17:21:31.187 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.180+0000 7f2cba575640 1 -- 10.20.193.76:0/3374366604 learned_addr learned my addr 10.20.193.76:0/3374366604 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:31.187 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.180+0000 7f2cbb577640 1 -- 10.20.193.76:0/3374366604 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2cbc06c100 msgr2=0x7f2cbc06c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:31.187 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.180+0000 7f2cbb577640 1 --2- 10.20.193.76:0/3374366604 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2cbc06c100 0x7f2cbc06c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.187 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.180+0000 7f2cbb577640 1 -- 10.20.193.76:0/3374366604 >> v2:10.20.193.76:3300/0 conn(0x7f2cbc12b220 msgr2=0x7f2cbc12b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:31.187 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.180+0000 7f2cbb577640 1 --2- 10.20.193.76:0/3374366604 >> v2:10.20.193.76:3300/0 conn(0x7f2cbc12b220 0x7f2cbc12b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.188 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.180+0000 7f2cbb577640 1 -- 10.20.193.76:0/3374366604 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cbc06dc80 con 0x7f2cbc06caf0 2026-02-25T17:21:31.188 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.181+0000 7f2cbb577640 1 --2- 10.20.193.76:0/3374366604 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2cbc06caf0 0x7f2cbc135630 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009df0 tx=0x7f2cac02f200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74869d7b11813653 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:31.188 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.181+0000 7f2cb9d74640 1 -- 10.20.193.76:0/3374366604 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac006ea0 con 0x7f2cbc06caf0 2026-02-25T17:21:31.188 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.181+0000 7f2cb9d74640 1 -- 10.20.193.76:0/3374366604 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cac02fe30 con 0x7f2cbc06caf0 2026-02-25T17:21:31.188 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.181+0000 7f2cb9d74640 1 -- 10.20.193.76:0/3374366604 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac037660 con 0x7f2cbc06caf0 2026-02-25T17:21:31.188 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.181+0000 7f2cc11b1640 1 -- 10.20.193.76:0/3374366604 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2cbc06caf0 msgr2=0x7f2cbc135630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.188 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.181+0000 7f2cc11b1640 1 --2- 10.20.193.76:0/3374366604 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2cbc06caf0 0x7f2cbc135630 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009df0 tx=0x7f2cac02f200 comp rx=0 tx=0).stop 2026-02-25T17:21:31.188 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.181+0000 7f2cc11b1640 1 -- 10.20.193.76:0/3374366604 shutdown_connections 2026-02-25T17:21:31.188 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.181+0000 7f2cc11b1640 1 --2- 10.20.193.76:0/3374366604 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2cbc06caf0 0x7f2cbc135630 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.188 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.181+0000 7f2cc11b1640 1 --2- 10.20.193.76:0/3374366604 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2cbc06c100 0x7f2cbc06c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.188 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.181+0000 7f2cc11b1640 1 --2- 10.20.193.76:0/3374366604 >> v2:10.20.193.76:3300/0 conn(0x7f2cbc12b220 0x7f2cbc12b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.188 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.181+0000 7f2cc11b1640 1 -- 10.20.193.76:0/3374366604 >> 10.20.193.76:0/3374366604 conn(0x7f2cbc09f050 msgr2=0x7f2cbc09f460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:31.189 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.181+0000 7f2cc11b1640 1 -- 10.20.193.76:0/3374366604 shutdown_connections 2026-02-25T17:21:31.189 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.181+0000 7f2cc11b1640 1 -- 10.20.193.76:0/3374366604 wait complete. 2026-02-25T17:21:31.189 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cc11b1640 1 Processor -- start 2026-02-25T17:21:31.189 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cc11b1640 1 -- start start 2026-02-25T17:21:31.189 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cc11b1640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2cbc06c100 0x7f2cbc1c5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.189 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cc11b1640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2cbc06caf0 0x7f2cbc1c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.189 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cc11b1640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2cbc12b220 0x7f2cbc11d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.189 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cc11b1640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc11f5b0 con 0x7f2cbc06c100 2026-02-25T17:21:31.189 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cc11b1640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc11f7c0 con 0x7f2cbc12b220 2026-02-25T17:21:31.189 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cc11b1640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cbc128a30 con 0x7f2cbc06caf0 2026-02-25T17:21:31.189 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cbad76640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2cbc06c100 0x7f2cbc1c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.189 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cbad76640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2cbc06c100 0x7f2cbc1c5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:36098/0 (socket says 10.20.193.76:36098) 2026-02-25T17:21:31.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cbad76640 1 -- 10.20.193.76:0/1520249958 learned_addr learned my addr 10.20.193.76:0/1520249958 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:31.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cba575640 1 --2- 10.20.193.76:0/1520249958 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2cbc06caf0 0x7f2cbc1c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cbb577640 1 --2- 10.20.193.76:0/1520249958 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2cbc12b220 0x7f2cbc11d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cbad76640 1 -- 10.20.193.76:0/1520249958 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2cbc06caf0 msgr2=0x7f2cbc1c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cbad76640 1 --2- 10.20.193.76:0/1520249958 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2cbc06caf0 0x7f2cbc1c58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cbad76640 1 -- 10.20.193.76:0/1520249958 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2cbc12b220 msgr2=0x7f2cbc11d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cbad76640 1 --2- 10.20.193.76:0/1520249958 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2cbc12b220 0x7f2cbc11d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cbad76640 1 -- 10.20.193.76:0/1520249958 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac009a70 con 0x7f2cbc06c100 2026-02-25T17:21:31.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cbad76640 1 --2- 10.20.193.76:0/1520249958 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2cbc06c100 0x7f2cbc1c5380 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2cb000ebe0 tx=0x7f2cb000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:31.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2c9b7fe640 1 -- 10.20.193.76:0/1520249958 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0009770 con 0x7f2cbc06c100 2026-02-25T17:21:31.190 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2c9b7fe640 1 -- 10.20.193.76:0/1520249958 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb000cc40 con 0x7f2cbc06c100 2026-02-25T17:21:31.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cc11b1640 1 -- 10.20.193.76:0/1520249958 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cbc120120 con 0x7f2cbc06c100 2026-02-25T17:21:31.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2c9b7fe640 1 -- 10.20.193.76:0/1520249958 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0013470 con 0x7f2cbc06c100 2026-02-25T17:21:31.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.182+0000 7f2cc11b1640 1 -- 10.20.193.76:0/1520249958 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cbc11d7b0 con 0x7f2cbc06c100 2026-02-25T17:21:31.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.183+0000 7f2cc11b1640 1 -- 10.20.193.76:0/1520249958 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cbc067d80 con 0x7f2cbc06c100 2026-02-25T17:21:31.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.183+0000 7f2c9b7fe640 1 -- 10.20.193.76:0/1520249958 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f2cb0011070 con 0x7f2cbc06c100 2026-02-25T17:21:31.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.183+0000 7f2c9b7fe640 1 -- 10.20.193.76:0/1520249958 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7f2cb0066870 con 0x7f2cbc06c100 2026-02-25T17:21:31.191 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.185+0000 7f2c9b7fe640 1 -- 10.20.193.76:0/1520249958 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f2cb00401f0 con 0x7f2cbc06c100 2026-02-25T17:21:31.253 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.251+0000 7f2cc11b1640 1 -- 10.20.193.76:0/1520249958 --> v1:10.20.193.76:6800/1563581135 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2cbc09e000 con 0x7f2c8804f8b0 2026-02-25T17:21:31.254 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.252+0000 7f2c9b7fe640 1 -- 10.20.193.76:0/1520249958 <== mgr.14104 v1:10.20.193.76:6800/1563581135 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34749 (unknown 2965378022 0 1888316965) 0x7f2ca4009820 con 0x7f2c8804f8b0 2026-02-25T17:21:31.255 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:31.256 INFO:teuthology.orchestra.run.trial076.stderr:dumped all 2026-02-25T17:21:31.256 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.252+0000 7f2cc11b1640 1 -- 10.20.193.76:0/1520249958 >> v1:10.20.193.76:6800/1563581135 conn(0x7f2c8804f8b0 legacy=0x7f2c88051d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.256 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.252+0000 7f2cc11b1640 1 -- 10.20.193.76:0/1520249958 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2cbc06c100 msgr2=0x7f2cbc1c5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.256 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.252+0000 7f2cc11b1640 1 --2- 10.20.193.76:0/1520249958 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2cbc06c100 0x7f2cbc1c5380 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2cb000ebe0 tx=0x7f2cb000c520 comp rx=0 tx=0).stop 2026-02-25T17:21:31.256 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.252+0000 7f2cc11b1640 1 -- 10.20.193.76:0/1520249958 shutdown_connections 2026-02-25T17:21:31.256 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.252+0000 7f2cc11b1640 1 --2- 10.20.193.76:0/1520249958 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f2cbc12b220 0x7f2cbc11d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.256 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.252+0000 7f2cc11b1640 1 --2- 10.20.193.76:0/1520249958 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f2cbc06caf0 0x7f2cbc1c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.256 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.252+0000 7f2cc11b1640 1 --2- 10.20.193.76:0/1520249958 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f2cbc06c100 0x7f2cbc1c5380 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.257 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.252+0000 7f2cc11b1640 1 -- 10.20.193.76:0/1520249958 >> 10.20.193.76:0/1520249958 conn(0x7f2cbc09f050 msgr2=0x7f2cbc12e090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:31.257 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.252+0000 7f2cc11b1640 1 -- 10.20.193.76:0/1520249958 shutdown_connections 2026-02-25T17:21:31.257 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.252+0000 7f2cc11b1640 1 -- 10.20.193.76:0/1520249958 wait complete. 2026-02-25T17:21:31.262 INFO:teuthology.orchestra.run.trial076.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2026-02-25T17:21:31.047594+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":111940,"kb_used_data":2104,"kb_used_omap":17,"kb_used_meta":109742,"kb_avail":377375420,"statfs":{"total":386547056640,"available":386432430080,"internally_reserved":0,"allocated":2154496,"data_stored":1521283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18185,"internal_metadata":112376055},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000584"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199182+0000","last_change":"2026-02-25T17:21:24.194818+0000","last_active":"2026-02-25T17:21:26.199182+0000","last_peered":"2026-02-25T17:21:26.199182+0000","last_clean":"2026-02-25T17:21:26.199182+0000","last_became_active":"2026-02-25T17:21:24.194619+0000","last_became_peered":"2026-02-25T17:21:24.194619+0000","last_unstale":"2026-02-25T17:21:26.199182+0000","last_undegraded":"2026-02-25T17:21:26.199182+0000","last_fullsized":"2026-02-25T17:21:26.199182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:59:31.300444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198898+0000","last_change":"2026-02-25T17:21:24.194618+0000","last_active":"2026-02-25T17:21:26.198898+0000","last_peered":"2026-02-25T17:21:26.198898+0000","last_clean":"2026-02-25T17:21:26.198898+0000","last_became_active":"2026-02-25T17:21:24.194411+0000","last_became_peered":"2026-02-25T17:21:24.194411+0000","last_unstale":"2026-02-25T17:21:26.198898+0000","last_undegraded":"2026-02-25T17:21:26.198898+0000","last_fullsized":"2026-02-25T17:21:26.198898+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:40:43.331156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000395898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199198+0000","last_change":"2026-02-25T17:21:24.195559+0000","last_active":"2026-02-25T17:21:26.199198+0000","last_peered":"2026-02-25T17:21:26.199198+0000","last_clean":"2026-02-25T17:21:26.199198+0000","last_became_active":"2026-02-25T17:21:24.195473+0000","last_became_peered":"2026-02-25T17:21:24.195473+0000","last_unstale":"2026-02-25T17:21:26.199198+0000","last_undegraded":"2026-02-25T17:21:26.199198+0000","last_fullsized":"2026-02-25T17:21:26.199198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:22:24.234703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026897200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198922+0000","last_change":"2026-02-25T17:21:24.194793+0000","last_active":"2026-02-25T17:21:26.198922+0000","last_peered":"2026-02-25T17:21:26.198922+0000","last_clean":"2026-02-25T17:21:26.198922+0000","last_became_active":"2026-02-25T17:21:24.194561+0000","last_became_peered":"2026-02-25T17:21:24.194561+0000","last_unstale":"2026-02-25T17:21:26.198922+0000","last_undegraded":"2026-02-25T17:21:26.198922+0000","last_fullsized":"2026-02-25T17:21:26.198922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:02:43.748049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038440700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"16'79","reported_seq":149,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198864+0000","last_change":"2026-02-25T17:21:24.195059+0000","last_active":"2026-02-25T17:21:26.198864+0000","last_peered":"2026-02-25T17:21:26.198864+0000","last_clean":"2026-02-25T17:21:26.198864+0000","last_became_active":"2026-02-25T17:21:24.194928+0000","last_became_peered":"2026-02-25T17:21:24.194928+0000","last_unstale":"2026-02-25T17:21:26.198864+0000","last_undegraded":"2026-02-25T17:21:26.198864+0000","last_fullsized":"2026-02-25T17:21:26.198864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:21:32.983159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199155+0000","last_change":"2026-02-25T17:21:23.192944+0000","last_active":"2026-02-25T17:21:26.199155+0000","last_peered":"2026-02-25T17:21:26.199155+0000","last_clean":"2026-02-25T17:21:26.199155+0000","last_became_active":"2026-02-25T17:21:23.192745+0000","last_became_peered":"2026-02-25T17:21:23.192745+0000","last_unstale":"2026-02-25T17:21:26.199155+0000","last_undegraded":"2026-02-25T17:21:26.199155+0000","last_fullsized":"2026-02-25T17:21:26.199155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:12:01.863576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033429400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.391364+0000","last_change":"2026-02-25T17:21:22.189219+0000","last_active":"2026-02-25T17:21:26.391364+0000","last_peered":"2026-02-25T17:21:26.391364+0000","last_clean":"2026-02-25T17:21:26.391364+0000","last_became_active":"2026-02-25T17:21:22.189043+0000","last_became_peered":"2026-02-25T17:21:22.189043+0000","last_unstale":"2026-02-25T17:21:26.391364+0000","last_undegraded":"2026-02-25T17:21:26.391364+0000","last_fullsized":"2026-02-25T17:21:26.391364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:14:12.733416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083336499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198893+0000","last_change":"2026-02-25T17:21:24.194744+0000","last_active":"2026-02-25T17:21:26.198893+0000","last_peered":"2026-02-25T17:21:26.198893+0000","last_clean":"2026-02-25T17:21:26.198893+0000","last_became_active":"2026-02-25T17:21:24.194527+0000","last_became_peered":"2026-02-25T17:21:24.194527+0000","last_unstale":"2026-02-25T17:21:26.198893+0000","last_undegraded":"2026-02-25T17:21:26.198893+0000","last_fullsized":"2026-02-25T17:21:26.198893+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:08:42.357152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054556799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199174+0000","last_change":"2026-02-25T17:21:22.188981+0000","last_active":"2026-02-25T17:21:26.199174+0000","last_peered":"2026-02-25T17:21:26.199174+0000","last_clean":"2026-02-25T17:21:26.199174+0000","last_became_active":"2026-02-25T17:21:22.188810+0000","last_became_peered":"2026-02-25T17:21:22.188810+0000","last_unstale":"2026-02-25T17:21:26.199174+0000","last_undegraded":"2026-02-25T17:21:26.199174+0000","last_fullsized":"2026-02-25T17:21:26.199174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:20:57.540380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056038500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":25,"seq":107374182403,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28288,"kb_used_data":812,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94343552,"statfs":{"total":96636764160,"available":96607797248,"internally_reserved":0,"allocated":831488,"data_stored":674090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4549,"internal_metadata":28110395},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.14399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]}]},{"osd":2,"up_from":24,"seq":103079215107,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":228,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":233472,"data_stored":83106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":28110400},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.11799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20499999999999999}]}]},{"osd":1,"up_from":23,"seq":98784247812,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":824,"kb_used_omap":4,"kb_used_meta":27387,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":843776,"data_stored":677704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4548,"internal_metadata":28044860},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]}]},{"osd":0,"up_from":22,"seq":94489280516,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":240,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":245760,"data_stored":86383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":28110400},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T17:21:31.264 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-25T17:21:31.264 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T17:21:31.334 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.328+0000 7fcfc7a49640 1 Processor -- start 2026-02-25T17:21:31.335 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.328+0000 7fcfc7a49640 1 -- start start 2026-02-25T17:21:31.335 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.328+0000 7fcfc7a49640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fcfc006dfd0 0x7fcfc006e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.335 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.329+0000 7fcfc7a49640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fcfc006e8f0 0x7fcfc00980d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.335 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.329+0000 7fcfc7a49640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc009d9a0 con 0x7fcfc0098610 2026-02-25T17:21:31.335 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.329+0000 7fcfc7a49640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc0099190 con 0x7fcfc006e8f0 2026-02-25T17:21:31.335 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.329+0000 7fcfc7a49640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc008c910 con 0x7fcfc006dfd0 2026-02-25T17:21:31.335 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.329+0000 7fcfc57be640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fcfc006dfd0 0x7fcfc006e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.335 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.329+0000 7fcfc57be640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fcfc006dfd0 0x7fcfc006e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39366/0 (socket says 10.20.193.76:39366) 2026-02-25T17:21:31.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.329+0000 7fcfc57be640 1 -- 10.20.193.76:0/91074190 learned_addr learned my addr 10.20.193.76:0/91074190 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:31.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.329+0000 7fcfc4fbd640 1 --2- 10.20.193.76:0/91074190 >> v2:10.20.193.76:3300/0 conn(0x7fcfc006e8f0 0x7fcfc00980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.329+0000 7fcfc57be640 1 -- 10.20.193.76:0/91074190 >> v2:10.20.193.76:3300/0 conn(0x7fcfc006e8f0 msgr2=0x7fcfc00980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:31.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.329+0000 7fcfc57be640 1 --2- 10.20.193.76:0/91074190 >> v2:10.20.193.76:3300/0 conn(0x7fcfc006e8f0 0x7fcfc00980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.329+0000 7fcfc57be640 1 -- 10.20.193.76:0/91074190 >> v1:10.20.193.76:6789/0 conn(0x7fcfc0098610 legacy=0x7fcfc0133700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.329+0000 7fcfc57be640 1 -- 10.20.193.76:0/91074190 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc0072260 con 0x7fcfc006dfd0 2026-02-25T17:21:31.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.329+0000 7fcfc57be640 1 --2- 10.20.193.76:0/91074190 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fcfc006dfd0 0x7fcfc006e3b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009970 tx=0x7fcfb002eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1065e6a8e280cfd server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:31.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.329+0000 7fcfaffff640 1 -- 10.20.193.76:0/91074190 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb002fbb0 con 0x7fcfc006dfd0 2026-02-25T17:21:31.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.329+0000 7fcfaffff640 1 -- 10.20.193.76:0/91074190 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb002fd10 con 0x7fcfc006dfd0 2026-02-25T17:21:31.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.329+0000 7fcfaffff640 1 -- 10.20.193.76:0/91074190 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0037660 con 0x7fcfc006dfd0 2026-02-25T17:21:31.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.330+0000 7fcfc7a49640 1 -- 10.20.193.76:0/91074190 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fcfc006dfd0 msgr2=0x7fcfc006e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.336 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.330+0000 7fcfc7a49640 1 --2- 10.20.193.76:0/91074190 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fcfc006dfd0 0x7fcfc006e3b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009970 tx=0x7fcfb002eef0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.330+0000 7fcfc7a49640 1 -- 10.20.193.76:0/91074190 shutdown_connections 2026-02-25T17:21:31.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.330+0000 7fcfc7a49640 1 --2- 10.20.193.76:0/91074190 >> v2:10.20.193.76:3300/0 conn(0x7fcfc006e8f0 0x7fcfc00980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.330+0000 7fcfc7a49640 1 --2- 10.20.193.76:0/91074190 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fcfc006dfd0 0x7fcfc006e3b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.330+0000 7fcfc7a49640 1 -- 10.20.193.76:0/91074190 >> 10.20.193.76:0/91074190 conn(0x7fcfc009a960 msgr2=0x7fcfc009ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:31.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.330+0000 7fcfc7a49640 1 -- 10.20.193.76:0/91074190 shutdown_connections 2026-02-25T17:21:31.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.330+0000 7fcfc7a49640 1 -- 10.20.193.76:0/91074190 wait complete. 2026-02-25T17:21:31.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.330+0000 7fcfc7a49640 1 Processor -- start 2026-02-25T17:21:31.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.330+0000 7fcfc7a49640 1 -- start start 2026-02-25T17:21:31.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc7a49640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fcfc006dfd0 0x7fcfc01c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc7a49640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fcfc006e8f0 0x7fcfc01c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.337 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc7a49640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fcfc0098610 0x7fcfc0124910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc7a49640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc0126910 con 0x7fcfc006e8f0 2026-02-25T17:21:31.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc7a49640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc008cf90 con 0x7fcfc0098610 2026-02-25T17:21:31.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc7a49640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc008d7c0 con 0x7fcfc006dfd0 2026-02-25T17:21:31.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc57be640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fcfc006dfd0 0x7fcfc01c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc4fbd640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fcfc006e8f0 0x7fcfc01c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc57be640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fcfc006dfd0 0x7fcfc01c3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39370/0 (socket says 10.20.193.76:39370) 2026-02-25T17:21:31.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc57be640 1 -- 10.20.193.76:0/156946203 learned_addr learned my addr 10.20.193.76:0/156946203 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:31.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc5fbf640 1 --2- 10.20.193.76:0/156946203 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fcfc0098610 0x7fcfc0124910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc57be640 1 -- 10.20.193.76:0/156946203 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fcfc0098610 msgr2=0x7fcfc0124910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc57be640 1 --2- 10.20.193.76:0/156946203 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fcfc0098610 0x7fcfc0124910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.338 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc57be640 1 -- 10.20.193.76:0/156946203 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fcfc006e8f0 msgr2=0x7fcfc01c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc57be640 1 --2- 10.20.193.76:0/156946203 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fcfc006e8f0 0x7fcfc01c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc57be640 1 -- 10.20.193.76:0/156946203 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb00095d0 con 0x7fcfc006dfd0 2026-02-25T17:21:31.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc5fbf640 1 --2- 10.20.193.76:0/156946203 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fcfc0098610 0x7fcfc0124910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-25T17:21:31.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc57be640 1 --2- 10.20.193.76:0/156946203 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fcfc006dfd0 0x7fcfc01c3680 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009aa0 tx=0x7fcfb00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:31.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfadffb640 1 -- 10.20.193.76:0/156946203 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0040660 con 0x7fcfc006dfd0 2026-02-25T17:21:31.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfadffb640 1 -- 10.20.193.76:0/156946203 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb00407c0 con 0x7fcfc006dfd0 2026-02-25T17:21:31.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc7a49640 1 -- 10.20.193.76:0/156946203 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc008e370 con 0x7fcfc006dfd0 2026-02-25T17:21:31.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfadffb640 1 -- 10.20.193.76:0/156946203 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0040b70 con 0x7fcfc006dfd0 2026-02-25T17:21:31.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc7a49640 1 -- 10.20.193.76:0/156946203 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc01c4100 con 0x7fcfc006dfd0 2026-02-25T17:21:31.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.331+0000 7fcfc7a49640 1 -- 10.20.193.76:0/156946203 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc0098ea0 con 0x7fcfc006dfd0 2026-02-25T17:21:31.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.332+0000 7fcfadffb640 1 -- 10.20.193.76:0/156946203 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fcfb0049020 con 0x7fcfc006dfd0 2026-02-25T17:21:31.339 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.332+0000 7fcfadffb640 1 -- 10.20.193.76:0/156946203 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7fcfb008bdc0 con 0x7fcfc006dfd0 2026-02-25T17:21:31.340 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.334+0000 7fcfadffb640 1 -- 10.20.193.76:0/156946203 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7fcfb00657b0 con 0x7fcfc006dfd0 2026-02-25T17:21:31.400 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.398+0000 7fcfc7a49640 1 -- 10.20.193.76:0/156946203 --> v1:10.20.193.76:6800/1563581135 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcfc006d560 con 0x7fcf9004f8b0 2026-02-25T17:21:31.401 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.399+0000 7fcfadffb640 1 -- 10.20.193.76:0/156946203 <== mgr.14104 v1:10.20.193.76:6800/1563581135 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34749 (unknown 2965378022 0 1888316965) 0x7fcfc006d560 con 0x7fcf9004f8b0 2026-02-25T17:21:31.402 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:31.403 INFO:teuthology.orchestra.run.trial076.stderr:dumped all 2026-02-25T17:21:31.403 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.400+0000 7fcfc7a49640 1 -- 10.20.193.76:0/156946203 >> v1:10.20.193.76:6800/1563581135 conn(0x7fcf9004f8b0 legacy=0x7fcf90051d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.403 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.400+0000 7fcfc7a49640 1 -- 10.20.193.76:0/156946203 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fcfc006dfd0 msgr2=0x7fcfc01c3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.403 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.400+0000 7fcfc7a49640 1 --2- 10.20.193.76:0/156946203 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fcfc006dfd0 0x7fcfc01c3680 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009aa0 tx=0x7fcfb00047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.403 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.400+0000 7fcfc7a49640 1 -- 10.20.193.76:0/156946203 shutdown_connections 2026-02-25T17:21:31.403 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.400+0000 7fcfc7a49640 1 --2- 10.20.193.76:0/156946203 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fcfc0098610 0x7fcfc0124910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.403 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.400+0000 7fcfc7a49640 1 --2- 10.20.193.76:0/156946203 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fcfc006e8f0 0x7fcfc01c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.404 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.400+0000 7fcfc7a49640 1 --2- 10.20.193.76:0/156946203 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fcfc006dfd0 0x7fcfc01c3680 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.404 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.400+0000 7fcfc7a49640 1 -- 10.20.193.76:0/156946203 >> 10.20.193.76:0/156946203 conn(0x7fcfc009a960 msgr2=0x7fcfc006bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:31.404 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.400+0000 7fcfc7a49640 1 -- 10.20.193.76:0/156946203 shutdown_connections 2026-02-25T17:21:31.404 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.400+0000 7fcfc7a49640 1 -- 10.20.193.76:0/156946203 wait complete. 2026-02-25T17:21:31.410 INFO:teuthology.orchestra.run.trial076.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2026-02-25T17:21:31.047594+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":111940,"kb_used_data":2104,"kb_used_omap":17,"kb_used_meta":109742,"kb_avail":377375420,"statfs":{"total":386547056640,"available":386432430080,"internally_reserved":0,"allocated":2154496,"data_stored":1521283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18185,"internal_metadata":112376055},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000584"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199182+0000","last_change":"2026-02-25T17:21:24.194818+0000","last_active":"2026-02-25T17:21:26.199182+0000","last_peered":"2026-02-25T17:21:26.199182+0000","last_clean":"2026-02-25T17:21:26.199182+0000","last_became_active":"2026-02-25T17:21:24.194619+0000","last_became_peered":"2026-02-25T17:21:24.194619+0000","last_unstale":"2026-02-25T17:21:26.199182+0000","last_undegraded":"2026-02-25T17:21:26.199182+0000","last_fullsized":"2026-02-25T17:21:26.199182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:59:31.300444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198898+0000","last_change":"2026-02-25T17:21:24.194618+0000","last_active":"2026-02-25T17:21:26.198898+0000","last_peered":"2026-02-25T17:21:26.198898+0000","last_clean":"2026-02-25T17:21:26.198898+0000","last_became_active":"2026-02-25T17:21:24.194411+0000","last_became_peered":"2026-02-25T17:21:24.194411+0000","last_unstale":"2026-02-25T17:21:26.198898+0000","last_undegraded":"2026-02-25T17:21:26.198898+0000","last_fullsized":"2026-02-25T17:21:26.198898+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:40:43.331156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000395898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199198+0000","last_change":"2026-02-25T17:21:24.195559+0000","last_active":"2026-02-25T17:21:26.199198+0000","last_peered":"2026-02-25T17:21:26.199198+0000","last_clean":"2026-02-25T17:21:26.199198+0000","last_became_active":"2026-02-25T17:21:24.195473+0000","last_became_peered":"2026-02-25T17:21:24.195473+0000","last_unstale":"2026-02-25T17:21:26.199198+0000","last_undegraded":"2026-02-25T17:21:26.199198+0000","last_fullsized":"2026-02-25T17:21:26.199198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:22:24.234703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026897200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198922+0000","last_change":"2026-02-25T17:21:24.194793+0000","last_active":"2026-02-25T17:21:26.198922+0000","last_peered":"2026-02-25T17:21:26.198922+0000","last_clean":"2026-02-25T17:21:26.198922+0000","last_became_active":"2026-02-25T17:21:24.194561+0000","last_became_peered":"2026-02-25T17:21:24.194561+0000","last_unstale":"2026-02-25T17:21:26.198922+0000","last_undegraded":"2026-02-25T17:21:26.198922+0000","last_fullsized":"2026-02-25T17:21:26.198922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:02:43.748049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038440700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"16'79","reported_seq":149,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198864+0000","last_change":"2026-02-25T17:21:24.195059+0000","last_active":"2026-02-25T17:21:26.198864+0000","last_peered":"2026-02-25T17:21:26.198864+0000","last_clean":"2026-02-25T17:21:26.198864+0000","last_became_active":"2026-02-25T17:21:24.194928+0000","last_became_peered":"2026-02-25T17:21:24.194928+0000","last_unstale":"2026-02-25T17:21:26.198864+0000","last_undegraded":"2026-02-25T17:21:26.198864+0000","last_fullsized":"2026-02-25T17:21:26.198864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:21:32.983159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199155+0000","last_change":"2026-02-25T17:21:23.192944+0000","last_active":"2026-02-25T17:21:26.199155+0000","last_peered":"2026-02-25T17:21:26.199155+0000","last_clean":"2026-02-25T17:21:26.199155+0000","last_became_active":"2026-02-25T17:21:23.192745+0000","last_became_peered":"2026-02-25T17:21:23.192745+0000","last_unstale":"2026-02-25T17:21:26.199155+0000","last_undegraded":"2026-02-25T17:21:26.199155+0000","last_fullsized":"2026-02-25T17:21:26.199155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:12:01.863576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033429400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.391364+0000","last_change":"2026-02-25T17:21:22.189219+0000","last_active":"2026-02-25T17:21:26.391364+0000","last_peered":"2026-02-25T17:21:26.391364+0000","last_clean":"2026-02-25T17:21:26.391364+0000","last_became_active":"2026-02-25T17:21:22.189043+0000","last_became_peered":"2026-02-25T17:21:22.189043+0000","last_unstale":"2026-02-25T17:21:26.391364+0000","last_undegraded":"2026-02-25T17:21:26.391364+0000","last_fullsized":"2026-02-25T17:21:26.391364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:14:12.733416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083336499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198893+0000","last_change":"2026-02-25T17:21:24.194744+0000","last_active":"2026-02-25T17:21:26.198893+0000","last_peered":"2026-02-25T17:21:26.198893+0000","last_clean":"2026-02-25T17:21:26.198893+0000","last_became_active":"2026-02-25T17:21:24.194527+0000","last_became_peered":"2026-02-25T17:21:24.194527+0000","last_unstale":"2026-02-25T17:21:26.198893+0000","last_undegraded":"2026-02-25T17:21:26.198893+0000","last_fullsized":"2026-02-25T17:21:26.198893+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:08:42.357152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054556799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199174+0000","last_change":"2026-02-25T17:21:22.188981+0000","last_active":"2026-02-25T17:21:26.199174+0000","last_peered":"2026-02-25T17:21:26.199174+0000","last_clean":"2026-02-25T17:21:26.199174+0000","last_became_active":"2026-02-25T17:21:22.188810+0000","last_became_peered":"2026-02-25T17:21:22.188810+0000","last_unstale":"2026-02-25T17:21:26.199174+0000","last_undegraded":"2026-02-25T17:21:26.199174+0000","last_fullsized":"2026-02-25T17:21:26.199174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:20:57.540380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056038500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":25,"seq":107374182403,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28288,"kb_used_data":812,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94343552,"statfs":{"total":96636764160,"available":96607797248,"internally_reserved":0,"allocated":831488,"data_stored":674090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4549,"internal_metadata":28110395},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.14399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]}]},{"osd":2,"up_from":24,"seq":103079215107,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":228,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":233472,"data_stored":83106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":28110400},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.11799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20499999999999999}]}]},{"osd":1,"up_from":23,"seq":98784247812,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":824,"kb_used_omap":4,"kb_used_meta":27387,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":843776,"data_stored":677704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4548,"internal_metadata":28044860},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]}]},{"osd":0,"up_from":22,"seq":94489280516,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":240,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":245760,"data_stored":86383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":28110400},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T17:21:31.412 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-25T17:21:31.481 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.479+0000 7fa91acd1640 1 Processor -- start 2026-02-25T17:21:31.481 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.479+0000 7fa91acd1640 1 -- start start 2026-02-25T17:21:31.481 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.479+0000 7fa91acd1640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fa91406dfd0 0x7fa91406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.481 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.479+0000 7fa91acd1640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa91406e8f0 0x7fa914070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.481 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.479+0000 7fa91acd1640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa914071a30 con 0x7fa914070ed0 2026-02-25T17:21:31.481 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.479+0000 7fa91acd1640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9140722a0 con 0x7fa91406dfd0 2026-02-25T17:21:31.481 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.479+0000 7fa91acd1640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa91406fe00 con 0x7fa91406e8f0 2026-02-25T17:21:31.481 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.479+0000 7fa918a46640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fa91406dfd0 0x7fa91406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.481 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.479+0000 7fa90bfff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa91406e8f0 0x7fa914070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.481 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.479+0000 7fa918a46640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fa91406dfd0 0x7fa91406e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:36120/0 (socket says 10.20.193.76:36120) 2026-02-25T17:21:31.481 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.479+0000 7fa919247640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7fa914070ed0 0x7fa914071320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:32792/0 (socket says 10.20.193.76:32792) 2026-02-25T17:21:31.481 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.479+0000 7fa918a46640 1 -- 10.20.193.76:0/272524722 learned_addr learned my addr 10.20.193.76:0/272524722 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:31.481 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.479+0000 7fa918a46640 1 -- 10.20.193.76:0/272524722 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa91406e8f0 msgr2=0x7fa914070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:31.481 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.479+0000 7fa918a46640 1 --2- 10.20.193.76:0/272524722 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa91406e8f0 0x7fa914070990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.481 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.479+0000 7fa918a46640 1 -- 10.20.193.76:0/272524722 >> v1:10.20.193.76:6789/0 conn(0x7fa914070ed0 legacy=0x7fa914071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.481 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.479+0000 7fa918a46640 1 -- 10.20.193.76:0/272524722 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa914061380 con 0x7fa91406dfd0 2026-02-25T17:21:31.481 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.479+0000 7fa90b7fe640 1 -- 10.20.193.76:0/272524722 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244622236 0 0) 0x7fa914071a30 con 0x7fa914070ed0 2026-02-25T17:21:31.482 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.480+0000 7fa918a46640 1 --2- 10.20.193.76:0/272524722 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fa91406dfd0 0x7fa91406e3b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa904009970 tx=0x7fa90402ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8609bce5ba7c5fdf server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:31.482 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.480+0000 7fa90b7fe640 1 -- 10.20.193.76:0/272524722 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90402fb10 con 0x7fa91406dfd0 2026-02-25T17:21:31.482 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.480+0000 7fa90b7fe640 1 -- 10.20.193.76:0/272524722 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90402fc70 con 0x7fa91406dfd0 2026-02-25T17:21:31.482 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.480+0000 7fa90b7fe640 1 -- 10.20.193.76:0/272524722 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa904037440 con 0x7fa91406dfd0 2026-02-25T17:21:31.482 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.480+0000 7fa91acd1640 1 -- 10.20.193.76:0/272524722 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fa91406dfd0 msgr2=0x7fa91406e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.482 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.480+0000 7fa91acd1640 1 --2- 10.20.193.76:0/272524722 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fa91406dfd0 0x7fa91406e3b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa904009970 tx=0x7fa90402ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:31.482 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.480+0000 7fa91acd1640 1 -- 10.20.193.76:0/272524722 shutdown_connections 2026-02-25T17:21:31.482 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.480+0000 7fa91acd1640 1 --2- 10.20.193.76:0/272524722 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa91406e8f0 0x7fa914070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.482 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.480+0000 7fa91acd1640 1 --2- 10.20.193.76:0/272524722 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fa91406dfd0 0x7fa91406e3b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.482 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.480+0000 7fa91acd1640 1 -- 10.20.193.76:0/272524722 >> 10.20.193.76:0/272524722 conn(0x7fa91409a960 msgr2=0x7fa91409ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:31.482 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.480+0000 7fa91acd1640 1 -- 10.20.193.76:0/272524722 shutdown_connections 2026-02-25T17:21:31.482 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.480+0000 7fa91acd1640 1 -- 10.20.193.76:0/272524722 wait complete. 2026-02-25T17:21:31.482 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa91acd1640 1 Processor -- start 2026-02-25T17:21:31.482 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa91acd1640 1 -- start start 2026-02-25T17:21:31.483 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa91acd1640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fa91406dfd0 0x7fa914122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.483 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa91acd1640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa91406e8f0 0x7fa914123370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.483 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa91acd1640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fa914070ed0 0x7fa9141238b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:31.483 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa91acd1640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa914126420 con 0x7fa91406dfd0 2026-02-25T17:21:31.483 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa91acd1640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa914124950 con 0x7fa914070ed0 2026-02-25T17:21:31.483 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa91acd1640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa914125aa0 con 0x7fa91406e8f0 2026-02-25T17:21:31.483 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa918a46640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fa91406dfd0 0x7fa914122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.483 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa90bfff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa91406e8f0 0x7fa914123370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.483 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa918a46640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fa91406dfd0 0x7fa914122e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:36124/0 (socket says 10.20.193.76:36124) 2026-02-25T17:21:31.483 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa918a46640 1 -- 10.20.193.76:0/2578966684 learned_addr learned my addr 10.20.193.76:0/2578966684 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:31.483 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa919247640 1 --2- 10.20.193.76:0/2578966684 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fa914070ed0 0x7fa9141238b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:31.483 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa918a46640 1 -- 10.20.193.76:0/2578966684 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa91406e8f0 msgr2=0x7fa914123370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.483 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa918a46640 1 --2- 10.20.193.76:0/2578966684 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa91406e8f0 0x7fa914123370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.483 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa918a46640 1 -- 10.20.193.76:0/2578966684 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fa914070ed0 msgr2=0x7fa9141238b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.483 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa918a46640 1 --2- 10.20.193.76:0/2578966684 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fa914070ed0 0x7fa9141238b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.483 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa918a46640 1 -- 10.20.193.76:0/2578966684 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9040095d0 con 0x7fa91406dfd0 2026-02-25T17:21:31.483 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa918a46640 1 --2- 10.20.193.76:0/2578966684 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fa91406dfd0 0x7fa914122e30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa904002410 tx=0x7fa9040047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:31.484 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa9097fa640 1 -- 10.20.193.76:0/2578966684 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90402fb10 con 0x7fa91406dfd0 2026-02-25T17:21:31.484 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa9097fa640 1 -- 10.20.193.76:0/2578966684 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa904004030 con 0x7fa91406dfd0 2026-02-25T17:21:31.484 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa91acd1640 1 -- 10.20.193.76:0/2578966684 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91406ee50 con 0x7fa91406dfd0 2026-02-25T17:21:31.484 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa9097fa640 1 -- 10.20.193.76:0/2578966684 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9040043e0 con 0x7fa91406dfd0 2026-02-25T17:21:31.484 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.481+0000 7fa91acd1640 1 -- 10.20.193.76:0/2578966684 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9141c92c0 con 0x7fa91406dfd0 2026-02-25T17:21:31.484 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.482+0000 7fa91acd1640 1 -- 10.20.193.76:0/2578966684 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa91406e3b0 con 0x7fa91406dfd0 2026-02-25T17:21:31.484 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.482+0000 7fa9097fa640 1 -- 10.20.193.76:0/2578966684 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fa90404a070 con 0x7fa91406dfd0 2026-02-25T17:21:31.484 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.482+0000 7fa9097fa640 1 -- 10.20.193.76:0/2578966684 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7fa90408c040 con 0x7fa91406dfd0 2026-02-25T17:21:31.486 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.484+0000 7fa9097fa640 1 -- 10.20.193.76:0/2578966684 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7fa9040b74a0 con 0x7fa91406dfd0 2026-02-25T17:21:31.554 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.552+0000 7fa91acd1640 1 -- 10.20.193.76:0/2578966684 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa914068270 con 0x7fa91406dfd0 2026-02-25T17:21:31.555 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.552+0000 7fa9097fa640 1 -- 10.20.193.76:0/2578966684 <== mon.0 v2:10.20.193.76:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+9086 (secure 0 0 0) 0x7fa90403c020 con 0x7fa91406dfd0 2026-02-25T17:21:31.555 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:31.555 INFO:teuthology.orchestra.run.trial076.stdout:{"epoch":29,"fsid":"0648ee30-4e19-4268-91ad-07b0e65a8518","created":"2026-02-25T17:13:33.780133+0000","modified":"2026-02-25T17:21:27.198134+0000","last_up_change":"2026-02-25T17:21:23.187037+0000","last_in_change":"2026-02-25T17:13:34.859194+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2026-02-25T17:13:42.208987+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":13,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2026-02-25T17:13:42.832027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"85909bd3-2540-48a9-a649-33709fa74613","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":16,"up_from":22,"up_thru":23,"down_at":17,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6805","nonce":1645506709}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6806","nonce":1645506709}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6808","nonce":1645506709}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6807","nonce":1645506709}]},"public_addr":"10.20.193.76:6805/1645506709","cluster_addr":"10.20.193.76:6806/1645506709","heartbeat_back_addr":"10.20.193.76:6808/1645506709","heartbeat_front_addr":"10.20.193.76:6807/1645506709","state":["exists","up"]},{"osd":1,"uuid":"f0a0a51c-d629-464e-bc04-dacbaaf78efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":16,"up_from":23,"up_thru":25,"down_at":18,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6809","nonce":1923901808}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6810","nonce":1923901808}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6812","nonce":1923901808}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6811","nonce":1923901808}]},"public_addr":"10.20.193.76:6809/1923901808","cluster_addr":"10.20.193.76:6810/1923901808","heartbeat_back_addr":"10.20.193.76:6812/1923901808","heartbeat_front_addr":"10.20.193.76:6811/1923901808","state":["exists","up"]},{"osd":2,"uuid":"9633000b-764d-457a-b560-539dc5830e9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":18,"up_from":24,"up_thru":25,"down_at":19,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6801","nonce":3531107996}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6802","nonce":3531107996}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6804","nonce":3531107996}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6803","nonce":3531107996}]},"public_addr":"10.20.193.76:6801/3531107996","cluster_addr":"10.20.193.76:6802/3531107996","heartbeat_back_addr":"10.20.193.76:6804/3531107996","heartbeat_front_addr":"10.20.193.76:6803/3531107996","state":["exists","up"]},{"osd":3,"uuid":"fc098e34-48a8-4414-ad41-60abdf7388a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":19,"up_from":25,"up_thru":25,"down_at":20,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6813","nonce":39660203}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6814","nonce":39660203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6816","nonce":39660203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.76:6815","nonce":39660203}]},"public_addr":"10.20.193.76:6813/39660203","cluster_addr":"10.20.193.76:6814/39660203","heartbeat_back_addr":"10.20.193.76:6816/39660203","heartbeat_front_addr":"10.20.193.76:6815/39660203","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.998715+0000","dead_epoch":17},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.974454+0000","dead_epoch":18},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:40.020834+0000","dead_epoch":19},{"osd":3,"down_stamp":"2026-02-25T17:21:17.173929+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2026-02-25T17:13:39.943932+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.76:0/94912213":"2026-02-26T17:21:11.039698+0000","10.20.193.76:6800/42442":"2026-02-26T17:21:11.039698+0000","10.20.193.76:0/1432153956":"2026-02-26T17:21:11.039698+0000","10.20.193.76:0/1754372634":"2026-02-26T17:21:11.039698+0000","10.20.193.76:0/599075350":"2026-02-26T17:21:11.039698+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-25T17:21:31.556 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.553+0000 7fa91acd1640 1 -- 10.20.193.76:0/2578966684 >> v1:10.20.193.76:6800/1563581135 conn(0x7fa8e404f8b0 legacy=0x7fa8e4051d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.556 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.553+0000 7fa91acd1640 1 -- 10.20.193.76:0/2578966684 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fa91406dfd0 msgr2=0x7fa914122e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:31.557 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.553+0000 7fa91acd1640 1 --2- 10.20.193.76:0/2578966684 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fa91406dfd0 0x7fa914122e30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa904002410 tx=0x7fa9040047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.557 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.554+0000 7fa91acd1640 1 -- 10.20.193.76:0/2578966684 shutdown_connections 2026-02-25T17:21:31.557 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.554+0000 7fa91acd1640 1 --2- 10.20.193.76:0/2578966684 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fa914070ed0 0x7fa9141238b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.557 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.554+0000 7fa91acd1640 1 --2- 10.20.193.76:0/2578966684 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fa91406e8f0 0x7fa914123370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.557 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.554+0000 7fa91acd1640 1 --2- 10.20.193.76:0/2578966684 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fa91406dfd0 0x7fa914122e30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:31.557 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.554+0000 7fa91acd1640 1 -- 10.20.193.76:0/2578966684 >> 10.20.193.76:0/2578966684 conn(0x7fa91409a960 msgr2=0x7fa91406bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:31.557 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.554+0000 7fa91acd1640 1 -- 10.20.193.76:0/2578966684 shutdown_connections 2026-02-25T17:21:31.557 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:31.554+0000 7fa91acd1640 1 -- 10.20.193.76:0/2578966684 wait complete. 2026-02-25T17:21:32.564 INFO:tasks.ceph:Scrubbing osd.0 2026-02-25T17:21:32.564 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-25T17:21:32.640 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.638+0000 7fca434cc640 1 Processor -- start 2026-02-25T17:21:32.641 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.638+0000 7fca434cc640 1 -- start start 2026-02-25T17:21:32.641 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.638+0000 7fca434cc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fca3c06c690 0x7fca3c06ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.641 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.638+0000 7fca434cc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fca3c133cb0 0x7fca3c1360a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.641 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.638+0000 7fca434cc640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3c09c530 con 0x7fca3c09ba00 2026-02-25T17:21:32.641 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.638+0000 7fca434cc640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c06e050 con 0x7fca3c06c690 2026-02-25T17:21:32.641 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.638+0000 7fca434cc640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c06e360 con 0x7fca3c133cb0 2026-02-25T17:21:32.641 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.638+0000 7fca41241640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7fca3c09ba00 0x7fca3c06bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:32794/0 (socket says 10.20.193.76:32794) 2026-02-25T17:21:32.641 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.638+0000 7fca41241640 1 -- 10.20.193.76:0/4130415600 learned_addr learned my addr 10.20.193.76:0/4130415600 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:32.641 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.638+0000 7fca41a42640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fca3c133cb0 0x7fca3c1360a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.641 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.638+0000 7fca40a40640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fca3c06c690 0x7fca3c06ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.641 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.638+0000 7fca2bfff640 1 -- 10.20.193.76:0/4130415600 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314810889 0 0) 0x7fca3c09c530 con 0x7fca3c09ba00 2026-02-25T17:21:32.641 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.638+0000 7fca41a42640 1 -- 10.20.193.76:0/4130415600 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fca3c06c690 msgr2=0x7fca3c06ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:32.641 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.638+0000 7fca41a42640 1 --2- 10.20.193.76:0/4130415600 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fca3c06c690 0x7fca3c06ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.641 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.638+0000 7fca41a42640 1 -- 10.20.193.76:0/4130415600 >> v1:10.20.193.76:6789/0 conn(0x7fca3c09ba00 legacy=0x7fca3c06bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.641 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.638+0000 7fca41a42640 1 -- 10.20.193.76:0/4130415600 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3c06d190 con 0x7fca3c133cb0 2026-02-25T17:21:32.641 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.639+0000 7fca41a42640 1 --2- 10.20.193.76:0/4130415600 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fca3c133cb0 0x7fca3c1360a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca38009dc0 tx=0x7fca3802f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35fbc289ef539490 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:32.642 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.639+0000 7fca2bfff640 1 -- 10.20.193.76:0/4130415600 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca38006ea0 con 0x7fca3c133cb0 2026-02-25T17:21:32.644 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.639+0000 7fca2bfff640 1 -- 10.20.193.76:0/4130415600 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3802fdf0 con 0x7fca3c133cb0 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.639+0000 7fca2bfff640 1 -- 10.20.193.76:0/4130415600 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca38037660 con 0x7fca3c133cb0 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.639+0000 7fca434cc640 1 -- 10.20.193.76:0/4130415600 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fca3c133cb0 msgr2=0x7fca3c1360a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.639+0000 7fca434cc640 1 --2- 10.20.193.76:0/4130415600 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fca3c133cb0 0x7fca3c1360a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fca38009dc0 tx=0x7fca3802f1c0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.639+0000 7fca434cc640 1 -- 10.20.193.76:0/4130415600 shutdown_connections 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.639+0000 7fca434cc640 1 --2- 10.20.193.76:0/4130415600 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fca3c133cb0 0x7fca3c1360a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.639+0000 7fca434cc640 1 --2- 10.20.193.76:0/4130415600 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fca3c06c690 0x7fca3c06ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.639+0000 7fca434cc640 1 -- 10.20.193.76:0/4130415600 >> 10.20.193.76:0/4130415600 conn(0x7fca3c0997d0 msgr2=0x7fca3c099be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.639+0000 7fca434cc640 1 -- 10.20.193.76:0/4130415600 shutdown_connections 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.639+0000 7fca434cc640 1 -- 10.20.193.76:0/4130415600 wait complete. 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca434cc640 1 Processor -- start 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca434cc640 1 -- start start 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca434cc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fca3c06c690 0x7fca3c091ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca434cc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fca3c09ba00 0x7fca3c094960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca434cc640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fca3c133cb0 0x7fca3c094ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca434cc640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c093af0 con 0x7fca3c09ba00 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca434cc640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c071b10 con 0x7fca3c06c690 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca434cc640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c0946a0 con 0x7fca3c133cb0 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca40a40640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fca3c09ba00 0x7fca3c094960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca41241640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fca3c06c690 0x7fca3c091ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca40a40640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fca3c09ba00 0x7fca3c094960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:36130/0 (socket says 10.20.193.76:36130) 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca41a42640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fca3c133cb0 0x7fca3c094ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca40a40640 1 -- 10.20.193.76:0/392818848 learned_addr learned my addr 10.20.193.76:0/392818848 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca40a40640 1 -- 10.20.193.76:0/392818848 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fca3c133cb0 msgr2=0x7fca3c094ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca40a40640 1 --2- 10.20.193.76:0/392818848 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fca3c133cb0 0x7fca3c094ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca40a40640 1 -- 10.20.193.76:0/392818848 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fca3c06c690 msgr2=0x7fca3c091ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca40a40640 1 --2- 10.20.193.76:0/392818848 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fca3c06c690 0x7fca3c091ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.645 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca40a40640 1 -- 10.20.193.76:0/392818848 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca38009a70 con 0x7fca3c09ba00 2026-02-25T17:21:32.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca41a42640 1 --2- 10.20.193.76:0/392818848 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fca3c133cb0 0x7fca3c094ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:32.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca41241640 1 --2- 10.20.193.76:0/392818848 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fca3c06c690 0x7fca3c091ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:32.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca40a40640 1 --2- 10.20.193.76:0/392818848 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fca3c09ba00 0x7fca3c094960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fca3000ebb0 tx=0x7fca3000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:32.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca29ffb640 1 -- 10.20.193.76:0/392818848 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca30009770 con 0x7fca3c09ba00 2026-02-25T17:21:32.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca29ffb640 1 -- 10.20.193.76:0/392818848 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3000eec0 con 0x7fca3c09ba00 2026-02-25T17:21:32.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.640+0000 7fca434cc640 1 -- 10.20.193.76:0/392818848 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca3c0965f0 con 0x7fca3c09ba00 2026-02-25T17:21:32.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.641+0000 7fca29ffb640 1 -- 10.20.193.76:0/392818848 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3000ce60 con 0x7fca3c09ba00 2026-02-25T17:21:32.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.641+0000 7fca434cc640 1 -- 10.20.193.76:0/392818848 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca3c0968e0 con 0x7fca3c09ba00 2026-02-25T17:21:32.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.641+0000 7fca434cc640 1 -- 10.20.193.76:0/392818848 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fca3c06ca90 con 0x7fca3c09ba00 2026-02-25T17:21:32.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.641+0000 7fca29ffb640 1 -- 10.20.193.76:0/392818848 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fca30011070 con 0x7fca3c09ba00 2026-02-25T17:21:32.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.642+0000 7fca29ffb640 1 -- 10.20.193.76:0/392818848 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7fca30066920 con 0x7fca3c09ba00 2026-02-25T17:21:32.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.642+0000 7fca29ffb640 1 -- 10.20.193.76:0/392818848 --> v1:10.20.193.76:6805/1645506709 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca0c059b10 con 0x7fca0c055e60 2026-02-25T17:21:32.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.642+0000 7fca29ffb640 1 -- 10.20.193.76:0/392818848 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca3006b2a0 con 0x7fca3c09ba00 2026-02-25T17:21:32.646 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.642+0000 7fca29ffb640 1 -- 10.20.193.76:0/392818848 <== osd.0 v1:10.20.193.76:6805/1645506709 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26930 (unknown 0 0 1052135439) 0x7fca0c059b10 con 0x7fca0c055e60 2026-02-25T17:21:32.650 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.648+0000 7fca434cc640 1 -- 10.20.193.76:0/392818848 --> v1:10.20.193.76:6805/1645506709 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fca3c0958c0 con 0x7fca0c055e60 2026-02-25T17:21:32.650 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.648+0000 7fca29ffb640 1 -- 10.20.193.76:0/392818848 <== osd.0 v1:10.20.193.76:6805/1645506709 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+712 (unknown 0 0 714369635) 0x7fca3c0958c0 con 0x7fca0c055e60 2026-02-25T17:21:32.651 INFO:teuthology.orchestra.run.trial076.stdout:{ 2026-02-25T17:21:32.651 INFO:teuthology.orchestra.run.trial076.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-25T17:21:32.651 INFO:teuthology.orchestra.run.trial076.stdout:} 2026-02-25T17:21:32.651 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.649+0000 7fca434cc640 1 -- 10.20.193.76:0/392818848 >> v1:10.20.193.76:6805/1645506709 conn(0x7fca0c055e60 legacy=0x7fca0c0582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.651 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.649+0000 7fca434cc640 1 -- 10.20.193.76:0/392818848 >> v1:10.20.193.76:6800/1563581135 conn(0x7fca0c04f8b0 legacy=0x7fca0c051d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.651 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.649+0000 7fca434cc640 1 -- 10.20.193.76:0/392818848 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fca3c09ba00 msgr2=0x7fca3c094960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.651 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.649+0000 7fca434cc640 1 --2- 10.20.193.76:0/392818848 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fca3c09ba00 0x7fca3c094960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fca3000ebb0 tx=0x7fca3000c520 comp rx=0 tx=0).stop 2026-02-25T17:21:32.651 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.649+0000 7fca41a42640 1 -- 10.20.193.76:0/392818848 reap_dead start 2026-02-25T17:21:32.651 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.649+0000 7fca434cc640 1 -- 10.20.193.76:0/392818848 shutdown_connections 2026-02-25T17:21:32.651 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.649+0000 7fca434cc640 1 -- 10.20.193.76:0/392818848 >> 10.20.193.76:0/392818848 conn(0x7fca3c0997d0 msgr2=0x7fca3c0983f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:32.651 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.649+0000 7fca434cc640 1 -- 10.20.193.76:0/392818848 shutdown_connections 2026-02-25T17:21:32.651 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.649+0000 7fca434cc640 1 -- 10.20.193.76:0/392818848 wait complete. 2026-02-25T17:21:32.657 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-25T17:21:32.731 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.727+0000 7f7f883d1640 1 Processor -- start 2026-02-25T17:21:32.731 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.728+0000 7f7f883d1640 1 -- start start 2026-02-25T17:21:32.731 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.728+0000 7f7f883d1640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f7f8006f210 0x7f7f80070b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.731 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.728+0000 7f7f883d1640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f7f8006fcc0 0x7f7f80071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.731 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.728+0000 7f7f883d1640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f7f800715b0 0x7f7f80134c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.731 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.728+0000 7f7f883d1640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8009d9a0 con 0x7f7f800715b0 2026-02-25T17:21:32.731 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.728+0000 7f7f883d1640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f80070560 con 0x7f7f8006f210 2026-02-25T17:21:32.731 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.728+0000 7f7f883d1640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f800992e0 con 0x7f7f8006fcc0 2026-02-25T17:21:32.731 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.728+0000 7f7f86146640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f7f8006f210 0x7f7f80070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.731 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.728+0000 7f7f85945640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f7f8006fcc0 0x7f7f80071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.732 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.728+0000 7f7f86947640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f7f800715b0 0x7f7f80134c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.732 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.728+0000 7f7f86146640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f7f8006f210 0x7f7f80070b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50852/0 (socket says 10.20.193.76:50852) 2026-02-25T17:21:32.732 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.728+0000 7f7f86146640 1 -- 10.20.193.76:0/1759997162 learned_addr learned my addr 10.20.193.76:0/1759997162 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:32.732 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.728+0000 7f7f86146640 1 -- 10.20.193.76:0/1759997162 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f7f8006fcc0 msgr2=0x7f7f80071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:32.732 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.728+0000 7f7f86146640 1 --2- 10.20.193.76:0/1759997162 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f7f8006fcc0 0x7f7f80071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.732 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.728+0000 7f7f86146640 1 -- 10.20.193.76:0/1759997162 >> v2:10.20.193.76:3300/0 conn(0x7f7f800715b0 msgr2=0x7f7f80134c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:32.732 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.728+0000 7f7f86146640 1 --2- 10.20.193.76:0/1759997162 >> v2:10.20.193.76:3300/0 conn(0x7f7f800715b0 0x7f7f80134c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.732 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.728+0000 7f7f86146640 1 -- 10.20.193.76:0/1759997162 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f80070870 con 0x7f7f8006f210 2026-02-25T17:21:32.732 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.729+0000 7f7f86146640 1 --2- 10.20.193.76:0/1759997162 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f7f8006f210 0x7f7f80070b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7f700099a0 tx=0x7f7f7002ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecd564e3285317af server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:32.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.729+0000 7f7f85144640 1 -- 10.20.193.76:0/1759997162 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7002fac0 con 0x7f7f8006f210 2026-02-25T17:21:32.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.729+0000 7f7f85144640 1 -- 10.20.193.76:0/1759997162 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7002fc20 con 0x7f7f8006f210 2026-02-25T17:21:32.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.729+0000 7f7f85144640 1 -- 10.20.193.76:0/1759997162 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70037440 con 0x7f7f8006f210 2026-02-25T17:21:32.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.729+0000 7f7f883d1640 1 -- 10.20.193.76:0/1759997162 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f7f8006f210 msgr2=0x7f7f80070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.729+0000 7f7f883d1640 1 --2- 10.20.193.76:0/1759997162 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f7f8006f210 0x7f7f80070b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7f700099a0 tx=0x7f7f7002ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:32.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.729+0000 7f7f883d1640 1 -- 10.20.193.76:0/1759997162 shutdown_connections 2026-02-25T17:21:32.735 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.729+0000 7f7f883d1640 1 --2- 10.20.193.76:0/1759997162 >> v2:10.20.193.76:3300/0 conn(0x7f7f800715b0 0x7f7f80134c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.729+0000 7f7f883d1640 1 --2- 10.20.193.76:0/1759997162 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f7f8006fcc0 0x7f7f80071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.729+0000 7f7f883d1640 1 --2- 10.20.193.76:0/1759997162 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f7f8006f210 0x7f7f80070b30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.729+0000 7f7f883d1640 1 -- 10.20.193.76:0/1759997162 >> 10.20.193.76:0/1759997162 conn(0x7f7f8009a960 msgr2=0x7f7f8009ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:32.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.729+0000 7f7f883d1640 1 -- 10.20.193.76:0/1759997162 shutdown_connections 2026-02-25T17:21:32.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.729+0000 7f7f883d1640 1 -- 10.20.193.76:0/1759997162 wait complete. 2026-02-25T17:21:32.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f883d1640 1 Processor -- start 2026-02-25T17:21:32.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f883d1640 1 -- start start 2026-02-25T17:21:32.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f883d1640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f7f8006f210 0x7f7f80123aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f883d1640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f7f8006fcc0 0x7f7f80123fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f883d1640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f7f800715b0 0x7f7f80124520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f883d1640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f80125c30 con 0x7f7f8006f210 2026-02-25T17:21:32.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f883d1640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f801254b0 con 0x7f7f8006fcc0 2026-02-25T17:21:32.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f883d1640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f80126840 con 0x7f7f800715b0 2026-02-25T17:21:32.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f85945640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f7f8006fcc0 0x7f7f80123fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.736 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f86146640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f7f8006f210 0x7f7f80123aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f86947640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f7f800715b0 0x7f7f80124520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f85945640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f7f8006fcc0 0x7f7f80123fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50856/0 (socket says 10.20.193.76:50856) 2026-02-25T17:21:32.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f85945640 1 -- 10.20.193.76:0/213246993 learned_addr learned my addr 10.20.193.76:0/213246993 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:32.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f85945640 1 -- 10.20.193.76:0/213246993 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f7f800715b0 msgr2=0x7f7f80124520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f85945640 1 --2- 10.20.193.76:0/213246993 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f7f800715b0 0x7f7f80124520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f85945640 1 -- 10.20.193.76:0/213246993 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f7f8006f210 msgr2=0x7f7f80123aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f85945640 1 --2- 10.20.193.76:0/213246993 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f7f8006f210 0x7f7f80123aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f85945640 1 -- 10.20.193.76:0/213246993 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f700095d0 con 0x7f7f8006fcc0 2026-02-25T17:21:32.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f85945640 1 --2- 10.20.193.76:0/213246993 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f7f8006fcc0 0x7f7f80123fe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400ebe0 tx=0x7f7f7400c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:32.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f66ffd640 1 -- 10.20.193.76:0/213246993 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74009770 con 0x7f7f8006fcc0 2026-02-25T17:21:32.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f66ffd640 1 -- 10.20.193.76:0/213246993 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7400cc40 con 0x7f7f8006fcc0 2026-02-25T17:21:32.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f66ffd640 1 -- 10.20.193.76:0/213246993 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74013470 con 0x7f7f8006fcc0 2026-02-25T17:21:32.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f883d1640 1 -- 10.20.193.76:0/213246993 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f801270a0 con 0x7f7f8006fcc0 2026-02-25T17:21:32.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.730+0000 7f7f883d1640 1 -- 10.20.193.76:0/213246993 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f80134ed0 con 0x7f7f8006fcc0 2026-02-25T17:21:32.737 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.731+0000 7f7f883d1640 1 -- 10.20.193.76:0/213246993 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f80071ff0 con 0x7f7f8006fcc0 2026-02-25T17:21:32.738 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.731+0000 7f7f66ffd640 1 -- 10.20.193.76:0/213246993 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f7f74011070 con 0x7f7f8006fcc0 2026-02-25T17:21:32.738 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.732+0000 7f7f66ffd640 1 -- 10.20.193.76:0/213246993 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7f7f74066fa0 con 0x7f7f8006fcc0 2026-02-25T17:21:32.738 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.733+0000 7f7f66ffd640 1 -- 10.20.193.76:0/213246993 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f7f74040a00 con 0x7f7f8006fcc0 2026-02-25T17:21:32.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.798+0000 7f7f883d1640 1 -- 10.20.193.76:0/213246993 --> v1:10.20.193.76:6800/1563581135 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f80068270 con 0x7f7f5004f8b0 2026-02-25T17:21:32.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.799+0000 7f7f66ffd640 1 -- 10.20.193.76:0/213246993 <== mgr.14104 v1:10.20.193.76:6800/1563581135 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (unknown 2057319476 0 0) 0x7f7f80068270 con 0x7f7f5004f8b0 2026-02-25T17:21:32.802 INFO:teuthology.orchestra.run.trial076.stderr:instructed osd(s) 0 to deep-scrub 2026-02-25T17:21:32.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.799+0000 7f7f883d1640 1 -- 10.20.193.76:0/213246993 >> v1:10.20.193.76:6800/1563581135 conn(0x7f7f5004f8b0 legacy=0x7f7f50051d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.799+0000 7f7f883d1640 1 -- 10.20.193.76:0/213246993 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f7f8006fcc0 msgr2=0x7f7f80123fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.799+0000 7f7f883d1640 1 --2- 10.20.193.76:0/213246993 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f7f8006fcc0 0x7f7f80123fe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400ebe0 tx=0x7f7f7400c520 comp rx=0 tx=0).stop 2026-02-25T17:21:32.802 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.799+0000 7f7f883d1640 1 -- 10.20.193.76:0/213246993 shutdown_connections 2026-02-25T17:21:32.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.799+0000 7f7f883d1640 1 --2- 10.20.193.76:0/213246993 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f7f800715b0 0x7f7f80124520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.799+0000 7f7f883d1640 1 --2- 10.20.193.76:0/213246993 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f7f8006fcc0 0x7f7f80123fe0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.799+0000 7f7f883d1640 1 --2- 10.20.193.76:0/213246993 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f7f8006f210 0x7f7f80123aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.799+0000 7f7f883d1640 1 -- 10.20.193.76:0/213246993 >> 10.20.193.76:0/213246993 conn(0x7f7f8009a960 msgr2=0x7f7f8006c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:32.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.799+0000 7f7f883d1640 1 -- 10.20.193.76:0/213246993 shutdown_connections 2026-02-25T17:21:32.803 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.799+0000 7f7f883d1640 1 -- 10.20.193.76:0/213246993 wait complete. 2026-02-25T17:21:32.809 INFO:tasks.ceph:Scrubbing osd.1 2026-02-25T17:21:32.809 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-25T17:21:32.882 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.876+0000 7fbfd55ed640 1 Processor -- start 2026-02-25T17:21:32.882 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.876+0000 7fbfd55ed640 1 -- start start 2026-02-25T17:21:32.882 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.876+0000 7fbfd55ed640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbfd006ca70 0x7fbfd0131590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.882 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.876+0000 7fbfd55ed640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fbfd0131ad0 0x7fbfd0133ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.883 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.876+0000 7fbfd55ed640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd009bc70 con 0x7fbfd006bf80 2026-02-25T17:21:32.883 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.876+0000 7fbfd55ed640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd00706c0 con 0x7fbfd0131ad0 2026-02-25T17:21:32.883 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.876+0000 7fbfd55ed640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd006f590 con 0x7fbfd006ca70 2026-02-25T17:21:32.883 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.876+0000 7fbfceffd640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7fbfd006bf80 0x7fbfd006c360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:32802/0 (socket says 10.20.193.76:32802) 2026-02-25T17:21:32.883 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.876+0000 7fbfceffd640 1 -- 10.20.193.76:0/3328212031 learned_addr learned my addr 10.20.193.76:0/3328212031 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:32.883 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.876+0000 7fbfce7fc640 1 --2- 10.20.193.76:0/3328212031 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbfd006ca70 0x7fbfd0131590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.883 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.876+0000 7fbfcf7fe640 1 --2- 10.20.193.76:0/3328212031 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fbfd0131ad0 0x7fbfd0133ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.883 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.876+0000 7fbfce7fc640 1 -- 10.20.193.76:0/3328212031 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fbfd0131ad0 msgr2=0x7fbfd0133ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:32.883 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.876+0000 7fbfce7fc640 1 --2- 10.20.193.76:0/3328212031 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fbfd0131ad0 0x7fbfd0133ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.883 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.876+0000 7fbfcdffb640 1 -- 10.20.193.76:0/3328212031 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400079598 0 0) 0x7fbfd009bc70 con 0x7fbfd006bf80 2026-02-25T17:21:32.883 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.876+0000 7fbfce7fc640 1 -- 10.20.193.76:0/3328212031 >> v1:10.20.193.76:6789/0 conn(0x7fbfd006bf80 legacy=0x7fbfd006c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.883 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.876+0000 7fbfce7fc640 1 -- 10.20.193.76:0/3328212031 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd006fa30 con 0x7fbfd006ca70 2026-02-25T17:21:32.884 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.877+0000 7fbfce7fc640 1 --2- 10.20.193.76:0/3328212031 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbfd006ca70 0x7fbfd0131590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbfb80098d0 tx=0x7fbfb802ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edca84a65e6f51ae server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:32.884 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.877+0000 7fbfcdffb640 1 -- 10.20.193.76:0/3328212031 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb802fab0 con 0x7fbfd006ca70 2026-02-25T17:21:32.884 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.877+0000 7fbfcdffb640 1 -- 10.20.193.76:0/3328212031 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb802fc10 con 0x7fbfd006ca70 2026-02-25T17:21:32.884 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.877+0000 7fbfcdffb640 1 -- 10.20.193.76:0/3328212031 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8037440 con 0x7fbfd006ca70 2026-02-25T17:21:32.884 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.877+0000 7fbfd55ed640 1 -- 10.20.193.76:0/3328212031 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbfd006ca70 msgr2=0x7fbfd0131590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.884 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.877+0000 7fbfd55ed640 1 --2- 10.20.193.76:0/3328212031 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbfd006ca70 0x7fbfd0131590 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbfb80098d0 tx=0x7fbfb802ee80 comp rx=0 tx=0).stop 2026-02-25T17:21:32.884 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.877+0000 7fbfd55ed640 1 -- 10.20.193.76:0/3328212031 shutdown_connections 2026-02-25T17:21:32.884 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.877+0000 7fbfd55ed640 1 --2- 10.20.193.76:0/3328212031 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fbfd0131ad0 0x7fbfd0133ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.884 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.877+0000 7fbfd55ed640 1 --2- 10.20.193.76:0/3328212031 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbfd006ca70 0x7fbfd0131590 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.884 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.877+0000 7fbfd55ed640 1 -- 10.20.193.76:0/3328212031 >> 10.20.193.76:0/3328212031 conn(0x7fbfd00997d0 msgr2=0x7fbfd0099be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:32.884 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.877+0000 7fbfd55ed640 1 -- 10.20.193.76:0/3328212031 shutdown_connections 2026-02-25T17:21:32.885 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.877+0000 7fbfd55ed640 1 -- 10.20.193.76:0/3328212031 wait complete. 2026-02-25T17:21:32.885 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfd55ed640 1 Processor -- start 2026-02-25T17:21:32.885 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfd55ed640 1 -- start start 2026-02-25T17:21:32.885 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfd55ed640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbfd006bf80 0x7fbfd006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.885 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfd55ed640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fbfd006ca70 0x7fbfd006d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.885 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfd55ed640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fbfd0131ad0 0x7fbfd006db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.885 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfd55ed640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd0071d70 con 0x7fbfd006ca70 2026-02-25T17:21:32.885 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfd55ed640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd006ed10 con 0x7fbfd0131ad0 2026-02-25T17:21:32.885 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfd55ed640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd01268f0 con 0x7fbfd006bf80 2026-02-25T17:21:32.885 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfce7fc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fbfd006ca70 0x7fbfd006d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.885 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfceffd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbfd006bf80 0x7fbfd006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.885 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfce7fc640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fbfd006ca70 0x7fbfd006d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:36166/0 (socket says 10.20.193.76:36166) 2026-02-25T17:21:32.886 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfcf7fe640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fbfd0131ad0 0x7fbfd006db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.886 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfce7fc640 1 -- 10.20.193.76:0/3137661942 learned_addr learned my addr 10.20.193.76:0/3137661942 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:32.886 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfce7fc640 1 -- 10.20.193.76:0/3137661942 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbfd006bf80 msgr2=0x7fbfd006d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.886 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfce7fc640 1 --2- 10.20.193.76:0/3137661942 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fbfd006bf80 0x7fbfd006d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.886 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfce7fc640 1 -- 10.20.193.76:0/3137661942 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fbfd0131ad0 msgr2=0x7fbfd006db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.886 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfce7fc640 1 --2- 10.20.193.76:0/3137661942 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fbfd0131ad0 0x7fbfd006db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.886 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfce7fc640 1 -- 10.20.193.76:0/3137661942 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb8009500 con 0x7fbfd006ca70 2026-02-25T17:21:32.886 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfce7fc640 1 --2- 10.20.193.76:0/3137661942 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fbfd006ca70 0x7fbfd006d640 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009a00 tx=0x7fbfb80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:32.886 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfaf7fe640 1 -- 10.20.193.76:0/3137661942 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8004230 con 0x7fbfd006ca70 2026-02-25T17:21:32.886 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfaf7fe640 1 -- 10.20.193.76:0/3137661942 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb8004390 con 0x7fbfd006ca70 2026-02-25T17:21:32.886 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfaf7fe640 1 -- 10.20.193.76:0/3137661942 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8003710 con 0x7fbfd006ca70 2026-02-25T17:21:32.886 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfd55ed640 1 -- 10.20.193.76:0/3137661942 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd0127120 con 0x7fbfd006ca70 2026-02-25T17:21:32.887 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.878+0000 7fbfd55ed640 1 -- 10.20.193.76:0/3137661942 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd0127f90 con 0x7fbfd006ca70 2026-02-25T17:21:32.887 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.879+0000 7fbfd55ed640 1 -- 10.20.193.76:0/3137661942 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbfd0134400 con 0x7fbfd006ca70 2026-02-25T17:21:32.887 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.879+0000 7fbfaf7fe640 1 -- 10.20.193.76:0/3137661942 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fbfb8003870 con 0x7fbfd006ca70 2026-02-25T17:21:32.887 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.879+0000 7fbfaf7fe640 1 -- 10.20.193.76:0/3137661942 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7fbfb808c040 con 0x7fbfd006ca70 2026-02-25T17:21:32.887 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.879+0000 7fbfaf7fe640 1 -- 10.20.193.76:0/3137661942 --> v1:10.20.193.76:6809/1923901808 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbf9c059ae0 con 0x7fbf9c055e30 2026-02-25T17:21:32.887 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.879+0000 7fbfaf7fe640 1 -- 10.20.193.76:0/3137661942 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfb808e700 con 0x7fbfd006ca70 2026-02-25T17:21:32.887 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.880+0000 7fbfaf7fe640 1 -- 10.20.193.76:0/3137661942 <== osd.1 v1:10.20.193.76:6809/1923901808 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26930 (unknown 0 0 1052135439) 0x7fbf9c059ae0 con 0x7fbf9c055e30 2026-02-25T17:21:32.888 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.886+0000 7fbfd55ed640 1 -- 10.20.193.76:0/3137661942 --> v1:10.20.193.76:6809/1923901808 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbfd006c360 con 0x7fbf9c055e30 2026-02-25T17:21:32.888 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.886+0000 7fbfaf7fe640 1 -- 10.20.193.76:0/3137661942 <== osd.1 v1:10.20.193.76:6809/1923901808 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+712 (unknown 0 0 714369635) 0x7fbfd006c360 con 0x7fbf9c055e30 2026-02-25T17:21:32.889 INFO:teuthology.orchestra.run.trial076.stdout:{ 2026-02-25T17:21:32.889 INFO:teuthology.orchestra.run.trial076.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-25T17:21:32.889 INFO:teuthology.orchestra.run.trial076.stdout:} 2026-02-25T17:21:32.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.886+0000 7fbfd55ed640 1 -- 10.20.193.76:0/3137661942 >> v1:10.20.193.76:6809/1923901808 conn(0x7fbf9c055e30 legacy=0x7fbf9c058270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.886+0000 7fbfd55ed640 1 -- 10.20.193.76:0/3137661942 >> v1:10.20.193.76:6800/1563581135 conn(0x7fbf9c04f880 legacy=0x7fbf9c051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.886+0000 7fbfd55ed640 1 -- 10.20.193.76:0/3137661942 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fbfd006ca70 msgr2=0x7fbfd006d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.886+0000 7fbfd55ed640 1 --2- 10.20.193.76:0/3137661942 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fbfd006ca70 0x7fbfd006d640 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8009a00 tx=0x7fbfb80047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.890 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.886+0000 7fbfcf7fe640 1 -- 10.20.193.76:0/3137661942 reap_dead start 2026-02-25T17:21:32.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.886+0000 7fbfd55ed640 1 -- 10.20.193.76:0/3137661942 shutdown_connections 2026-02-25T17:21:32.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.886+0000 7fbfd55ed640 1 -- 10.20.193.76:0/3137661942 >> 10.20.193.76:0/3137661942 conn(0x7fbfd00997d0 msgr2=0x7fbfd0098120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:32.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.886+0000 7fbfd55ed640 1 -- 10.20.193.76:0/3137661942 shutdown_connections 2026-02-25T17:21:32.891 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.887+0000 7fbfd55ed640 1 -- 10.20.193.76:0/3137661942 wait complete. 2026-02-25T17:21:32.896 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-25T17:21:32.969 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.962+0000 7f2582994640 1 Processor -- start 2026-02-25T17:21:32.969 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.962+0000 7f2582994640 1 -- start start 2026-02-25T17:21:32.969 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.963+0000 7f2582994640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f257c12e530 0x7f257c12e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.969 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.963+0000 7f2582994640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f257c12ee50 0x7f257c097b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.969 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.963+0000 7f2582994640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f257c06d420 con 0x7f257c09d390 2026-02-25T17:21:32.970 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.963+0000 7f2582994640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257c09b050 con 0x7f257c12ee50 2026-02-25T17:21:32.970 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.963+0000 7f2582994640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f257c06da80 con 0x7f257c12e530 2026-02-25T17:21:32.970 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.963+0000 7f257bfff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f257c12e530 0x7f257c12e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.970 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.963+0000 7f257bfff640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f257c12e530 0x7f257c12e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39442/0 (socket says 10.20.193.76:39442) 2026-02-25T17:21:32.970 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.963+0000 7f257bfff640 1 -- 10.20.193.76:0/4082457727 learned_addr learned my addr 10.20.193.76:0/4082457727 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:32.970 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.963+0000 7f2580f0a640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f257c12ee50 0x7f257c097b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.970 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.963+0000 7f257bfff640 1 -- 10.20.193.76:0/4082457727 >> v2:10.20.193.76:3300/0 conn(0x7f257c12ee50 msgr2=0x7f257c097b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:32.971 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.963+0000 7f257bfff640 1 --2- 10.20.193.76:0/4082457727 >> v2:10.20.193.76:3300/0 conn(0x7f257c12ee50 0x7f257c097b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.971 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.963+0000 7f257bfff640 1 -- 10.20.193.76:0/4082457727 >> v1:10.20.193.76:6789/0 conn(0x7f257c09d390 legacy=0x7f257c097460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.971 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.963+0000 7f257bfff640 1 -- 10.20.193.76:0/4082457727 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c12f280 con 0x7f257c12e530 2026-02-25T17:21:32.971 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.963+0000 7f257bfff640 1 --2- 10.20.193.76:0/4082457727 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f257c12e530 0x7f257c12e910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2568009970 tx=0x7f256802ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a22aadbcb74540e server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:32.971 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.964+0000 7f257affd640 1 -- 10.20.193.76:0/4082457727 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256802fb10 con 0x7f257c12e530 2026-02-25T17:21:32.971 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.964+0000 7f257affd640 1 -- 10.20.193.76:0/4082457727 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256802fc70 con 0x7f257c12e530 2026-02-25T17:21:32.971 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.964+0000 7f257affd640 1 -- 10.20.193.76:0/4082457727 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2568037440 con 0x7f257c12e530 2026-02-25T17:21:32.971 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.964+0000 7f2582994640 1 -- 10.20.193.76:0/4082457727 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f257c12e530 msgr2=0x7f257c12e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.971 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.964+0000 7f2582994640 1 --2- 10.20.193.76:0/4082457727 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f257c12e530 0x7f257c12e910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2568009970 tx=0x7f256802ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:32.971 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.964+0000 7f2582994640 1 -- 10.20.193.76:0/4082457727 shutdown_connections 2026-02-25T17:21:32.971 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.964+0000 7f2582994640 1 --2- 10.20.193.76:0/4082457727 >> v2:10.20.193.76:3300/0 conn(0x7f257c12ee50 0x7f257c097b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.964+0000 7f2582994640 1 --2- 10.20.193.76:0/4082457727 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f257c12e530 0x7f257c12e910 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.964+0000 7f2582994640 1 -- 10.20.193.76:0/4082457727 >> 10.20.193.76:0/4082457727 conn(0x7f257c09e130 msgr2=0x7f257c09ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:32.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.964+0000 7f2582994640 1 -- 10.20.193.76:0/4082457727 shutdown_connections 2026-02-25T17:21:32.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.964+0000 7f2582994640 1 -- 10.20.193.76:0/4082457727 wait complete. 2026-02-25T17:21:32.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f2582994640 1 Processor -- start 2026-02-25T17:21:32.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f2582994640 1 -- start start 2026-02-25T17:21:32.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f2582994640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f257c09d390 0x7f257c127a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f2582994640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f257c12e530 0x7f257c127f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f2582994640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f257c12ee50 0x7f257c128490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:32.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f2582994640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c129d70 con 0x7f257c09d390 2026-02-25T17:21:32.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f2582994640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c12a3a0 con 0x7f257c12e530 2026-02-25T17:21:32.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f2582994640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f257c128ac0 con 0x7f257c12ee50 2026-02-25T17:21:32.973 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f257bfff640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f257c09d390 0x7f257c127a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.973 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f257bfff640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f257c09d390 0x7f257c127a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:36192/0 (socket says 10.20.193.76:36192) 2026-02-25T17:21:32.973 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f257bfff640 1 -- 10.20.193.76:0/2588392336 learned_addr learned my addr 10.20.193.76:0/2588392336 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:32.973 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f2580f0a640 1 --2- 10.20.193.76:0/2588392336 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f257c12ee50 0x7f257c128490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.973 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f257b7fe640 1 --2- 10.20.193.76:0/2588392336 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f257c12e530 0x7f257c127f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:32.973 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f257bfff640 1 -- 10.20.193.76:0/2588392336 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f257c12ee50 msgr2=0x7f257c128490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.973 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f257bfff640 1 --2- 10.20.193.76:0/2588392336 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f257c12ee50 0x7f257c128490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.973 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f257bfff640 1 -- 10.20.193.76:0/2588392336 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f257c12e530 msgr2=0x7f257c127f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:32.973 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f257bfff640 1 --2- 10.20.193.76:0/2588392336 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f257c12e530 0x7f257c127f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:32.973 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f257bfff640 1 -- 10.20.193.76:0/2588392336 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25680095d0 con 0x7f257c09d390 2026-02-25T17:21:32.973 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f257b7fe640 1 --2- 10.20.193.76:0/2588392336 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f257c12e530 0x7f257c127f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-25T17:21:32.973 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f257bfff640 1 --2- 10.20.193.76:0/2588392336 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f257c09d390 0x7f257c127a10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f256802f3f0 tx=0x7f25680047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:32.974 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f2578ff9640 1 -- 10.20.193.76:0/2588392336 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2568040830 con 0x7f257c09d390 2026-02-25T17:21:32.974 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f2578ff9640 1 -- 10.20.193.76:0/2588392336 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25680409b0 con 0x7f257c09d390 2026-02-25T17:21:32.974 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f2582994640 1 -- 10.20.193.76:0/2588392336 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257c12a5e0 con 0x7f257c09d390 2026-02-25T17:21:32.974 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f2578ff9640 1 -- 10.20.193.76:0/2588392336 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2568040d60 con 0x7f257c09d390 2026-02-25T17:21:32.974 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.965+0000 7f2582994640 1 -- 10.20.193.76:0/2588392336 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257c12bd00 con 0x7f257c09d390 2026-02-25T17:21:32.974 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.966+0000 7f2582994640 1 -- 10.20.193.76:0/2588392336 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257c12e910 con 0x7f257c09d390 2026-02-25T17:21:32.974 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.966+0000 7f2578ff9640 1 -- 10.20.193.76:0/2588392336 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f2568042470 con 0x7f257c09d390 2026-02-25T17:21:32.974 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.966+0000 7f2578ff9640 1 -- 10.20.193.76:0/2588392336 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7f256808c410 con 0x7f257c09d390 2026-02-25T17:21:32.975 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:32.968+0000 7f2578ff9640 1 -- 10.20.193.76:0/2588392336 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f2568069bb0 con 0x7f257c09d390 2026-02-25T17:21:33.035 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.033+0000 7f2582994640 1 -- 10.20.193.76:0/2588392336 --> v1:10.20.193.76:6800/1563581135 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f257c136af0 con 0x7f254c04f880 2026-02-25T17:21:33.036 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.033+0000 7f2578ff9640 1 -- 10.20.193.76:0/2588392336 <== mgr.14104 v1:10.20.193.76:6800/1563581135 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (unknown 489605429 0 0) 0x7f256c004a50 con 0x7f254c04f880 2026-02-25T17:21:33.036 INFO:teuthology.orchestra.run.trial076.stderr:instructed osd(s) 1 to deep-scrub 2026-02-25T17:21:33.037 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.034+0000 7f2582994640 1 -- 10.20.193.76:0/2588392336 >> v1:10.20.193.76:6800/1563581135 conn(0x7f254c04f880 legacy=0x7f254c051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.037 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.034+0000 7f2582994640 1 -- 10.20.193.76:0/2588392336 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f257c09d390 msgr2=0x7f257c127a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.037 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.034+0000 7f2582994640 1 --2- 10.20.193.76:0/2588392336 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f257c09d390 0x7f257c127a10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f256802f3f0 tx=0x7f25680047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.037 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.034+0000 7f2582994640 1 -- 10.20.193.76:0/2588392336 shutdown_connections 2026-02-25T17:21:33.037 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.034+0000 7f2582994640 1 --2- 10.20.193.76:0/2588392336 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f257c12ee50 0x7f257c128490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.037 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.034+0000 7f2582994640 1 --2- 10.20.193.76:0/2588392336 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f257c12e530 0x7f257c127f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.037 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.034+0000 7f2582994640 1 --2- 10.20.193.76:0/2588392336 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f257c09d390 0x7f257c127a10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.037 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.034+0000 7f2582994640 1 -- 10.20.193.76:0/2588392336 >> 10.20.193.76:0/2588392336 conn(0x7f257c09e130 msgr2=0x7f257c098f70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:33.038 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.034+0000 7f2582994640 1 -- 10.20.193.76:0/2588392336 shutdown_connections 2026-02-25T17:21:33.038 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.034+0000 7f2582994640 1 -- 10.20.193.76:0/2588392336 wait complete. 2026-02-25T17:21:33.044 INFO:tasks.ceph:Scrubbing osd.2 2026-02-25T17:21:33.044 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-25T17:21:33.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.111+0000 7fad449b9640 1 Processor -- start 2026-02-25T17:21:33.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.112+0000 7fad449b9640 1 -- start start 2026-02-25T17:21:33.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.112+0000 7fad449b9640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fad3c06bf80 0x7fad3c06c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.112+0000 7fad449b9640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fad3c06c8a0 0x7fad3c096450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.112+0000 7fad449b9640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7fad3c096990 0x7fad3c096e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.119 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.112+0000 7fad449b9640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad3c0706c0 con 0x7fad3c096990 2026-02-25T17:21:33.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.112+0000 7fad449b9640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c06f590 con 0x7fad3c06c8a0 2026-02-25T17:21:33.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.112+0000 7fad449b9640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c09bc70 con 0x7fad3c06bf80 2026-02-25T17:21:33.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.112+0000 7fad4272e640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fad3c06bf80 0x7fad3c06c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.112+0000 7fad41f2d640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fad3c06c8a0 0x7fad3c096450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.112+0000 7fad4272e640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fad3c06bf80 0x7fad3c06c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39460/0 (socket says 10.20.193.76:39460) 2026-02-25T17:21:33.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.112+0000 7fad4272e640 1 -- 10.20.193.76:0/1848142288 learned_addr learned my addr 10.20.193.76:0/1848142288 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:33.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.112+0000 7fad41f2d640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fad3c06c8a0 0x7fad3c096450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50894/0 (socket says 10.20.193.76:50894) 2026-02-25T17:21:33.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.112+0000 7fad42f2f640 1 --2- 10.20.193.76:0/1848142288 >> v2:10.20.193.76:3300/0 conn(0x7fad3c096990 0x7fad3c096e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.112+0000 7fad4272e640 1 -- 10.20.193.76:0/1848142288 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fad3c06c8a0 msgr2=0x7fad3c096450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:33.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.112+0000 7fad4272e640 1 --2- 10.20.193.76:0/1848142288 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fad3c06c8a0 0x7fad3c096450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.120 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.112+0000 7fad4272e640 1 -- 10.20.193.76:0/1848142288 >> v2:10.20.193.76:3300/0 conn(0x7fad3c096990 msgr2=0x7fad3c096e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:33.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.112+0000 7fad4272e640 1 --2- 10.20.193.76:0/1848142288 >> v2:10.20.193.76:3300/0 conn(0x7fad3c096990 0x7fad3c096e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.112+0000 7fad4272e640 1 -- 10.20.193.76:0/1848142288 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c06fa30 con 0x7fad3c06bf80 2026-02-25T17:21:33.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.112+0000 7fad4272e640 1 --2- 10.20.193.76:0/1848142288 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fad3c06bf80 0x7fad3c06c360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fad34009970 tx=0x7fad3402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ec5dfc4c6b637e server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:33.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.113+0000 7fad4172c640 1 -- 10.20.193.76:0/1848142288 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3402fac0 con 0x7fad3c06bf80 2026-02-25T17:21:33.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.113+0000 7fad4172c640 1 -- 10.20.193.76:0/1848142288 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3402fc20 con 0x7fad3c06bf80 2026-02-25T17:21:33.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.113+0000 7fad4172c640 1 -- 10.20.193.76:0/1848142288 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34037440 con 0x7fad3c06bf80 2026-02-25T17:21:33.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.113+0000 7fad449b9640 1 -- 10.20.193.76:0/1848142288 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fad3c06bf80 msgr2=0x7fad3c06c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.113+0000 7fad449b9640 1 --2- 10.20.193.76:0/1848142288 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fad3c06bf80 0x7fad3c06c360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fad34009970 tx=0x7fad3402ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:33.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.113+0000 7fad449b9640 1 -- 10.20.193.76:0/1848142288 shutdown_connections 2026-02-25T17:21:33.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.113+0000 7fad449b9640 1 --2- 10.20.193.76:0/1848142288 >> v2:10.20.193.76:3300/0 conn(0x7fad3c096990 0x7fad3c096e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.113+0000 7fad449b9640 1 --2- 10.20.193.76:0/1848142288 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fad3c06c8a0 0x7fad3c096450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.121 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.113+0000 7fad449b9640 1 --2- 10.20.193.76:0/1848142288 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fad3c06bf80 0x7fad3c06c360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.113+0000 7fad449b9640 1 -- 10.20.193.76:0/1848142288 >> 10.20.193.76:0/1848142288 conn(0x7fad3c0997d0 msgr2=0x7fad3c099be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:33.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.113+0000 7fad449b9640 1 -- 10.20.193.76:0/1848142288 shutdown_connections 2026-02-25T17:21:33.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.113+0000 7fad449b9640 1 -- 10.20.193.76:0/1848142288 wait complete. 2026-02-25T17:21:33.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad449b9640 1 Processor -- start 2026-02-25T17:21:33.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad449b9640 1 -- start start 2026-02-25T17:21:33.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad449b9640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fad3c06bf80 0x7fad3c124670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad449b9640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fad3c06c8a0 0x7fad3c124bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad449b9640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fad3c096990 0x7fad3c1250f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad449b9640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c1260a0 con 0x7fad3c06c8a0 2026-02-25T17:21:33.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad449b9640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c126d80 con 0x7fad3c06bf80 2026-02-25T17:21:33.122 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad449b9640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c1269b0 con 0x7fad3c096990 2026-02-25T17:21:33.123 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad4272e640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fad3c06bf80 0x7fad3c124670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.123 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad4272e640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fad3c06bf80 0x7fad3c124670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50910/0 (socket says 10.20.193.76:50910) 2026-02-25T17:21:33.123 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad4272e640 1 -- 10.20.193.76:0/876240727 learned_addr learned my addr 10.20.193.76:0/876240727 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:33.123 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad41f2d640 1 --2- 10.20.193.76:0/876240727 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fad3c06c8a0 0x7fad3c124bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.123 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad42f2f640 1 --2- 10.20.193.76:0/876240727 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fad3c096990 0x7fad3c1250f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.123 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad4272e640 1 -- 10.20.193.76:0/876240727 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fad3c096990 msgr2=0x7fad3c1250f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.123 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad4272e640 1 --2- 10.20.193.76:0/876240727 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fad3c096990 0x7fad3c1250f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.123 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad4272e640 1 -- 10.20.193.76:0/876240727 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fad3c06c8a0 msgr2=0x7fad3c124bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.123 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad4272e640 1 --2- 10.20.193.76:0/876240727 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fad3c06c8a0 0x7fad3c124bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.123 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad4272e640 1 -- 10.20.193.76:0/876240727 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad340095d0 con 0x7fad3c06bf80 2026-02-25T17:21:33.123 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad4272e640 1 --2- 10.20.193.76:0/876240727 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fad3c06bf80 0x7fad3c124670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fad34009aa0 tx=0x7fad340047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:33.124 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad26ffd640 1 -- 10.20.193.76:0/876240727 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34040660 con 0x7fad3c06bf80 2026-02-25T17:21:33.124 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad26ffd640 1 -- 10.20.193.76:0/876240727 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad340407c0 con 0x7fad3c06bf80 2026-02-25T17:21:33.124 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad449b9640 1 -- 10.20.193.76:0/876240727 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad3c1273a0 con 0x7fad3c06bf80 2026-02-25T17:21:33.124 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad26ffd640 1 -- 10.20.193.76:0/876240727 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34040b70 con 0x7fad3c06bf80 2026-02-25T17:21:33.124 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.114+0000 7fad449b9640 1 -- 10.20.193.76:0/876240727 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad3c128240 con 0x7fad3c06bf80 2026-02-25T17:21:33.124 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.115+0000 7fad449b9640 1 -- 10.20.193.76:0/876240727 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fad3c06cd20 con 0x7fad3c06bf80 2026-02-25T17:21:33.124 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.115+0000 7fad26ffd640 1 -- 10.20.193.76:0/876240727 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fad34049020 con 0x7fad3c06bf80 2026-02-25T17:21:33.124 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.115+0000 7fad26ffd640 1 -- 10.20.193.76:0/876240727 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7fad3408c730 con 0x7fad3c06bf80 2026-02-25T17:21:33.124 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.115+0000 7fad26ffd640 1 -- 10.20.193.76:0/876240727 --> v1:10.20.193.76:6801/3531107996 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad0c059ae0 con 0x7fad0c055e30 2026-02-25T17:21:33.124 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.115+0000 7fad26ffd640 1 -- 10.20.193.76:0/876240727 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad3408cb80 con 0x7fad3c06bf80 2026-02-25T17:21:33.124 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.116+0000 7fad26ffd640 1 -- 10.20.193.76:0/876240727 <== osd.2 v1:10.20.193.76:6801/3531107996 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26930 (unknown 0 0 1052135439) 0x7fad0c059ae0 con 0x7fad0c055e30 2026-02-25T17:21:33.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.122+0000 7fad449b9640 1 -- 10.20.193.76:0/876240727 --> v1:10.20.193.76:6801/3531107996 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fad3c096450 con 0x7fad0c055e30 2026-02-25T17:21:33.125 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.122+0000 7fad26ffd640 1 -- 10.20.193.76:0/876240727 <== osd.2 v1:10.20.193.76:6801/3531107996 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+712 (unknown 0 0 714369635) 0x7fad3c096450 con 0x7fad0c055e30 2026-02-25T17:21:33.126 INFO:teuthology.orchestra.run.trial076.stdout:{ 2026-02-25T17:21:33.126 INFO:teuthology.orchestra.run.trial076.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-25T17:21:33.126 INFO:teuthology.orchestra.run.trial076.stdout:} 2026-02-25T17:21:33.127 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.122+0000 7fad449b9640 1 -- 10.20.193.76:0/876240727 >> v1:10.20.193.76:6801/3531107996 conn(0x7fad0c055e30 legacy=0x7fad0c058270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.127 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.122+0000 7fad449b9640 1 -- 10.20.193.76:0/876240727 >> v1:10.20.193.76:6800/1563581135 conn(0x7fad0c04f880 legacy=0x7fad0c051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.127 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.122+0000 7fad449b9640 1 -- 10.20.193.76:0/876240727 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fad3c06bf80 msgr2=0x7fad3c124670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.127 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.122+0000 7fad449b9640 1 --2- 10.20.193.76:0/876240727 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fad3c06bf80 0x7fad3c124670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fad34009aa0 tx=0x7fad340047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.128 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.122+0000 7fad42f2f640 1 -- 10.20.193.76:0/876240727 reap_dead start 2026-02-25T17:21:33.128 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.122+0000 7fad449b9640 1 -- 10.20.193.76:0/876240727 shutdown_connections 2026-02-25T17:21:33.128 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.122+0000 7fad449b9640 1 -- 10.20.193.76:0/876240727 >> 10.20.193.76:0/876240727 conn(0x7fad3c0997d0 msgr2=0x7fad3c1324b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:33.128 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.123+0000 7fad449b9640 1 -- 10.20.193.76:0/876240727 shutdown_connections 2026-02-25T17:21:33.128 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.123+0000 7fad449b9640 1 -- 10.20.193.76:0/876240727 wait complete. 2026-02-25T17:21:33.130 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-25T17:21:33.203 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.197+0000 7fe65f590640 1 Processor -- start 2026-02-25T17:21:33.203 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.197+0000 7fe65f590640 1 -- start start 2026-02-25T17:21:33.203 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.197+0000 7fe65f590640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe65806dfd0 0x7fe65806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.203 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.197+0000 7fe65f590640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe6580987e0 0x7fe658134710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.204 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.197+0000 7fe65f590640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65809d9a0 con 0x7fe65806e8f0 2026-02-25T17:21:33.204 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.197+0000 7fe65f590640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe658099190 con 0x7fe65806dfd0 2026-02-25T17:21:33.204 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.197+0000 7fe65f590640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe65808c910 con 0x7fe6580987e0 2026-02-25T17:21:33.204 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.197+0000 7fe65d305640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe65806dfd0 0x7fe65806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.204 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.197+0000 7fe65db06640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe6580987e0 0x7fe658134710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.204 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.197+0000 7fe65d305640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe65806dfd0 0x7fe65806e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50912/0 (socket says 10.20.193.76:50912) 2026-02-25T17:21:33.204 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.197+0000 7fe65d305640 1 -- 10.20.193.76:0/3146939421 learned_addr learned my addr 10.20.193.76:0/3146939421 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:33.204 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.197+0000 7fe65d305640 1 -- 10.20.193.76:0/3146939421 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe6580987e0 msgr2=0x7fe658134710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:33.205 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.197+0000 7fe65d305640 1 --2- 10.20.193.76:0/3146939421 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe6580987e0 0x7fe658134710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.205 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.197+0000 7fe65d305640 1 -- 10.20.193.76:0/3146939421 >> v1:10.20.193.76:6789/0 conn(0x7fe65806e8f0 legacy=0x7fe6580980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.205 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.197+0000 7fe65d305640 1 -- 10.20.193.76:0/3146939421 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe658072260 con 0x7fe65806dfd0 2026-02-25T17:21:33.205 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.198+0000 7fe65d305640 1 --2- 10.20.193.76:0/3146939421 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe65806dfd0 0x7fe65806e3b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe6480099d0 tx=0x7fe64802ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7188adc3c2a665d server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:33.205 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.198+0000 7fe647fff640 1 -- 10.20.193.76:0/3146939421 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64802fb90 con 0x7fe65806dfd0 2026-02-25T17:21:33.205 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.198+0000 7fe647fff640 1 -- 10.20.193.76:0/3146939421 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64802fcf0 con 0x7fe65806dfd0 2026-02-25T17:21:33.205 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.198+0000 7fe647fff640 1 -- 10.20.193.76:0/3146939421 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe648037660 con 0x7fe65806dfd0 2026-02-25T17:21:33.205 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.198+0000 7fe65f590640 1 -- 10.20.193.76:0/3146939421 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe65806dfd0 msgr2=0x7fe65806e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.205 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.198+0000 7fe65f590640 1 --2- 10.20.193.76:0/3146939421 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe65806dfd0 0x7fe65806e3b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe6480099d0 tx=0x7fe64802ef60 comp rx=0 tx=0).stop 2026-02-25T17:21:33.205 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.198+0000 7fe65f590640 1 -- 10.20.193.76:0/3146939421 shutdown_connections 2026-02-25T17:21:33.205 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.198+0000 7fe65f590640 1 --2- 10.20.193.76:0/3146939421 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe6580987e0 0x7fe658134710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.206 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.198+0000 7fe65f590640 1 --2- 10.20.193.76:0/3146939421 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe65806dfd0 0x7fe65806e3b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.206 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.198+0000 7fe65f590640 1 -- 10.20.193.76:0/3146939421 >> 10.20.193.76:0/3146939421 conn(0x7fe65809a960 msgr2=0x7fe65809ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:33.206 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.198+0000 7fe65f590640 1 -- 10.20.193.76:0/3146939421 shutdown_connections 2026-02-25T17:21:33.206 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.198+0000 7fe65f590640 1 -- 10.20.193.76:0/3146939421 wait complete. 2026-02-25T17:21:33.206 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65f590640 1 Processor -- start 2026-02-25T17:21:33.206 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65f590640 1 -- start start 2026-02-25T17:21:33.206 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65f590640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe65806dfd0 0x7fe6581c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.206 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65f590640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe65806e8f0 0x7fe6581c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.206 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65f590640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe6580987e0 0x7fe65808ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.206 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65f590640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe658126be0 con 0x7fe65806dfd0 2026-02-25T17:21:33.206 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65f590640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65808eed0 con 0x7fe65806e8f0 2026-02-25T17:21:33.207 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65f590640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe658090310 con 0x7fe6580987e0 2026-02-25T17:21:33.207 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65d305640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe65806dfd0 0x7fe6581c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.207 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65db06640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe6580987e0 0x7fe65808ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.207 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65cb04640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe65806e8f0 0x7fe6581c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.207 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65d305640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe65806dfd0 0x7fe6581c56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:36210/0 (socket says 10.20.193.76:36210) 2026-02-25T17:21:33.207 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65d305640 1 -- 10.20.193.76:0/1704439323 learned_addr learned my addr 10.20.193.76:0/1704439323 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:33.207 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65db06640 1 -- 10.20.193.76:0/1704439323 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe65806e8f0 msgr2=0x7fe6581c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.207 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65db06640 1 --2- 10.20.193.76:0/1704439323 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe65806e8f0 0x7fe6581c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.207 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65db06640 1 -- 10.20.193.76:0/1704439323 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe65806dfd0 msgr2=0x7fe6581c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.207 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65db06640 1 --2- 10.20.193.76:0/1704439323 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe65806dfd0 0x7fe6581c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.208 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65db06640 1 -- 10.20.193.76:0/1704439323 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6480095d0 con 0x7fe6580987e0 2026-02-25T17:21:33.208 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65d305640 1 --2- 10.20.193.76:0/1704439323 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe65806dfd0 0x7fe6581c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:33.208 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65db06640 1 --2- 10.20.193.76:0/1704439323 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe6580987e0 0x7fe65808ce00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe65400efc0 tx=0x7fe65400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:33.208 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe645ffb640 1 -- 10.20.193.76:0/1704439323 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe654006ea0 con 0x7fe6580987e0 2026-02-25T17:21:33.208 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe645ffb640 1 -- 10.20.193.76:0/1704439323 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65400f040 con 0x7fe6580987e0 2026-02-25T17:21:33.208 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65f590640 1 -- 10.20.193.76:0/1704439323 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6581c6120 con 0x7fe6580987e0 2026-02-25T17:21:33.208 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe645ffb640 1 -- 10.20.193.76:0/1704439323 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6540146c0 con 0x7fe6580987e0 2026-02-25T17:21:33.208 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.199+0000 7fe65f590640 1 -- 10.20.193.76:0/1704439323 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65808fa20 con 0x7fe6580987e0 2026-02-25T17:21:33.208 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.200+0000 7fe65f590640 1 -- 10.20.193.76:0/1704439323 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65808f630 con 0x7fe6580987e0 2026-02-25T17:21:33.208 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.200+0000 7fe645ffb640 1 -- 10.20.193.76:0/1704439323 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7fe654024020 con 0x7fe6580987e0 2026-02-25T17:21:33.208 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.200+0000 7fe645ffb640 1 -- 10.20.193.76:0/1704439323 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7fe654067220 con 0x7fe6580987e0 2026-02-25T17:21:33.209 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.202+0000 7fe645ffb640 1 -- 10.20.193.76:0/1704439323 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7fe65808f630 con 0x7fe6580987e0 2026-02-25T17:21:33.269 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.267+0000 7fe65f590640 1 -- 10.20.193.76:0/1704439323 --> v1:10.20.193.76:6800/1563581135 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fe658098c90 con 0x7fe62804f8b0 2026-02-25T17:21:33.270 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.267+0000 7fe645ffb640 1 -- 10.20.193.76:0/1704439323 <== mgr.14104 v1:10.20.193.76:6800/1563581135 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (unknown 3049115190 0 0) 0x7fe64802f990 con 0x7fe62804f8b0 2026-02-25T17:21:33.270 INFO:teuthology.orchestra.run.trial076.stderr:instructed osd(s) 2 to deep-scrub 2026-02-25T17:21:33.271 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.268+0000 7fe65f590640 1 -- 10.20.193.76:0/1704439323 >> v1:10.20.193.76:6800/1563581135 conn(0x7fe62804f8b0 legacy=0x7fe628051d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.271 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.268+0000 7fe65f590640 1 -- 10.20.193.76:0/1704439323 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe6580987e0 msgr2=0x7fe65808ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.271 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.268+0000 7fe65f590640 1 --2- 10.20.193.76:0/1704439323 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe6580987e0 0x7fe65808ce00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe65400efc0 tx=0x7fe65400c490 comp rx=0 tx=0).stop 2026-02-25T17:21:33.271 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.268+0000 7fe65f590640 1 -- 10.20.193.76:0/1704439323 shutdown_connections 2026-02-25T17:21:33.271 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.268+0000 7fe65f590640 1 --2- 10.20.193.76:0/1704439323 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7fe6580987e0 0x7fe65808ce00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.271 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.268+0000 7fe65f590640 1 --2- 10.20.193.76:0/1704439323 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7fe65806e8f0 0x7fe6581c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.271 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.268+0000 7fe65f590640 1 --2- 10.20.193.76:0/1704439323 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7fe65806dfd0 0x7fe6581c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.272 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.268+0000 7fe65f590640 1 -- 10.20.193.76:0/1704439323 >> 10.20.193.76:0/1704439323 conn(0x7fe65809a960 msgr2=0x7fe658126030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:33.272 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.268+0000 7fe65f590640 1 -- 10.20.193.76:0/1704439323 shutdown_connections 2026-02-25T17:21:33.272 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.268+0000 7fe65f590640 1 -- 10.20.193.76:0/1704439323 wait complete. 2026-02-25T17:21:33.278 INFO:tasks.ceph:Scrubbing osd.3 2026-02-25T17:21:33.279 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-25T17:21:33.354 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.347+0000 7ff959722640 1 Processor -- start 2026-02-25T17:21:33.355 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.347+0000 7ff959722640 1 -- start start 2026-02-25T17:21:33.355 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.347+0000 7ff959722640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff95406bf80 0x7ff95406c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.355 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.347+0000 7ff959722640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7ff95406c8a0 0x7ff954096450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.355 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.347+0000 7ff959722640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff95409bc70 con 0x7ff954096990 2026-02-25T17:21:33.355 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.347+0000 7ff959722640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9540706c0 con 0x7ff95406c8a0 2026-02-25T17:21:33.355 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.347+0000 7ff959722640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95406f590 con 0x7ff95406bf80 2026-02-25T17:21:33.355 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.348+0000 7ff952ffd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff95406bf80 0x7ff95406c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.355 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.348+0000 7ff9527fc640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7ff95406c8a0 0x7ff954096450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.356 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.348+0000 7ff952ffd640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff95406bf80 0x7ff95406c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50930/0 (socket says 10.20.193.76:50930) 2026-02-25T17:21:33.356 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.348+0000 7ff952ffd640 1 -- 10.20.193.76:0/1320526265 learned_addr learned my addr 10.20.193.76:0/1320526265 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:33.356 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.348+0000 7ff952ffd640 1 -- 10.20.193.76:0/1320526265 >> v2:10.20.193.76:3300/0 conn(0x7ff95406c8a0 msgr2=0x7ff954096450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:33.356 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.348+0000 7ff952ffd640 1 --2- 10.20.193.76:0/1320526265 >> v2:10.20.193.76:3300/0 conn(0x7ff95406c8a0 0x7ff954096450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.356 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.348+0000 7ff952ffd640 1 -- 10.20.193.76:0/1320526265 >> v1:10.20.193.76:6789/0 conn(0x7ff954096990 legacy=0x7ff9541335a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.356 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.348+0000 7ff952ffd640 1 -- 10.20.193.76:0/1320526265 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95406fa30 con 0x7ff95406bf80 2026-02-25T17:21:33.356 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.348+0000 7ff952ffd640 1 --2- 10.20.193.76:0/1320526265 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff95406bf80 0x7ff95406c360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff948009970 tx=0x7ff94802ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbb1cb14bc8857 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:33.356 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.348+0000 7ff951ffb640 1 -- 10.20.193.76:0/1320526265 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94802fb10 con 0x7ff95406bf80 2026-02-25T17:21:33.356 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.348+0000 7ff951ffb640 1 -- 10.20.193.76:0/1320526265 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94802fc70 con 0x7ff95406bf80 2026-02-25T17:21:33.356 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.348+0000 7ff951ffb640 1 -- 10.20.193.76:0/1320526265 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff948037440 con 0x7ff95406bf80 2026-02-25T17:21:33.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.349+0000 7ff959722640 1 -- 10.20.193.76:0/1320526265 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff95406bf80 msgr2=0x7ff95406c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.349+0000 7ff959722640 1 --2- 10.20.193.76:0/1320526265 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff95406bf80 0x7ff95406c360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff948009970 tx=0x7ff94802ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:33.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.349+0000 7ff959722640 1 -- 10.20.193.76:0/1320526265 shutdown_connections 2026-02-25T17:21:33.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.349+0000 7ff959722640 1 --2- 10.20.193.76:0/1320526265 >> v2:10.20.193.76:3300/0 conn(0x7ff95406c8a0 0x7ff954096450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.349+0000 7ff959722640 1 --2- 10.20.193.76:0/1320526265 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff95406bf80 0x7ff95406c360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.349+0000 7ff959722640 1 -- 10.20.193.76:0/1320526265 >> 10.20.193.76:0/1320526265 conn(0x7ff9540997d0 msgr2=0x7ff954099be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:33.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.349+0000 7ff959722640 1 -- 10.20.193.76:0/1320526265 shutdown_connections 2026-02-25T17:21:33.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.349+0000 7ff959722640 1 -- 10.20.193.76:0/1320526265 wait complete. 2026-02-25T17:21:33.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.349+0000 7ff959722640 1 Processor -- start 2026-02-25T17:21:33.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.349+0000 7ff959722640 1 -- start start 2026-02-25T17:21:33.357 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff959722640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff95406bf80 0x7ff95408c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.358 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff959722640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff95406c8a0 0x7ff95408c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.358 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff959722640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff954096990 0x7ff95408ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.358 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff959722640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff954128c30 con 0x7ff954096990 2026-02-25T17:21:33.358 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff959722640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff954129330 con 0x7ff95406c8a0 2026-02-25T17:21:33.358 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff959722640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff95408d7c0 con 0x7ff95406bf80 2026-02-25T17:21:33.358 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff9527fc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff95406c8a0 0x7ff95408c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.358 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff952ffd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff95406bf80 0x7ff95408c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.358 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff9527fc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff95406c8a0 0x7ff95408c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:50944/0 (socket says 10.20.193.76:50944) 2026-02-25T17:21:33.358 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff9527fc640 1 -- 10.20.193.76:0/759896369 learned_addr learned my addr 10.20.193.76:0/759896369 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:33.358 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff9537fe640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff954096990 0x7ff95408ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.358 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff9527fc640 1 -- 10.20.193.76:0/759896369 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff95406bf80 msgr2=0x7ff95408c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.358 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff9527fc640 1 --2- 10.20.193.76:0/759896369 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7ff95406bf80 0x7ff95408c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.359 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff9527fc640 1 -- 10.20.193.76:0/759896369 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff954096990 msgr2=0x7ff95408ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.359 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff9527fc640 1 --2- 10.20.193.76:0/759896369 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7ff954096990 0x7ff95408ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.359 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff9527fc640 1 -- 10.20.193.76:0/759896369 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9480095d0 con 0x7ff95406c8a0 2026-02-25T17:21:33.359 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff9527fc640 1 --2- 10.20.193.76:0/759896369 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff95406c8a0 0x7ff95408c8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00ebe0 tx=0x7ff93c00c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:33.359 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff9337fe640 1 -- 10.20.193.76:0/759896369 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c009770 con 0x7ff95406c8a0 2026-02-25T17:21:33.359 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff9337fe640 1 -- 10.20.193.76:0/759896369 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c00cc40 con 0x7ff95406c8a0 2026-02-25T17:21:33.359 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff9337fe640 1 -- 10.20.193.76:0/759896369 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c013470 con 0x7ff95406c8a0 2026-02-25T17:21:33.359 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff959722640 1 -- 10.20.193.76:0/759896369 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff95408de70 con 0x7ff95406c8a0 2026-02-25T17:21:33.359 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff959722640 1 -- 10.20.193.76:0/759896369 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9541c32b0 con 0x7ff95406c8a0 2026-02-25T17:21:33.359 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.350+0000 7ff959722640 1 -- 10.20.193.76:0/759896369 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff95406cd20 con 0x7ff95406c8a0 2026-02-25T17:21:33.359 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.351+0000 7ff9337fe640 1 -- 10.20.193.76:0/759896369 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7ff93c011070 con 0x7ff95406c8a0 2026-02-25T17:21:33.360 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.351+0000 7ff9337fe640 1 -- 10.20.193.76:0/759896369 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7ff93c066ca0 con 0x7ff95406c8a0 2026-02-25T17:21:33.360 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.351+0000 7ff9337fe640 1 -- 10.20.193.76:0/759896369 --> v1:10.20.193.76:6813/39660203 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff920059ae0 con 0x7ff920055e30 2026-02-25T17:21:33.360 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.351+0000 7ff9337fe640 1 -- 10.20.193.76:0/759896369 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff93c0670f0 con 0x7ff95406c8a0 2026-02-25T17:21:33.360 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.352+0000 7ff9337fe640 1 -- 10.20.193.76:0/759896369 <== osd.3 v1:10.20.193.76:6813/39660203 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26930 (unknown 0 0 1052135439) 0x7ff920059ae0 con 0x7ff920055e30 2026-02-25T17:21:33.361 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.358+0000 7ff959722640 1 -- 10.20.193.76:0/759896369 --> v1:10.20.193.76:6813/39660203 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff9540989f0 con 0x7ff920055e30 2026-02-25T17:21:33.361 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.358+0000 7ff9337fe640 1 -- 10.20.193.76:0/759896369 <== osd.3 v1:10.20.193.76:6813/39660203 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+712 (unknown 0 0 714369635) 0x7ff9540989f0 con 0x7ff920055e30 2026-02-25T17:21:33.361 INFO:teuthology.orchestra.run.trial076.stdout:{ 2026-02-25T17:21:33.361 INFO:teuthology.orchestra.run.trial076.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-25T17:21:33.361 INFO:teuthology.orchestra.run.trial076.stdout:} 2026-02-25T17:21:33.363 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.358+0000 7ff959722640 1 -- 10.20.193.76:0/759896369 >> v1:10.20.193.76:6813/39660203 conn(0x7ff920055e30 legacy=0x7ff920058270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.363 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.358+0000 7ff959722640 1 -- 10.20.193.76:0/759896369 >> v1:10.20.193.76:6800/1563581135 conn(0x7ff92004f880 legacy=0x7ff920051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.363 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.358+0000 7ff959722640 1 -- 10.20.193.76:0/759896369 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff95406c8a0 msgr2=0x7ff95408c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.363 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.358+0000 7ff959722640 1 --2- 10.20.193.76:0/759896369 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7ff95406c8a0 0x7ff95408c8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00ebe0 tx=0x7ff93c00c520 comp rx=0 tx=0).stop 2026-02-25T17:21:33.363 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.358+0000 7ff9537fe640 1 -- 10.20.193.76:0/759896369 reap_dead start 2026-02-25T17:21:33.363 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.358+0000 7ff959722640 1 -- 10.20.193.76:0/759896369 shutdown_connections 2026-02-25T17:21:33.363 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.358+0000 7ff959722640 1 -- 10.20.193.76:0/759896369 >> 10.20.193.76:0/759896369 conn(0x7ff9540997d0 msgr2=0x7ff9540982e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:33.363 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.358+0000 7ff959722640 1 -- 10.20.193.76:0/759896369 shutdown_connections 2026-02-25T17:21:33.363 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.358+0000 7ff959722640 1 -- 10.20.193.76:0/759896369 wait complete. 2026-02-25T17:21:33.366 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-25T17:21:33.434 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.431+0000 7f443cf62640 1 Processor -- start 2026-02-25T17:21:33.434 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.431+0000 7f443cf62640 1 -- start start 2026-02-25T17:21:33.434 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.431+0000 7f443cf62640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f443806dfd0 0x7f443806e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.434 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.431+0000 7f443cf62640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f44380710a0 0x7f44380714f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.434 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.431+0000 7f443cf62640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4438071a30 con 0x7f443806e8f0 2026-02-25T17:21:33.434 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.431+0000 7f443cf62640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44380722a0 con 0x7f443806dfd0 2026-02-25T17:21:33.434 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.431+0000 7f443cf62640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f443806fe00 con 0x7f44380710a0 2026-02-25T17:21:33.434 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.431+0000 7f4436575640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f443806dfd0 0x7f443806e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.434 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.431+0000 7f4435d74640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f443806e8f0 0x7f4438070990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:32842/0 (socket says 10.20.193.76:32842) 2026-02-25T17:21:33.434 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.431+0000 7f4436d76640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f44380710a0 0x7f44380714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.434 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.431+0000 7f4435d74640 1 -- 10.20.193.76:0/1919015895 learned_addr learned my addr 10.20.193.76:0/1919015895 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:33.434 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.431+0000 7f4436575640 1 -- 10.20.193.76:0/1919015895 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f44380710a0 msgr2=0x7f44380714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:33.435 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.431+0000 7f4436575640 1 --2- 10.20.193.76:0/1919015895 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f44380710a0 0x7f44380714f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.435 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.431+0000 7f4436575640 1 -- 10.20.193.76:0/1919015895 >> v1:10.20.193.76:6789/0 conn(0x7f443806e8f0 legacy=0x7f4438070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.435 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.431+0000 7f4435573640 1 -- 10.20.193.76:0/1919015895 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1063936555 0 0) 0x7f4438071a30 con 0x7f443806e8f0 2026-02-25T17:21:33.435 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.432+0000 7f4436575640 1 -- 10.20.193.76:0/1919015895 --> v2:10.20.193.76:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4438061380 con 0x7f443806dfd0 2026-02-25T17:21:33.435 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.432+0000 7f4436d76640 1 --2- 10.20.193.76:0/1919015895 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f44380710a0 0x7f44380714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:33.435 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.432+0000 7f4436575640 1 --2- 10.20.193.76:0/1919015895 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f443806dfd0 0x7f443806e3b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f442c0098a0 tx=0x7f442c02ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f096487a728b6be server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:33.435 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.432+0000 7f4435573640 1 -- 10.20.193.76:0/1919015895 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c02fa40 con 0x7f443806dfd0 2026-02-25T17:21:33.435 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.432+0000 7f4435573640 1 -- 10.20.193.76:0/1919015895 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442c02fba0 con 0x7f443806dfd0 2026-02-25T17:21:33.435 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.432+0000 7f4435573640 1 -- 10.20.193.76:0/1919015895 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c037440 con 0x7f443806dfd0 2026-02-25T17:21:33.436 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.432+0000 7f443cf62640 1 -- 10.20.193.76:0/1919015895 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f443806dfd0 msgr2=0x7f443806e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.436 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.432+0000 7f443cf62640 1 --2- 10.20.193.76:0/1919015895 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f443806dfd0 0x7f443806e3b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f442c0098a0 tx=0x7f442c02ed80 comp rx=0 tx=0).stop 2026-02-25T17:21:33.436 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.432+0000 7f443cf62640 1 -- 10.20.193.76:0/1919015895 shutdown_connections 2026-02-25T17:21:33.436 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.432+0000 7f443cf62640 1 --2- 10.20.193.76:0/1919015895 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f44380710a0 0x7f44380714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.436 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.432+0000 7f443cf62640 1 --2- 10.20.193.76:0/1919015895 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f443806dfd0 0x7f443806e3b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.436 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.432+0000 7f443cf62640 1 -- 10.20.193.76:0/1919015895 >> 10.20.193.76:0/1919015895 conn(0x7f443809a960 msgr2=0x7f443809ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:33.436 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.432+0000 7f443cf62640 1 -- 10.20.193.76:0/1919015895 shutdown_connections 2026-02-25T17:21:33.436 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.432+0000 7f443cf62640 1 -- 10.20.193.76:0/1919015895 wait complete. 2026-02-25T17:21:33.436 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.433+0000 7f443cf62640 1 Processor -- start 2026-02-25T17:21:33.436 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.433+0000 7f443cf62640 1 -- start start 2026-02-25T17:21:33.436 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.433+0000 7f443cf62640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f443806dfd0 0x7f4438121b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.436 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.433+0000 7f443cf62640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f443806e8f0 0x7f4438122060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.436 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.433+0000 7f443cf62640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f44380710a0 0x7f44381225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.433+0000 7f443cf62640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443813a640 con 0x7f44380710a0 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.433+0000 7f443cf62640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4438123790 con 0x7f443806e8f0 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.433+0000 7f443cf62640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44381247f0 con 0x7f443806dfd0 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.433+0000 7f4436575640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f443806dfd0 0x7f4438121b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.433+0000 7f4436575640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f443806dfd0 0x7f4438121b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:39526/0 (socket says 10.20.193.76:39526) 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.433+0000 7f4436575640 1 -- 10.20.193.76:0/2277171356 learned_addr learned my addr 10.20.193.76:0/2277171356 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.433+0000 7f4436d76640 1 --2- 10.20.193.76:0/2277171356 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f44380710a0 0x7f44381225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.433+0000 7f4435d74640 1 --2- 10.20.193.76:0/2277171356 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f443806e8f0 0x7f4438122060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.433+0000 7f4436575640 1 -- 10.20.193.76:0/2277171356 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f443806e8f0 msgr2=0x7f4438122060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.433+0000 7f4436575640 1 --2- 10.20.193.76:0/2277171356 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f443806e8f0 0x7f4438122060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.433+0000 7f4436575640 1 -- 10.20.193.76:0/2277171356 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f44380710a0 msgr2=0x7f44381225a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.433+0000 7f4436575640 1 --2- 10.20.193.76:0/2277171356 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f44380710a0 0x7f44381225a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.433+0000 7f4436575640 1 -- 10.20.193.76:0/2277171356 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4428009a70 con 0x7f443806dfd0 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.433+0000 7f4436d76640 1 --2- 10.20.193.76:0/2277171356 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f44380710a0 0x7f44381225a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.433+0000 7f4436575640 1 --2- 10.20.193.76:0/2277171356 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f443806dfd0 0x7f4438121b20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f442c002410 tx=0x7f442c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.434+0000 7f441effd640 1 -- 10.20.193.76:0/2277171356 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c004230 con 0x7f443806dfd0 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.434+0000 7f441effd640 1 -- 10.20.193.76:0/2277171356 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442c004390 con 0x7f443806dfd0 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.434+0000 7f443cf62640 1 -- 10.20.193.76:0/2277171356 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f442c009500 con 0x7f443806dfd0 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.434+0000 7f441effd640 1 -- 10.20.193.76:0/2277171356 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442c003710 con 0x7f443806dfd0 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.434+0000 7f443cf62640 1 -- 10.20.193.76:0/2277171356 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4438123440 con 0x7f443806dfd0 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.434+0000 7f443cf62640 1 -- 10.20.193.76:0/2277171356 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443806e3b0 con 0x7f443806dfd0 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.434+0000 7f441effd640 1 -- 10.20.193.76:0/2277171356 <== mon.2 v2:10.20.193.76:3302/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f442c003870 con 0x7f443806dfd0 2026-02-25T17:21:33.437 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.435+0000 7f441effd640 1 -- 10.20.193.76:0/2277171356 <== mon.2 v2:10.20.193.76:3302/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7f442c08bf50 con 0x7f443806dfd0 2026-02-25T17:21:33.438 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.436+0000 7f441effd640 1 -- 10.20.193.76:0/2277171356 <== mon.2 v2:10.20.193.76:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f442c065980 con 0x7f443806dfd0 2026-02-25T17:21:33.504 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.501+0000 7f443cf62640 1 -- 10.20.193.76:0/2277171356 --> v1:10.20.193.76:6800/1563581135 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f443806ed00 con 0x7f440404f880 2026-02-25T17:21:33.504 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.502+0000 7f441effd640 1 -- 10.20.193.76:0/2277171356 <== mgr.14104 v1:10.20.193.76:6800/1563581135 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (unknown 3526570807 0 0) 0x7f4420002ba0 con 0x7f440404f880 2026-02-25T17:21:33.505 INFO:teuthology.orchestra.run.trial076.stderr:instructed osd(s) 3 to deep-scrub 2026-02-25T17:21:33.506 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.503+0000 7f443cf62640 1 -- 10.20.193.76:0/2277171356 >> v1:10.20.193.76:6800/1563581135 conn(0x7f440404f880 legacy=0x7f4404051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.506 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.503+0000 7f443cf62640 1 -- 10.20.193.76:0/2277171356 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f443806dfd0 msgr2=0x7f4438121b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.506 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.503+0000 7f443cf62640 1 --2- 10.20.193.76:0/2277171356 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f443806dfd0 0x7f4438121b20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f442c002410 tx=0x7f442c0047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.506 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.503+0000 7f443cf62640 1 -- 10.20.193.76:0/2277171356 shutdown_connections 2026-02-25T17:21:33.506 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.503+0000 7f443cf62640 1 --2- 10.20.193.76:0/2277171356 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f44380710a0 0x7f44381225a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.507 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.503+0000 7f443cf62640 1 --2- 10.20.193.76:0/2277171356 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f443806e8f0 0x7f4438122060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.507 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.503+0000 7f443cf62640 1 --2- 10.20.193.76:0/2277171356 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f443806dfd0 0x7f4438121b20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.507 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.503+0000 7f443cf62640 1 -- 10.20.193.76:0/2277171356 >> 10.20.193.76:0/2277171356 conn(0x7f443809a960 msgr2=0x7f443806bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:33.507 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.503+0000 7f443cf62640 1 -- 10.20.193.76:0/2277171356 shutdown_connections 2026-02-25T17:21:33.507 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.503+0000 7f443cf62640 1 -- 10.20.193.76:0/2277171356 wait complete. 2026-02-25T17:21:33.513 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T17:21:33.587 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.579+0000 7f596d44e640 1 Processor -- start 2026-02-25T17:21:33.587 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.579+0000 7f596d44e640 1 -- start start 2026-02-25T17:21:33.587 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.579+0000 7f596d44e640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f596806f210 0x7f5968070b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.588 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.579+0000 7f596d44e640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5968133c20 0x7f5968136010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.588 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.579+0000 7f596d44e640 1 -- --> v1:10.20.193.76:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596809d9a0 con 0x7f596806fcc0 2026-02-25T17:21:33.588 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.579+0000 7f596d44e640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5968070560 con 0x7f596806f210 2026-02-25T17:21:33.588 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.579+0000 7f596d44e640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59680992e0 con 0x7f5968133c20 2026-02-25T17:21:33.588 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.579+0000 7f59677fe640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5968133c20 0x7f5968136010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.579+0000 7f5966ffd640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f596806f210 0x7f5968070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.579+0000 7f59667fc640 1 --1- >> v1:10.20.193.76:6789/0 conn(0x7f596806fcc0 0x7f5968071070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.76:6789/0 says I am v1:10.20.193.76:32848/0 (socket says 10.20.193.76:32848) 2026-02-25T17:21:33.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.579+0000 7f59667fc640 1 -- 10.20.193.76:0/1266599200 learned_addr learned my addr 10.20.193.76:0/1266599200 (peer_addr_for_me v1:10.20.193.76:0/0) 2026-02-25T17:21:33.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.580+0000 7f5965ffb640 1 -- 10.20.193.76:0/1266599200 <== mon.0 v1:10.20.193.76:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841046828 0 0) 0x7f596809d9a0 con 0x7f596806fcc0 2026-02-25T17:21:33.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.580+0000 7f5965ffb640 1 -- 10.20.193.76:0/1266599200 --> v1:10.20.193.76:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5954003620 con 0x7f596806fcc0 2026-02-25T17:21:33.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.580+0000 7f59677fe640 1 -- 10.20.193.76:0/1266599200 >> v2:10.20.193.76:3300/0 conn(0x7f596806f210 msgr2=0x7f5968070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:33.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.580+0000 7f59677fe640 1 --2- 10.20.193.76:0/1266599200 >> v2:10.20.193.76:3300/0 conn(0x7f596806f210 0x7f5968070b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.580+0000 7f59677fe640 1 -- 10.20.193.76:0/1266599200 >> v1:10.20.193.76:6789/0 conn(0x7f596806fcc0 legacy=0x7f5968071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.580+0000 7f59677fe640 1 -- 10.20.193.76:0/1266599200 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5968070870 con 0x7f5968133c20 2026-02-25T17:21:33.589 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.580+0000 7f59677fe640 1 --2- 10.20.193.76:0/1266599200 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5968133c20 0x7f5968136010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5958009d90 tx=0x7f595802f190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a80da0418cfafa4 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:33.590 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.580+0000 7f5965ffb640 1 -- 10.20.193.76:0/1266599200 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958006ea0 con 0x7f5968133c20 2026-02-25T17:21:33.590 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.580+0000 7f5965ffb640 1 -- 10.20.193.76:0/1266599200 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595802fe10 con 0x7f5968133c20 2026-02-25T17:21:33.590 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.580+0000 7f5965ffb640 1 -- 10.20.193.76:0/1266599200 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958037660 con 0x7f5968133c20 2026-02-25T17:21:33.590 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.580+0000 7f596d44e640 1 -- 10.20.193.76:0/1266599200 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5968133c20 msgr2=0x7f5968136010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.590 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.580+0000 7f596d44e640 1 --2- 10.20.193.76:0/1266599200 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5968133c20 0x7f5968136010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5958009d90 tx=0x7f595802f190 comp rx=0 tx=0).stop 2026-02-25T17:21:33.590 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.580+0000 7f596d44e640 1 -- 10.20.193.76:0/1266599200 shutdown_connections 2026-02-25T17:21:33.590 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.580+0000 7f596d44e640 1 --2- 10.20.193.76:0/1266599200 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5968133c20 0x7f5968136010 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.590 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.580+0000 7f596d44e640 1 --2- 10.20.193.76:0/1266599200 >> v2:10.20.193.76:3300/0 conn(0x7f596806f210 0x7f5968070b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.590 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.580+0000 7f596d44e640 1 -- 10.20.193.76:0/1266599200 >> 10.20.193.76:0/1266599200 conn(0x7f596809a960 msgr2=0x7f596809ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:33.590 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.580+0000 7f596d44e640 1 -- 10.20.193.76:0/1266599200 shutdown_connections 2026-02-25T17:21:33.590 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.580+0000 7f596d44e640 1 -- 10.20.193.76:0/1266599200 wait complete. 2026-02-25T17:21:33.591 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.581+0000 7f596d44e640 1 Processor -- start 2026-02-25T17:21:33.591 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.581+0000 7f596d44e640 1 -- start start 2026-02-25T17:21:33.591 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.581+0000 7f596d44e640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f596806f210 0x7f5968094050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.591 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.581+0000 7f596d44e640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f596806fcc0 0x7f5968094590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.591 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.581+0000 7f596d44e640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5968133c20 0x7f5968094ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:33.591 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.581+0000 7f596d44e640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5968097ae0 con 0x7f596806f210 2026-02-25T17:21:33.591 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.581+0000 7f596d44e640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5968097820 con 0x7f596806fcc0 2026-02-25T17:21:33.591 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.581+0000 7f596d44e640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5968096420 con 0x7f5968133c20 2026-02-25T17:21:33.591 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.581+0000 7f5966ffd640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f596806f210 0x7f5968094050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.591 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.581+0000 7f5966ffd640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f596806f210 0x7f5968094050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:36266/0 (socket says 10.20.193.76:36266) 2026-02-25T17:21:33.592 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.581+0000 7f5966ffd640 1 -- 10.20.193.76:0/2258976936 learned_addr learned my addr 10.20.193.76:0/2258976936 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:33.592 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.581+0000 7f59677fe640 1 --2- 10.20.193.76:0/2258976936 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5968133c20 0x7f5968094ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.592 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.581+0000 7f59667fc640 1 --2- 10.20.193.76:0/2258976936 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f596806fcc0 0x7f5968094590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:33.592 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.581+0000 7f5966ffd640 1 -- 10.20.193.76:0/2258976936 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5968133c20 msgr2=0x7f5968094ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.592 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.581+0000 7f5966ffd640 1 --2- 10.20.193.76:0/2258976936 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5968133c20 0x7f5968094ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.592 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.581+0000 7f5966ffd640 1 -- 10.20.193.76:0/2258976936 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f596806fcc0 msgr2=0x7f5968094590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.592 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.581+0000 7f5966ffd640 1 --2- 10.20.193.76:0/2258976936 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f596806fcc0 0x7f5968094590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.592 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.581+0000 7f5966ffd640 1 -- 10.20.193.76:0/2258976936 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5958009a70 con 0x7f596806f210 2026-02-25T17:21:33.592 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.581+0000 7f5966ffd640 1 --2- 10.20.193.76:0/2258976936 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f596806f210 0x7f5968094050 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f595c00ebe0 tx=0x7f595c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:33.592 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.582+0000 7f59477fe640 1 -- 10.20.193.76:0/2258976936 <== mon.0 v2:10.20.193.76:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c009770 con 0x7f596806f210 2026-02-25T17:21:33.593 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.582+0000 7f59477fe640 1 -- 10.20.193.76:0/2258976936 <== mon.0 v2:10.20.193.76:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595c00cc40 con 0x7f596806f210 2026-02-25T17:21:33.593 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.582+0000 7f596d44e640 1 -- 10.20.193.76:0/2258976936 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5968096c70 con 0x7f596806f210 2026-02-25T17:21:33.593 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.582+0000 7f59477fe640 1 -- 10.20.193.76:0/2258976936 <== mon.0 v2:10.20.193.76:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c013470 con 0x7f596806f210 2026-02-25T17:21:33.593 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.582+0000 7f596d44e640 1 -- 10.20.193.76:0/2258976936 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59680951f0 con 0x7f596806f210 2026-02-25T17:21:33.593 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.582+0000 7f596d44e640 1 -- 10.20.193.76:0/2258976936 --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5968074be0 con 0x7f596806f210 2026-02-25T17:21:33.593 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.582+0000 7f59477fe640 1 -- 10.20.193.76:0/2258976936 <== mon.0 v2:10.20.193.76:3300/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f595c011070 con 0x7f596806f210 2026-02-25T17:21:33.593 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.583+0000 7f59477fe640 1 -- 10.20.193.76:0/2258976936 <== mon.0 v2:10.20.193.76:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7f595c066920 con 0x7f596806f210 2026-02-25T17:21:33.593 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.584+0000 7f59477fe640 1 -- 10.20.193.76:0/2258976936 <== mon.0 v2:10.20.193.76:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f595c0402a0 con 0x7f596806f210 2026-02-25T17:21:33.651 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.649+0000 7f596d44e640 1 -- 10.20.193.76:0/2258976936 --> v1:10.20.193.76:6800/1563581135 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5968095c30 con 0x7f593404f880 2026-02-25T17:21:33.653 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.649+0000 7f59477fe640 1 -- 10.20.193.76:0/2258976936 <== mgr.14104 v1:10.20.193.76:6800/1563581135 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34735 (unknown 2965378022 0 15709611) 0x7f5950002be0 con 0x7f593404f880 2026-02-25T17:21:33.654 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:33.657 INFO:teuthology.orchestra.run.trial076.stderr:dumped all 2026-02-25T17:21:33.657 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.650+0000 7f596d44e640 1 -- 10.20.193.76:0/2258976936 >> v1:10.20.193.76:6800/1563581135 conn(0x7f593404f880 legacy=0x7f5934051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.657 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.650+0000 7f596d44e640 1 -- 10.20.193.76:0/2258976936 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f596806f210 msgr2=0x7f5968094050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:33.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.650+0000 7f596d44e640 1 --2- 10.20.193.76:0/2258976936 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f596806f210 0x7f5968094050 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f595c00ebe0 tx=0x7f595c00c520 comp rx=0 tx=0).stop 2026-02-25T17:21:33.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.650+0000 7f596d44e640 1 -- 10.20.193.76:0/2258976936 shutdown_connections 2026-02-25T17:21:33.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.650+0000 7f596d44e640 1 --2- 10.20.193.76:0/2258976936 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f5968133c20 0x7f5968094ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.650+0000 7f596d44e640 1 --2- 10.20.193.76:0/2258976936 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f596806fcc0 0x7f5968094590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.650+0000 7f596d44e640 1 --2- 10.20.193.76:0/2258976936 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f596806f210 0x7f5968094050 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:33.658 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.650+0000 7f596d44e640 1 -- 10.20.193.76:0/2258976936 >> 10.20.193.76:0/2258976936 conn(0x7f596809a960 msgr2=0x7f596806cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:33.659 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.650+0000 7f596d44e640 1 -- 10.20.193.76:0/2258976936 shutdown_connections 2026-02-25T17:21:33.659 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:33.650+0000 7f596d44e640 1 -- 10.20.193.76:0/2258976936 wait complete. 2026-02-25T17:21:33.661 INFO:teuthology.orchestra.run.trial076.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2026-02-25T17:21:33.047787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":111940,"kb_used_data":2120,"kb_used_omap":17,"kb_used_meta":109742,"kb_avail":377375420,"statfs":{"total":386547056640,"available":386432430080,"internally_reserved":0,"allocated":2170880,"data_stored":1528473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18185,"internal_metadata":112376055},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.852352"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199182+0000","last_change":"2026-02-25T17:21:24.194818+0000","last_active":"2026-02-25T17:21:26.199182+0000","last_peered":"2026-02-25T17:21:26.199182+0000","last_clean":"2026-02-25T17:21:26.199182+0000","last_became_active":"2026-02-25T17:21:24.194619+0000","last_became_peered":"2026-02-25T17:21:24.194619+0000","last_unstale":"2026-02-25T17:21:26.199182+0000","last_undegraded":"2026-02-25T17:21:26.199182+0000","last_fullsized":"2026-02-25T17:21:26.199182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:59:31.300444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198898+0000","last_change":"2026-02-25T17:21:24.194618+0000","last_active":"2026-02-25T17:21:26.198898+0000","last_peered":"2026-02-25T17:21:26.198898+0000","last_clean":"2026-02-25T17:21:26.198898+0000","last_became_active":"2026-02-25T17:21:24.194411+0000","last_became_peered":"2026-02-25T17:21:24.194411+0000","last_unstale":"2026-02-25T17:21:26.198898+0000","last_undegraded":"2026-02-25T17:21:26.198898+0000","last_fullsized":"2026-02-25T17:21:26.198898+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:40:43.331156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000395898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":32,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199198+0000","last_change":"2026-02-25T17:21:24.195559+0000","last_active":"2026-02-25T17:21:26.199198+0000","last_peered":"2026-02-25T17:21:26.199198+0000","last_clean":"2026-02-25T17:21:26.199198+0000","last_became_active":"2026-02-25T17:21:24.195473+0000","last_became_peered":"2026-02-25T17:21:24.195473+0000","last_unstale":"2026-02-25T17:21:26.199198+0000","last_undegraded":"2026-02-25T17:21:26.199198+0000","last_fullsized":"2026-02-25T17:21:26.199198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:22:24.234703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00026897200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198922+0000","last_change":"2026-02-25T17:21:24.194793+0000","last_active":"2026-02-25T17:21:26.198922+0000","last_peered":"2026-02-25T17:21:26.198922+0000","last_clean":"2026-02-25T17:21:26.198922+0000","last_became_active":"2026-02-25T17:21:24.194561+0000","last_became_peered":"2026-02-25T17:21:24.194561+0000","last_unstale":"2026-02-25T17:21:26.198922+0000","last_undegraded":"2026-02-25T17:21:26.198922+0000","last_fullsized":"2026-02-25T17:21:26.198922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T04:02:43.748049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038440700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"16'79","reported_seq":149,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198864+0000","last_change":"2026-02-25T17:21:24.195059+0000","last_active":"2026-02-25T17:21:26.198864+0000","last_peered":"2026-02-25T17:21:26.198864+0000","last_clean":"2026-02-25T17:21:26.198864+0000","last_became_active":"2026-02-25T17:21:24.194928+0000","last_became_peered":"2026-02-25T17:21:24.194928+0000","last_unstale":"2026-02-25T17:21:26.198864+0000","last_undegraded":"2026-02-25T17:21:26.198864+0000","last_fullsized":"2026-02-25T17:21:26.198864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T01:21:32.983159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"11'1","reported_seq":34,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199155+0000","last_change":"2026-02-25T17:21:23.192944+0000","last_active":"2026-02-25T17:21:26.199155+0000","last_peered":"2026-02-25T17:21:26.199155+0000","last_clean":"2026-02-25T17:21:26.199155+0000","last_became_active":"2026-02-25T17:21:23.192745+0000","last_became_peered":"2026-02-25T17:21:23.192745+0000","last_unstale":"2026-02-25T17:21:26.199155+0000","last_undegraded":"2026-02-25T17:21:26.199155+0000","last_fullsized":"2026-02-25T17:21:26.199155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:12:01.863576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00033429400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"13'2","reported_seq":36,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.391364+0000","last_change":"2026-02-25T17:21:22.189219+0000","last_active":"2026-02-25T17:21:26.391364+0000","last_peered":"2026-02-25T17:21:26.391364+0000","last_clean":"2026-02-25T17:21:26.391364+0000","last_became_active":"2026-02-25T17:21:22.189043+0000","last_became_peered":"2026-02-25T17:21:22.189043+0000","last_unstale":"2026-02-25T17:21:26.391364+0000","last_undegraded":"2026-02-25T17:21:26.391364+0000","last_fullsized":"2026-02-25T17:21:26.391364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:14:12.733416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083336499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":43,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.198893+0000","last_change":"2026-02-25T17:21:24.194744+0000","last_active":"2026-02-25T17:21:26.198893+0000","last_peered":"2026-02-25T17:21:26.198893+0000","last_clean":"2026-02-25T17:21:26.198893+0000","last_became_active":"2026-02-25T17:21:24.194527+0000","last_became_peered":"2026-02-25T17:21:24.194527+0000","last_unstale":"2026-02-25T17:21:26.198893+0000","last_undegraded":"2026-02-25T17:21:26.198893+0000","last_fullsized":"2026-02-25T17:21:26.198893+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:08:42.357152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00054556799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-25T17:21:26.199174+0000","last_change":"2026-02-25T17:21:22.188981+0000","last_active":"2026-02-25T17:21:26.199174+0000","last_peered":"2026-02-25T17:21:26.199174+0000","last_clean":"2026-02-25T17:21:26.199174+0000","last_became_active":"2026-02-25T17:21:22.188810+0000","last_became_peered":"2026-02-25T17:21:22.188810+0000","last_unstale":"2026-02-25T17:21:26.199174+0000","last_undegraded":"2026-02-25T17:21:26.199174+0000","last_fullsized":"2026-02-25T17:21:26.199174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:13:43.012899+0000","last_clean_scrub_stamp":"2026-02-25T17:13:43.012899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:20:57.540380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056038500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":25,"seq":107374182404,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28288,"kb_used_data":820,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94343552,"statfs":{"total":96636764160,"available":96607797248,"internally_reserved":0,"allocated":839680,"data_stored":677685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4549,"internal_metadata":28110395},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.14399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]}]},{"osd":2,"up_from":24,"seq":103079215108,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":236,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":241664,"data_stored":86701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":28110400},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.14999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.182}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]}]},{"osd":1,"up_from":23,"seq":98784247812,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28232,"kb_used_data":824,"kb_used_omap":4,"kb_used_meta":27387,"kb_avail":94343608,"statfs":{"total":96636764160,"available":96607854592,"internally_reserved":0,"allocated":843776,"data_stored":677704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4548,"internal_metadata":28044860},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]}]},{"osd":0,"up_from":22,"seq":94489280516,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":240,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":245760,"data_stored":86383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":28110400},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T17:21:33.672 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2026-02-25T17:13:43.012899+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=17, tm_min=13, tm_sec=43, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=17, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T17:21:33.673 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2026-02-25T17:13:43.012899+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=17, tm_min=13, tm_sec=43, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=17, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T17:21:33.673 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2026-02-25T17:13:43.012899+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=17, tm_min=13, tm_sec=43, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=17, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T17:21:33.673 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2026-02-25T17:13:43.012899+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=17, tm_min=13, tm_sec=43, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=17, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T17:21:33.674 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-25T17:13:43.012899+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=17, tm_min=13, tm_sec=43, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=17, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T17:21:33.674 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2026-02-25T17:13:43.012899+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=17, tm_min=13, tm_sec=43, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=17, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T17:21:33.674 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2026-02-25T17:13:43.012899+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=17, tm_min=13, tm_sec=43, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=17, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T17:21:33.675 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2026-02-25T17:13:43.012899+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=17, tm_min=13, tm_sec=43, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=17, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T17:21:33.675 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-25T17:13:43.012899+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=17, tm_min=13, tm_sec=43, tm_wday=2, tm_yday=56, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=25, tm_hour=17, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=56, tm_isdst=0) 2026-02-25T17:21:33.675 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-25T17:21:53.676 DEBUG:teuthology.orchestra.run.trial076:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-25T17:21:53.748 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.741+0000 7f2965758640 1 Processor -- start 2026-02-25T17:21:53.748 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.741+0000 7f2965758640 1 -- start start 2026-02-25T17:21:53.748 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.741+0000 7f2965758640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f296006f210 0x7f2960070b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:53.748 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.741+0000 7f2965758640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f296006fcc0 0x7f2960071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:53.749 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.741+0000 7f2965758640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f29600715b0 0x7f2960134c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:53.749 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.741+0000 7f2965758640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f296009d9a0 con 0x7f29600715b0 2026-02-25T17:21:53.749 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.741+0000 7f2965758640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2960070560 con 0x7f296006fcc0 2026-02-25T17:21:53.749 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.741+0000 7f2965758640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29600992e0 con 0x7f296006f210 2026-02-25T17:21:53.749 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.741+0000 7f295effd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f296006f210 0x7f2960070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:53.749 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.741+0000 7f295e7fc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f296006fcc0 0x7f2960071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:53.749 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.741+0000 7f295f7fe640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f29600715b0 0x7f2960134c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:53.749 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.741+0000 7f295effd640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f296006f210 0x7f2960070b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:55174/0 (socket says 10.20.193.76:55174) 2026-02-25T17:21:53.749 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.741+0000 7f295effd640 1 -- 10.20.193.76:0/3504264515 learned_addr learned my addr 10.20.193.76:0/3504264515 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:53.749 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.741+0000 7f295e7fc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f296006fcc0 0x7f2960071070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:46452/0 (socket says 10.20.193.76:46452) 2026-02-25T17:21:53.749 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.741+0000 7f295effd640 1 -- 10.20.193.76:0/3504264515 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f296006fcc0 msgr2=0x7f2960071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:53.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.741+0000 7f295effd640 1 --2- 10.20.193.76:0/3504264515 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f296006fcc0 0x7f2960071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.741+0000 7f295effd640 1 -- 10.20.193.76:0/3504264515 >> v2:10.20.193.76:3300/0 conn(0x7f29600715b0 msgr2=0x7f2960134c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:53.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.741+0000 7f295effd640 1 --2- 10.20.193.76:0/3504264515 >> v2:10.20.193.76:3300/0 conn(0x7f29600715b0 0x7f2960134c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.741+0000 7f295effd640 1 -- 10.20.193.76:0/3504264515 --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2960070870 con 0x7f296006f210 2026-02-25T17:21:53.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.742+0000 7f295effd640 1 --2- 10.20.193.76:0/3504264515 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f296006f210 0x7f2960070b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f29540099a0 tx=0x7f295402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34130376c8459e1d server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:53.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.742+0000 7f295dffb640 1 -- 10.20.193.76:0/3504264515 <== mon.2 v2:10.20.193.76:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295402fac0 con 0x7f296006f210 2026-02-25T17:21:53.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.742+0000 7f295dffb640 1 -- 10.20.193.76:0/3504264515 <== mon.2 v2:10.20.193.76:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295402fc20 con 0x7f296006f210 2026-02-25T17:21:53.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.742+0000 7f295dffb640 1 -- 10.20.193.76:0/3504264515 <== mon.2 v2:10.20.193.76:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954037440 con 0x7f296006f210 2026-02-25T17:21:53.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.742+0000 7f2965758640 1 -- 10.20.193.76:0/3504264515 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f296006f210 msgr2=0x7f2960070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:53.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.742+0000 7f2965758640 1 --2- 10.20.193.76:0/3504264515 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f296006f210 0x7f2960070b30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f29540099a0 tx=0x7f295402ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:53.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.742+0000 7f2965758640 1 -- 10.20.193.76:0/3504264515 shutdown_connections 2026-02-25T17:21:53.750 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.742+0000 7f2965758640 1 --2- 10.20.193.76:0/3504264515 >> v2:10.20.193.76:3300/0 conn(0x7f29600715b0 0x7f2960134c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.751 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.742+0000 7f2965758640 1 --2- 10.20.193.76:0/3504264515 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f296006fcc0 0x7f2960071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.751 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.742+0000 7f2965758640 1 --2- 10.20.193.76:0/3504264515 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f296006f210 0x7f2960070b30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.751 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.742+0000 7f2965758640 1 -- 10.20.193.76:0/3504264515 >> 10.20.193.76:0/3504264515 conn(0x7f296009a960 msgr2=0x7f296009ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:53.751 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.742+0000 7f2965758640 1 -- 10.20.193.76:0/3504264515 shutdown_connections 2026-02-25T17:21:53.751 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.742+0000 7f2965758640 1 -- 10.20.193.76:0/3504264515 wait complete. 2026-02-25T17:21:53.751 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f2965758640 1 Processor -- start 2026-02-25T17:21:53.751 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f2965758640 1 -- start start 2026-02-25T17:21:53.751 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f2965758640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f296006f210 0x7f2960123aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:53.751 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f2965758640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f296006fcc0 0x7f2960123fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:53.751 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f2965758640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f29600715b0 0x7f2960124520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:53.751 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f2965758640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2960125c30 con 0x7f296006f210 2026-02-25T17:21:53.751 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f2965758640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29601254b0 con 0x7f296006fcc0 2026-02-25T17:21:53.751 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f2965758640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2960126840 con 0x7f29600715b0 2026-02-25T17:21:53.752 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f295e7fc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f296006fcc0 0x7f2960123fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:53.752 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f295effd640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f296006f210 0x7f2960123aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:53.752 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f295e7fc640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f296006fcc0 0x7f2960123fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:46460/0 (socket says 10.20.193.76:46460) 2026-02-25T17:21:53.752 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f295e7fc640 1 -- 10.20.193.76:0/2220581620 learned_addr learned my addr 10.20.193.76:0/2220581620 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:53.752 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f295f7fe640 1 --2- 10.20.193.76:0/2220581620 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f29600715b0 0x7f2960124520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:53.752 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f295e7fc640 1 -- 10.20.193.76:0/2220581620 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f29600715b0 msgr2=0x7f2960124520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:53.752 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f295e7fc640 1 --2- 10.20.193.76:0/2220581620 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f29600715b0 0x7f2960124520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.752 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f295e7fc640 1 -- 10.20.193.76:0/2220581620 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f296006f210 msgr2=0x7f2960123aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:53.752 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f295e7fc640 1 --2- 10.20.193.76:0/2220581620 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f296006f210 0x7f2960123aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.752 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f295e7fc640 1 -- 10.20.193.76:0/2220581620 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29540095d0 con 0x7f296006fcc0 2026-02-25T17:21:53.752 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f295e7fc640 1 --2- 10.20.193.76:0/2220581620 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f296006fcc0 0x7f2960123fe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f294800ebe0 tx=0x7f294800c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:53.753 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f293f7fe640 1 -- 10.20.193.76:0/2220581620 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948009770 con 0x7f296006fcc0 2026-02-25T17:21:53.753 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f293f7fe640 1 -- 10.20.193.76:0/2220581620 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294800cc40 con 0x7f296006fcc0 2026-02-25T17:21:53.753 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f2965758640 1 -- 10.20.193.76:0/2220581620 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29601270a0 con 0x7f296006fcc0 2026-02-25T17:21:53.753 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f293f7fe640 1 -- 10.20.193.76:0/2220581620 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948013470 con 0x7f296006fcc0 2026-02-25T17:21:53.753 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.743+0000 7f2965758640 1 -- 10.20.193.76:0/2220581620 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2960134ed0 con 0x7f296006fcc0 2026-02-25T17:21:53.753 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.744+0000 7f2965758640 1 -- 10.20.193.76:0/2220581620 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2960071ff0 con 0x7f296006fcc0 2026-02-25T17:21:53.753 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.744+0000 7f293f7fe640 1 -- 10.20.193.76:0/2220581620 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f2948011070 con 0x7f296006fcc0 2026-02-25T17:21:53.753 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.744+0000 7f293f7fe640 1 -- 10.20.193.76:0/2220581620 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7f2948066930 con 0x7f296006fcc0 2026-02-25T17:21:53.754 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.746+0000 7f293f7fe640 1 -- 10.20.193.76:0/2220581620 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f29480402b0 con 0x7f296006fcc0 2026-02-25T17:21:53.815 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.812+0000 7f2965758640 1 -- 10.20.193.76:0/2220581620 --> v1:10.20.193.76:6800/1563581135 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2960126400 con 0x7f292c04f8b0 2026-02-25T17:21:53.816 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.813+0000 7f293f7fe640 1 -- 10.20.193.76:0/2220581620 <== mgr.14104 v1:10.20.193.76:6800/1563581135 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34923 (unknown 2965378022 0 3230021089) 0x7f2960126400 con 0x7f292c04f8b0 2026-02-25T17:21:53.817 INFO:teuthology.orchestra.run.trial076.stdout: 2026-02-25T17:21:53.818 INFO:teuthology.orchestra.run.trial076.stderr:dumped all 2026-02-25T17:21:53.818 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.814+0000 7f2965758640 1 -- 10.20.193.76:0/2220581620 >> v1:10.20.193.76:6800/1563581135 conn(0x7f292c04f8b0 legacy=0x7f292c051d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:53.818 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.814+0000 7f2965758640 1 -- 10.20.193.76:0/2220581620 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f296006fcc0 msgr2=0x7f2960123fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:53.818 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.814+0000 7f2965758640 1 --2- 10.20.193.76:0/2220581620 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f296006fcc0 0x7f2960123fe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f294800ebe0 tx=0x7f294800c520 comp rx=0 tx=0).stop 2026-02-25T17:21:53.818 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.814+0000 7f2965758640 1 -- 10.20.193.76:0/2220581620 shutdown_connections 2026-02-25T17:21:53.818 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.814+0000 7f2965758640 1 --2- 10.20.193.76:0/2220581620 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f29600715b0 0x7f2960124520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.814+0000 7f2965758640 1 --2- 10.20.193.76:0/2220581620 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f296006fcc0 0x7f2960123fe0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.814+0000 7f2965758640 1 --2- 10.20.193.76:0/2220581620 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f296006f210 0x7f2960123aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.814+0000 7f2965758640 1 -- 10.20.193.76:0/2220581620 >> 10.20.193.76:0/2220581620 conn(0x7f296009a960 msgr2=0x7f296006c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:53.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.814+0000 7f2965758640 1 -- 10.20.193.76:0/2220581620 shutdown_connections 2026-02-25T17:21:53.819 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.814+0000 7f2965758640 1 -- 10.20.193.76:0/2220581620 wait complete. 2026-02-25T17:21:53.825 INFO:teuthology.orchestra.run.trial076.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2026-02-25T17:21:53.049492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":111912,"kb_used_data":2120,"kb_used_omap":17,"kb_used_meta":109742,"kb_avail":377375448,"statfs":{"total":386547056640,"available":386432458752,"internally_reserved":0,"allocated":2170880,"data_stored":1528473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18185,"internal_metadata":112376055},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000984"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T17:21:42.218048+0000","last_change":"2026-02-25T17:21:42.218123+0000","last_active":"2026-02-25T17:21:42.218048+0000","last_peered":"2026-02-25T17:21:42.218048+0000","last_clean":"2026-02-25T17:21:42.218048+0000","last_became_active":"2026-02-25T17:21:24.194619+0000","last_became_peered":"2026-02-25T17:21:24.194619+0000","last_unstale":"2026-02-25T17:21:42.218048+0000","last_undegraded":"2026-02-25T17:21:42.218048+0000","last_fullsized":"2026-02-25T17:21:42.218048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:21:42.218030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:21:42.218030+0000","last_clean_scrub_stamp":"2026-02-25T17:21:42.218030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T05:05:50.421120+0000","scrub_duration":0.00073924400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T17:21:50.166655+0000","last_change":"2026-02-25T17:21:50.166720+0000","last_active":"2026-02-25T17:21:50.166655+0000","last_peered":"2026-02-25T17:21:50.166655+0000","last_clean":"2026-02-25T17:21:50.166655+0000","last_became_active":"2026-02-25T17:21:24.194411+0000","last_became_peered":"2026-02-25T17:21:24.194411+0000","last_unstale":"2026-02-25T17:21:50.166655+0000","last_undegraded":"2026-02-25T17:21:50.166655+0000","last_fullsized":"2026-02-25T17:21:50.166655+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:21:50.166640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:21:50.166640+0000","last_clean_scrub_stamp":"2026-02-25T17:21:50.166640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T19:58:08.319398+0000","scrub_duration":0.00087518800000000005,"objects_trimmed":0,"snaptrim_duration":0.000395898,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T17:21:40.106954+0000","last_change":"2026-02-25T17:21:40.107010+0000","last_active":"2026-02-25T17:21:40.106954+0000","last_peered":"2026-02-25T17:21:40.106954+0000","last_clean":"2026-02-25T17:21:40.106954+0000","last_became_active":"2026-02-25T17:21:24.195473+0000","last_became_peered":"2026-02-25T17:21:24.195473+0000","last_unstale":"2026-02-25T17:21:40.106954+0000","last_undegraded":"2026-02-25T17:21:40.106954+0000","last_fullsized":"2026-02-25T17:21:40.106954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:21:40.106944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:21:40.106944+0000","last_clean_scrub_stamp":"2026-02-25T17:21:40.106944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T20:10:02.860559+0000","scrub_duration":0.00074576600000000003,"objects_trimmed":0,"snaptrim_duration":0.00026897200000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T17:21:41.077295+0000","last_change":"2026-02-25T17:21:41.077355+0000","last_active":"2026-02-25T17:21:41.077295+0000","last_peered":"2026-02-25T17:21:41.077295+0000","last_clean":"2026-02-25T17:21:41.077295+0000","last_became_active":"2026-02-25T17:21:24.194561+0000","last_became_peered":"2026-02-25T17:21:24.194561+0000","last_unstale":"2026-02-25T17:21:41.077295+0000","last_undegraded":"2026-02-25T17:21:41.077295+0000","last_fullsized":"2026-02-25T17:21:41.077295+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:21:41.077284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:21:41.077284+0000","last_clean_scrub_stamp":"2026-02-25T17:21:41.077284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T00:20:06.826355+0000","scrub_duration":0.00059916199999999998,"objects_trimmed":0,"snaptrim_duration":0.00038440700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"29'80","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T17:21:40.052702+0000","last_change":"2026-02-25T17:21:40.052813+0000","last_active":"2026-02-25T17:21:40.052702+0000","last_peered":"2026-02-25T17:21:40.052702+0000","last_clean":"2026-02-25T17:21:40.052702+0000","last_became_active":"2026-02-25T17:21:24.194928+0000","last_became_peered":"2026-02-25T17:21:24.194928+0000","last_unstale":"2026-02-25T17:21:40.052702+0000","last_undegraded":"2026-02-25T17:21:40.052702+0000","last_fullsized":"2026-02-25T17:21:40.052702+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'80","last_scrub_stamp":"2026-02-25T17:21:40.052678+0000","last_deep_scrub":"29'80","last_deep_scrub_stamp":"2026-02-25T17:21:40.052678+0000","last_clean_scrub_stamp":"2026-02-25T17:21:40.052678+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:53:05.483492+0000","scrub_duration":0.0035820869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T17:21:36.183362+0000","last_change":"2026-02-25T17:21:36.183462+0000","last_active":"2026-02-25T17:21:36.183362+0000","last_peered":"2026-02-25T17:21:36.183362+0000","last_clean":"2026-02-25T17:21:36.183362+0000","last_became_active":"2026-02-25T17:21:23.192745+0000","last_became_peered":"2026-02-25T17:21:23.192745+0000","last_unstale":"2026-02-25T17:21:36.183362+0000","last_undegraded":"2026-02-25T17:21:36.183362+0000","last_fullsized":"2026-02-25T17:21:36.183362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2026-02-25T17:21:36.183341+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2026-02-25T17:21:36.183341+0000","last_clean_scrub_stamp":"2026-02-25T17:21:36.183341+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-27T02:41:55.743086+0000","scrub_duration":0.002248239,"objects_trimmed":0,"snaptrim_duration":0.00033429400000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"29'3","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T17:21:35.357814+0000","last_change":"2026-02-25T17:21:35.357920+0000","last_active":"2026-02-25T17:21:35.357814+0000","last_peered":"2026-02-25T17:21:35.357814+0000","last_clean":"2026-02-25T17:21:35.357814+0000","last_became_active":"2026-02-25T17:21:22.189043+0000","last_became_peered":"2026-02-25T17:21:22.189043+0000","last_unstale":"2026-02-25T17:21:35.357814+0000","last_undegraded":"2026-02-25T17:21:35.357814+0000","last_fullsized":"2026-02-25T17:21:35.357814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2026-02-25T17:21:35.357802+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2026-02-25T17:21:35.357802+0000","last_clean_scrub_stamp":"2026-02-25T17:21:35.357802+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T18:12:36.849425+0000","scrub_duration":0.0025752819999999999,"objects_trimmed":0,"snaptrim_duration":0.00083336499999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T17:21:39.013035+0000","last_change":"2026-02-25T17:21:39.013089+0000","last_active":"2026-02-25T17:21:39.013035+0000","last_peered":"2026-02-25T17:21:39.013035+0000","last_clean":"2026-02-25T17:21:39.013035+0000","last_became_active":"2026-02-25T17:21:24.194527+0000","last_became_peered":"2026-02-25T17:21:24.194527+0000","last_unstale":"2026-02-25T17:21:39.013035+0000","last_undegraded":"2026-02-25T17:21:39.013035+0000","last_fullsized":"2026-02-25T17:21:39.013035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:21:39.013024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:21:39.013024+0000","last_clean_scrub_stamp":"2026-02-25T17:21:39.013024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T22:52:29.476475+0000","scrub_duration":0.00083006400000000004,"objects_trimmed":0,"snaptrim_duration":0.00054556799999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-25T17:21:33.238330+0000","last_change":"2026-02-25T17:21:33.238380+0000","last_active":"2026-02-25T17:21:33.238330+0000","last_peered":"2026-02-25T17:21:33.238330+0000","last_clean":"2026-02-25T17:21:33.238330+0000","last_became_active":"2026-02-25T17:21:22.188810+0000","last_became_peered":"2026-02-25T17:21:22.188810+0000","last_unstale":"2026-02-25T17:21:33.238330+0000","last_undegraded":"2026-02-25T17:21:33.238330+0000","last_fullsized":"2026-02-25T17:21:33.238330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-25T17:21:33.238319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-25T17:21:33.238319+0000","last_clean_scrub_stamp":"2026-02-25T17:21:33.238319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T23:16:29.204955+0000","scrub_duration":0.00089042699999999995,"objects_trimmed":0,"snaptrim_duration":0.00056038500000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":25,"seq":107374182408,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":820,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":839680,"data_stored":677685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4549,"internal_metadata":28110395},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.088999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.097000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.14099999999999999}]}]},{"osd":2,"up_from":24,"seq":103079215112,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":236,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":241664,"data_stored":86701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":28110400},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.11600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.154}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16900000000000001}]}]},{"osd":1,"up_from":23,"seq":98784247816,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28224,"kb_used_data":824,"kb_used_omap":4,"kb_used_meta":27387,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":843776,"data_stored":677704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4548,"internal_metadata":28044860},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.087999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.129}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.13500000000000001}]}]},{"osd":0,"up_from":22,"seq":94489280520,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":240,"kb_used_omap":4,"kb_used_meta":27451,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":245760,"data_stored":86383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":28110400},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-25T17:21:53.827 DEBUG:teuthology.orchestra.run.trial076:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-25T17:21:53.899 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b8b52e640 1 Processor -- start 2026-02-25T17:21:53.899 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b8b52e640 1 -- start start 2026-02-25T17:21:53.900 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b8b52e640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0b8409ba00 0x7f0b8406bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:53.900 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b8b52e640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0b8406d780 0x7f0b8406c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:53.900 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b8b52e640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f0b8406c9d0 0x7f0b84134cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:53.900 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b8b52e640 1 -- --> v2:10.20.193.76:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b8409c900 con 0x7f0b8406c9d0 2026-02-25T17:21:53.900 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b8b52e640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8406e020 con 0x7f0b8409ba00 2026-02-25T17:21:53.900 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b8b52e640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8409c250 con 0x7f0b8406d780 2026-02-25T17:21:53.900 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b892a3640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0b8409ba00 0x7f0b8406bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:53.900 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b88aa2640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0b8406d780 0x7f0b8406c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:53.900 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b89aa4640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f0b8406c9d0 0x7f0b84134cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:53.900 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b892a3640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0b8409ba00 0x7f0b8406bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:46474/0 (socket says 10.20.193.76:46474) 2026-02-25T17:21:53.901 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b88aa2640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0b8406d780 0x7f0b8406c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3302/0 says I am v2:10.20.193.76:55192/0 (socket says 10.20.193.76:55192) 2026-02-25T17:21:53.901 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b89aa4640 1 --2- >> v2:10.20.193.76:3300/0 conn(0x7f0b8406c9d0 0x7f0b84134cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3300/0 says I am v2:10.20.193.76:51878/0 (socket says 10.20.193.76:51878) 2026-02-25T17:21:53.901 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b892a3640 1 -- 10.20.193.76:0/3406943521 learned_addr learned my addr 10.20.193.76:0/3406943521 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:53.901 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b892a3640 1 -- 10.20.193.76:0/3406943521 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0b8406d780 msgr2=0x7f0b8406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:53.901 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b892a3640 1 --2- 10.20.193.76:0/3406943521 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0b8406d780 0x7f0b8406c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.901 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b892a3640 1 -- 10.20.193.76:0/3406943521 >> v2:10.20.193.76:3300/0 conn(0x7f0b8406c9d0 msgr2=0x7f0b84134cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-25T17:21:53.901 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b892a3640 1 --2- 10.20.193.76:0/3406943521 >> v2:10.20.193.76:3300/0 conn(0x7f0b8406c9d0 0x7f0b84134cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.901 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b892a3640 1 -- 10.20.193.76:0/3406943521 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8406ce80 con 0x7f0b8409ba00 2026-02-25T17:21:53.901 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.892+0000 7f0b89aa4640 1 --2- 10.20.193.76:0/3406943521 >> v2:10.20.193.76:3300/0 conn(0x7f0b8406c9d0 0x7f0b84134cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-25T17:21:53.901 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.893+0000 7f0b892a3640 1 --2- 10.20.193.76:0/3406943521 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0b8409ba00 0x7f0b8406bf50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0b740099a0 tx=0x7f0b7402ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33e0f0c11a39134d server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:53.901 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.893+0000 7f0b73fff640 1 -- 10.20.193.76:0/3406943521 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7402fac0 con 0x7f0b8409ba00 2026-02-25T17:21:53.901 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.893+0000 7f0b73fff640 1 -- 10.20.193.76:0/3406943521 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7402fc20 con 0x7f0b8409ba00 2026-02-25T17:21:53.902 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.893+0000 7f0b73fff640 1 -- 10.20.193.76:0/3406943521 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74037440 con 0x7f0b8409ba00 2026-02-25T17:21:53.902 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.893+0000 7f0b8b52e640 1 -- 10.20.193.76:0/3406943521 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0b8409ba00 msgr2=0x7f0b8406bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:53.902 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.893+0000 7f0b8b52e640 1 --2- 10.20.193.76:0/3406943521 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0b8409ba00 0x7f0b8406bf50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0b740099a0 tx=0x7f0b7402ee90 comp rx=0 tx=0).stop 2026-02-25T17:21:53.902 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.893+0000 7f0b8b52e640 1 -- 10.20.193.76:0/3406943521 shutdown_connections 2026-02-25T17:21:53.902 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.893+0000 7f0b8b52e640 1 --2- 10.20.193.76:0/3406943521 >> v2:10.20.193.76:3300/0 conn(0x7f0b8406c9d0 0x7f0b84134cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.902 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.893+0000 7f0b8b52e640 1 --2- 10.20.193.76:0/3406943521 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0b8406d780 0x7f0b8406c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.902 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.893+0000 7f0b8b52e640 1 --2- 10.20.193.76:0/3406943521 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0b8409ba00 0x7f0b8406bf50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.902 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.893+0000 7f0b8b52e640 1 -- 10.20.193.76:0/3406943521 >> 10.20.193.76:0/3406943521 conn(0x7f0b840997d0 msgr2=0x7f0b84099be0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:53.902 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.893+0000 7f0b8b52e640 1 -- 10.20.193.76:0/3406943521 shutdown_connections 2026-02-25T17:21:53.902 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.893+0000 7f0b8b52e640 1 -- 10.20.193.76:0/3406943521 wait complete. 2026-02-25T17:21:53.902 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b8b52e640 1 Processor -- start 2026-02-25T17:21:53.902 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b8b52e640 1 -- start start 2026-02-25T17:21:53.902 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b8b52e640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0b8406c9d0 0x7f0b84123730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:53.903 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b8b52e640 1 --2- >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0b8406d780 0x7f0b84123c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:53.903 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b8b52e640 1 --2- >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0b8409ba00 0x7f0b841241b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-25T17:21:53.903 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b8b52e640 1 -- --> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b84125d40 con 0x7f0b8409ba00 2026-02-25T17:21:53.903 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b8b52e640 1 -- --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b841267b0 con 0x7f0b8406c9d0 2026-02-25T17:21:53.903 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b8b52e640 1 -- --> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b84071c00 con 0x7f0b8406d780 2026-02-25T17:21:53.903 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b892a3640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0b8406c9d0 0x7f0b84123730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:53.903 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b892a3640 1 --2- >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0b8406c9d0 0x7f0b84123730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.76:3301/0 says I am v2:10.20.193.76:46480/0 (socket says 10.20.193.76:46480) 2026-02-25T17:21:53.903 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b892a3640 1 -- 10.20.193.76:0/803750115 learned_addr learned my addr 10.20.193.76:0/803750115 (peer_addr_for_me v2:10.20.193.76:0/0) 2026-02-25T17:21:53.903 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b88aa2640 1 --2- 10.20.193.76:0/803750115 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0b8406d780 0x7f0b84123c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:53.903 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b89aa4640 1 --2- 10.20.193.76:0/803750115 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0b8409ba00 0x7f0b841241b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-25T17:21:53.903 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b892a3640 1 -- 10.20.193.76:0/803750115 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0b8406d780 msgr2=0x7f0b84123c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:53.904 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b892a3640 1 --2- 10.20.193.76:0/803750115 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0b8406d780 0x7f0b84123c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.904 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b892a3640 1 -- 10.20.193.76:0/803750115 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0b8409ba00 msgr2=0x7f0b841241b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:53.904 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b892a3640 1 --2- 10.20.193.76:0/803750115 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0b8409ba00 0x7f0b841241b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.904 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b892a3640 1 -- 10.20.193.76:0/803750115 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b80009a70 con 0x7f0b8406c9d0 2026-02-25T17:21:53.904 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b892a3640 1 --2- 10.20.193.76:0/803750115 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0b8406c9d0 0x7f0b84123730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0b7402f3a0 tx=0x7f0b740047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-25T17:21:53.904 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b71ffb640 1 -- 10.20.193.76:0/803750115 <== mon.1 v2:10.20.193.76:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74040630 con 0x7f0b8406c9d0 2026-02-25T17:21:53.904 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b71ffb640 1 -- 10.20.193.76:0/803750115 <== mon.1 v2:10.20.193.76:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b740407b0 con 0x7f0b8406c9d0 2026-02-25T17:21:53.904 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b8b52e640 1 -- 10.20.193.76:0/803750115 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b740095d0 con 0x7f0b8406c9d0 2026-02-25T17:21:53.904 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b71ffb640 1 -- 10.20.193.76:0/803750115 <== mon.1 v2:10.20.193.76:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74040b60 con 0x7f0b8406c9d0 2026-02-25T17:21:53.904 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.894+0000 7f0b8b52e640 1 -- 10.20.193.76:0/803750115 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b841246f0 con 0x7f0b8406c9d0 2026-02-25T17:21:53.904 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.895+0000 7f0b8b52e640 1 -- 10.20.193.76:0/803750115 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b841249a0 con 0x7f0b8406c9d0 2026-02-25T17:21:53.904 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.895+0000 7f0b71ffb640 1 -- 10.20.193.76:0/803750115 <== mon.1 v2:10.20.193.76:3301/0 4 ==== mgrmap(e 10) v1 ==== 62006+0+0 (secure 0 0 0) 0x7f0b74050020 con 0x7f0b8406c9d0 2026-02-25T17:21:53.905 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.895+0000 7f0b71ffb640 1 -- 10.20.193.76:0/803750115 <== mon.1 v2:10.20.193.76:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3025+0+0 (secure 0 0 0) 0x7f0b7408b840 con 0x7f0b8406c9d0 2026-02-25T17:21:53.905 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.897+0000 7f0b71ffb640 1 -- 10.20.193.76:0/803750115 <== mon.1 v2:10.20.193.76:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+148618 (secure 0 0 0) 0x7f0b74065230 con 0x7f0b8406c9d0 2026-02-25T17:21:53.967 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.964+0000 7f0b8b52e640 1 -- 10.20.193.76:0/803750115 --> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f0b8406bf50 con 0x7f0b8406c9d0 2026-02-25T17:21:53.969 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.966+0000 7f0b71ffb640 1 -- 10.20.193.76:0/803750115 <== mon.1 v2:10.20.193.76:3301/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0b74065230 con 0x7f0b8406c9d0 2026-02-25T17:21:53.970 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.966+0000 7f0b71ffb640 1 -- 10.20.193.76:0/803750115 <== mon.1 v2:10.20.193.76:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) v1 ==== 123+0+0 (secure 0 0 0) 0x7f0b7403c020 con 0x7f0b8406c9d0 2026-02-25T17:21:53.971 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.968+0000 7f0b8b52e640 1 -- 10.20.193.76:0/803750115 >> v1:10.20.193.76:6800/1563581135 conn(0x7f0b5404f880 legacy=0x7f0b54051d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:53.971 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.968+0000 7f0b8b52e640 1 -- 10.20.193.76:0/803750115 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0b8406c9d0 msgr2=0x7f0b84123730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-25T17:21:53.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.968+0000 7f0b8b52e640 1 --2- 10.20.193.76:0/803750115 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0b8406c9d0 0x7f0b84123730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0b7402f3a0 tx=0x7f0b740047c0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.968+0000 7f0b8b52e640 1 -- 10.20.193.76:0/803750115 shutdown_connections 2026-02-25T17:21:53.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.968+0000 7f0b8b52e640 1 --2- 10.20.193.76:0/803750115 >> [v2:10.20.193.76:3300/0,v1:10.20.193.76:6789/0] conn(0x7f0b8409ba00 0x7f0b841241b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.968+0000 7f0b8b52e640 1 --2- 10.20.193.76:0/803750115 >> [v2:10.20.193.76:3302/0,v1:10.20.193.76:6791/0] conn(0x7f0b8406d780 0x7f0b84123c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.968+0000 7f0b8b52e640 1 --2- 10.20.193.76:0/803750115 >> [v2:10.20.193.76:3301/0,v1:10.20.193.76:6790/0] conn(0x7f0b8406c9d0 0x7f0b84123730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-25T17:21:53.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.968+0000 7f0b8b52e640 1 -- 10.20.193.76:0/803750115 >> 10.20.193.76:0/803750115 conn(0x7f0b840997d0 msgr2=0x7f0b84097560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-25T17:21:53.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.968+0000 7f0b8b52e640 1 -- 10.20.193.76:0/803750115 shutdown_connections 2026-02-25T17:21:53.972 INFO:teuthology.orchestra.run.trial076.stderr:2026-02-25T17:21:53.968+0000 7f0b8b52e640 1 -- 10.20.193.76:0/803750115 wait complete. 2026-02-25T17:21:53.980 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-25T17:21:53.980 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-25T17:21:53.980 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-25T17:21:53.980 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T17:21:54.021 INFO:tasks.ceph.osd.0:Stopped 2026-02-25T17:21:54.022 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-25T17:21:54.022 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T17:21:54.092 INFO:tasks.ceph.osd.1:Stopped 2026-02-25T17:21:54.092 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-25T17:21:54.093 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T17:21:54.172 INFO:tasks.ceph.osd.2:Stopped 2026-02-25T17:21:54.173 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-25T17:21:54.173 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T17:21:54.250 INFO:tasks.ceph.osd.3:Stopped 2026-02-25T17:21:54.251 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-25T17:21:54.251 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-25T17:21:54.251 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T17:21:54.315 INFO:tasks.ceph.mgr.x:Stopped 2026-02-25T17:21:54.316 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-25T17:21:54.316 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T17:21:54.379 INFO:tasks.ceph.mgr.y:Stopped 2026-02-25T17:21:54.379 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-25T17:21:54.379 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-25T17:21:54.379 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T17:21:54.429 INFO:tasks.ceph.mon.a:Stopped 2026-02-25T17:21:54.429 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-25T17:21:54.430 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T17:21:54.479 INFO:tasks.ceph.mon.b:Stopped 2026-02-25T17:21:54.479 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-25T17:21:54.479 INFO:teuthology.orchestra.run:waiting for 300 2026-02-25T17:21:54.530 INFO:tasks.ceph.mon.c:Stopped 2026-02-25T17:21:54.531 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-25T17:21:54.531 DEBUG:teuthology.orchestra.run.trial076:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v 'is offline because no MDS' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v MGR_MODULE_ERROR | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'pg .* is stuck inactive' | egrep -v 'pg .* is .*degraded' | egrep -v 'pg .* is stuck peering' | egrep -v 'scrub mismatch' | egrep -v ScrubResult | egrep -v 'wrongly marked' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_MSGR2_NOT_ENABLED\)' | egrep -v 'slow request' | head -n 1 2026-02-25T17:21:54.597 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial076.front.sepia.ceph.com 2026-02-25T17:21:54.598 DEBUG:teuthology.orchestra.run.trial076:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-25T17:21:54.670 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial076.front.sepia.ceph.com 2026-02-25T17:21:54.670 DEBUG:teuthology.orchestra.run.trial076:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-25T17:21:54.738 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial076.front.sepia.ceph.com 2026-02-25T17:21:54.738 DEBUG:teuthology.orchestra.run.trial076:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-25T17:21:54.805 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial076.front.sepia.ceph.com 2026-02-25T17:21:54.805 DEBUG:teuthology.orchestra.run.trial076:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-25T17:21:54.881 INFO:tasks.ceph:Archiving mon data... 2026-02-25T17:21:54.882 DEBUG:teuthology.misc:Transferring archived files from trial076:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-25_15:27:50-fs-reef-release-distro-default-trial/70419/data/mon.a.tgz 2026-02-25T17:21:54.882 DEBUG:teuthology.orchestra.run.trial076:> mktemp 2026-02-25T17:21:54.937 INFO:teuthology.orchestra.run.trial076.stdout:/tmp/tmp.JABI1OpC3N 2026-02-25T17:21:54.938 DEBUG:teuthology.orchestra.run.trial076:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.JABI1OpC3N 2026-02-25T17:21:55.038 DEBUG:teuthology.orchestra.run.trial076:> sudo chmod 0666 /tmp/tmp.JABI1OpC3N 2026-02-25T17:21:55.121 DEBUG:teuthology.orchestra.remote:trial076:/tmp/tmp.JABI1OpC3N is 281KB 2026-02-25T17:21:55.219 DEBUG:teuthology.orchestra.run.trial076:> rm -fr /tmp/tmp.JABI1OpC3N 2026-02-25T17:21:55.235 DEBUG:teuthology.misc:Transferring archived files from trial076:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/yuriw-2026-02-25_15:27:50-fs-reef-release-distro-default-trial/70419/data/mon.b.tgz 2026-02-25T17:21:55.235 DEBUG:teuthology.orchestra.run.trial076:> mktemp 2026-02-25T17:21:55.290 INFO:teuthology.orchestra.run.trial076.stdout:/tmp/tmp.P8peV9oALA 2026-02-25T17:21:55.291 DEBUG:teuthology.orchestra.run.trial076:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.P8peV9oALA 2026-02-25T17:21:55.395 DEBUG:teuthology.orchestra.run.trial076:> sudo chmod 0666 /tmp/tmp.P8peV9oALA 2026-02-25T17:21:55.474 DEBUG:teuthology.orchestra.remote:trial076:/tmp/tmp.P8peV9oALA is 319KB 2026-02-25T17:21:55.567 DEBUG:teuthology.orchestra.run.trial076:> rm -fr /tmp/tmp.P8peV9oALA 2026-02-25T17:21:55.584 DEBUG:teuthology.misc:Transferring archived files from trial076:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/yuriw-2026-02-25_15:27:50-fs-reef-release-distro-default-trial/70419/data/mon.c.tgz 2026-02-25T17:21:55.584 DEBUG:teuthology.orchestra.run.trial076:> mktemp 2026-02-25T17:21:55.639 INFO:teuthology.orchestra.run.trial076.stdout:/tmp/tmp.yr52zicu7U 2026-02-25T17:21:55.640 DEBUG:teuthology.orchestra.run.trial076:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.yr52zicu7U 2026-02-25T17:21:55.743 DEBUG:teuthology.orchestra.run.trial076:> sudo chmod 0666 /tmp/tmp.yr52zicu7U 2026-02-25T17:21:55.824 DEBUG:teuthology.orchestra.remote:trial076:/tmp/tmp.yr52zicu7U is 318KB 2026-02-25T17:21:55.918 DEBUG:teuthology.orchestra.run.trial076:> rm -fr /tmp/tmp.yr52zicu7U 2026-02-25T17:21:55.936 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-25T17:21:55.936 DEBUG:teuthology.orchestra.run.trial076:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-25T17:21:55.999 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2026-02-25T17:21:56.000 DEBUG:teuthology.orchestra.run.trial076:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2026-02-25T17:21:56.067 INFO:teuthology.orchestra.run.trial076.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2026-02-25T17:21:56.071 INFO:tasks.ceph:Archiving crash dumps... 2026-02-25T17:21:56.072 DEBUG:teuthology.misc:Transferring archived files from trial076:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-25_15:27:50-fs-reef-release-distro-default-trial/70419/remote/trial076/crash 2026-02-25T17:21:56.073 DEBUG:teuthology.orchestra.run.trial076:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-25T17:21:56.135 INFO:tasks.ceph:Compressing logs... 2026-02-25T17:21:56.142 DEBUG:teuthology.orchestra.run.trial076:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2026-02-25T17:21:56.863 INFO:tasks.ceph:Archiving logs... 2026-02-25T17:21:56.864 DEBUG:teuthology.misc:Transferring archived files from trial076:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-25_15:27:50-fs-reef-release-distro-default-trial/70419/remote/trial076/log 2026-02-25T17:21:56.865 DEBUG:teuthology.orchestra.run.trial076:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-25T17:21:57.046 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-25T17:21:57.090 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-25T17:21:57.090 DEBUG:teuthology.orchestra.run.trial076:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-25T17:21:57.182 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-25T17:21:57.202 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-25T17:21:57.202 DEBUG:teuthology.orchestra.run.trial076:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-25T17:21:57.217 INFO:teuthology.orchestra.run.trial076.stderr:bash: line 1: ntpq: command not found 2026-02-25T17:21:57.238 INFO:teuthology.orchestra.run.trial076.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-25T17:21:57.238 INFO:teuthology.orchestra.run.trial076.stdout:=============================================================================== 2026-02-25T17:21:57.238 INFO:teuthology.orchestra.run.trial076.stdout:^+ ntp.shastacoe.net 2 6 377 51 -1328us[-1328us] +/- 78ms 2026-02-25T17:21:57.238 INFO:teuthology.orchestra.run.trial076.stdout:^+ 172-233-155-39.ip.linode> 4 6 377 51 -3578us[-3844us] +/- 67ms 2026-02-25T17:21:57.238 INFO:teuthology.orchestra.run.trial076.stdout:^+ 44.190.5.123 2 6 377 50 +1891us[+1891us] +/- 34ms 2026-02-25T17:21:57.238 INFO:teuthology.orchestra.run.trial076.stdout:^* lax1.us.ntp.li 2 6 377 51 +259us[-7694ns] +/- 36ms 2026-02-25T17:21:57.238 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-25T17:21:57.258 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-25T17:21:57.259 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-25T17:21:57.272 DEBUG:teuthology.orchestra.run.trial076:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-25T17:21:57.333 DEBUG:teuthology.orchestra.run.trial076:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-25T17:21:57.358 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T17:21:57.359 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-25T17:21:57.381 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-25T17:21:57.404 INFO:teuthology.task.internal:Duration was 755.430317 seconds 2026-02-25T17:21:57.405 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-25T17:21:57.423 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-25T17:21:57.423 DEBUG:teuthology.orchestra.run.trial076:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-25T17:21:57.460 INFO:teuthology.orchestra.run.trial076.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-25T17:21:57.787 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-25T17:21:57.788 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial076.front.sepia.ceph.com 2026-02-25T17:21:57.788 DEBUG:teuthology.orchestra.run.trial076:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-25T17:21:57.846 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-25T17:21:57.846 DEBUG:teuthology.orchestra.run.trial076:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T17:21:57.947 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-25T17:21:57.947 DEBUG:teuthology.orchestra.run.trial076:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-25T17:21:57.971 INFO:teuthology.orchestra.run.trial076.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-25T17:21:57.971 INFO:teuthology.orchestra.run.trial076.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-25T17:21:57.971 INFO:teuthology.orchestra.run.trial076.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-25T17:21:57.971 INFO:teuthology.orchestra.run.trial076.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-25T17:21:57.972 INFO:teuthology.orchestra.run.trial076.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-25T17:21:57.981 INFO:teuthology.orchestra.run.trial076.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-25T17:21:57.983 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-25T17:21:58.002 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-25T17:21:58.003 DEBUG:teuthology.orchestra.run.trial076:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-25T17:21:58.046 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-25T17:21:58.069 DEBUG:teuthology.orchestra.run.trial076:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-25T17:21:58.112 INFO:teuthology.orchestra.run.trial076.stdout:kernel.core_pattern = core 2026-02-25T17:21:58.130 DEBUG:teuthology.orchestra.run.trial076:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-25T17:21:58.185 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-25T17:21:58.186 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-25T17:21:58.223 INFO:teuthology.task.internal:Transferring archived files... 2026-02-25T17:21:58.224 DEBUG:teuthology.misc:Transferring archived files from trial076:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-25_15:27:50-fs-reef-release-distro-default-trial/70419/remote/trial076 2026-02-25T17:21:58.224 DEBUG:teuthology.orchestra.run.trial076:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-25T17:21:58.259 INFO:teuthology.task.internal:Removing archive directory... 2026-02-25T17:21:58.260 DEBUG:teuthology.orchestra.run.trial076:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-25T17:21:58.311 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-25T17:21:58.339 INFO:teuthology.task.internal:Not uploading archives. 2026-02-25T17:21:58.339 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-25T17:21:58.359 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-25T17:21:58.359 DEBUG:teuthology.orchestra.run.trial076:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-25T17:21:58.375 INFO:teuthology.orchestra.run.trial076.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 25 17:21 /home/ubuntu/cephtest 2026-02-25T17:21:58.376 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-25T17:21:58.400 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-25T17:21:58.445 INFO:teuthology.run:Summary data: description: fs/upgrade/nofs/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-from/quincy 1-upgrade}} duration: 755.4303171634674 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-25T17:21:58.445 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-25T17:21:58.553 INFO:teuthology.run:pass