2026-02-18T20:58:11.055 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-18T20:58:11.071 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-18T20:58:11.157 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:34:58-fs-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53280 branch: wip-jcollin-testing-20260217.080557-squid description: fs/upgrade/nofs/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} kernel no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-from/quincy 1-upgrade}} email: jcollin@redhat.com first_in_suite: false flavor: default job_id: '53280' kernel: sha1: distro last_in_suite: false machine_type: trial meta: - desc: 'install ceph/quincy latest ' name: jcollin-2026-02-17_12:34:58-fs-wip-jcollin-testing-20260217.080557-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-jcollin-testing-20260217.080557-squid ceph: cluster-conf: mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - MGR_MODULE_ERROR - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - pg .* is stuck peering - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request sha1: 5c7d9533eb2b3fdb031dd48c8022c4d967a9a910 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 5c7d9533eb2b3fdb031dd48c8022c4d967a9a910 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-jcollin-testing-20260217.080557-squid sha1: 5c7d9533eb2b3fdb031dd48c8022c4d967a9a910 owner: scheduled_jcollin@soko04.front.sepia.ceph.com priority: 200 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 seed: 974 sha1: 5c7d9533eb2b3fdb031dd48c8022c4d967a9a910 sleep_before_teardown: 0 subset: 302/2048 suite: fs suite_branch: wip-jcollin-testing-20260217.080557-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_5c7d9533eb2b3fdb031dd48c8022c4d967a9a910/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 5c7d9533eb2b3fdb031dd48c8022c4d967a9a910 targets: trial068.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH8poxxRcP+hSeBsGno65yJ+iOaLENt9umTxrA0SZKSmU8YFjDxy63vMNmqvEp7uXeisFDWfmPUgY22nEtj8ycM= tasks: - install: branch: quincy exclude_packages: - librados3 - ceph-mgr-dashboard - ceph-mgr-diskprediction-local - ceph-mgr-rook - ceph-mgr-cephadm - cephadm - ceph-volume extra_packages: - librados2 - print: '**** done installing quincy' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client quincy - print: '**** done ceph' - print: '*** upgrading, no cephfs present' - exec: mon.a: - ceph fs dump - install.upgrade: mon.a: null - print: '**** done install.upgrade' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph versions - ceph osd dump -f json-pretty - ceph fs dump - ceph osd require-osd-release squid - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph.healthy: null - print: '**** done ceph.restart' teuthology: fragments_dropped: [] meta: {} postmerge: - "local branch = yaml.kernel.branch\nif branch and not yaml.kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\", yaml.kernel)\n\ \ py_attrgetter(yaml.kernel).pop('branch', nil)\n py_attrgetter(yaml.kernel).pop('deb',\ \ nil)\n py_attrgetter(yaml.kernel).pop('flavor', nil)\n py_attrgetter(yaml.kernel).pop('kdb',\ \ nil)\n py_attrgetter(yaml.kernel).pop('koji', nil)\n py_attrgetter(yaml.kernel).pop('koji_task',\ \ nil)\n py_attrgetter(yaml.kernel).pop('rpm', nil)\n py_attrgetter(yaml.kernel).pop('sha1',\ \ nil)\n py_attrgetter(yaml.kernel).pop('tag', nil)\nend\n" teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_12:34:58 tube: trial user: jcollin verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-18T20:58:11.158 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_5c7d9533eb2b3fdb031dd48c8022c4d967a9a910/qa; will attempt to use it 2026-02-18T20:58:11.158 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_5c7d9533eb2b3fdb031dd48c8022c4d967a9a910/qa/tasks 2026-02-18T20:58:11.158 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-18T20:58:11.159 INFO:teuthology.task.internal:Checking packages... 2026-02-18T20:58:11.160 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '5c7d9533eb2b3fdb031dd48c8022c4d967a9a910' 2026-02-18T20:58:11.160 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-18T20:58:11.160 INFO:teuthology.packaging:ref: None 2026-02-18T20:58:11.160 INFO:teuthology.packaging:tag: None 2026-02-18T20:58:11.160 INFO:teuthology.packaging:branch: wip-jcollin-testing-20260217.080557-squid 2026-02-18T20:58:11.160 INFO:teuthology.packaging:sha1: 5c7d9533eb2b3fdb031dd48c8022c4d967a9a910 2026-02-18T20:58:11.160 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-jcollin-testing-20260217.080557-squid 2026-02-18T20:58:11.277 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-689.g5c7d9533 2026-02-18T20:58:11.278 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-18T20:58:11.290 INFO:teuthology.task.internal:no buildpackages task found 2026-02-18T20:58:11.290 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-18T20:58:11.304 INFO:teuthology.task.internal:Saving configuration 2026-02-18T20:58:11.320 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-18T20:58:11.335 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-18T20:58:11.411 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial068.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:34:58-fs-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53280', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-18 20:54:44.911593', 'locked_by': 'scheduled_jcollin@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH8poxxRcP+hSeBsGno65yJ+iOaLENt9umTxrA0SZKSmU8YFjDxy63vMNmqvEp7uXeisFDWfmPUgY22nEtj8ycM='} 2026-02-18T20:58:11.411 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-18T20:58:11.422 INFO:teuthology.task.internal:roles: ubuntu@trial068.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2026-02-18T20:58:11.422 INFO:teuthology.run_tasks:Running task console_log... 2026-02-18T20:58:11.507 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x728ee8fe8ea0>, signals=[15]) 2026-02-18T20:58:11.507 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-18T20:58:11.521 INFO:teuthology.task.internal:Opening connections... 2026-02-18T20:58:11.521 DEBUG:teuthology.task.internal:connecting to ubuntu@trial068.front.sepia.ceph.com 2026-02-18T20:58:11.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial068.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T20:58:11.583 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-18T20:58:11.594 DEBUG:teuthology.orchestra.run.trial068:> uname -m 2026-02-18T20:58:11.659 INFO:teuthology.orchestra.run.trial068.stdout:x86_64 2026-02-18T20:58:11.659 DEBUG:teuthology.orchestra.run.trial068:> cat /etc/os-release 2026-02-18T20:58:11.715 INFO:teuthology.orchestra.run.trial068.stdout:NAME="CentOS Stream" 2026-02-18T20:58:11.715 INFO:teuthology.orchestra.run.trial068.stdout:VERSION="9" 2026-02-18T20:58:11.715 INFO:teuthology.orchestra.run.trial068.stdout:ID="centos" 2026-02-18T20:58:11.715 INFO:teuthology.orchestra.run.trial068.stdout:ID_LIKE="rhel fedora" 2026-02-18T20:58:11.715 INFO:teuthology.orchestra.run.trial068.stdout:VERSION_ID="9" 2026-02-18T20:58:11.715 INFO:teuthology.orchestra.run.trial068.stdout:PLATFORM_ID="platform:el9" 2026-02-18T20:58:11.715 INFO:teuthology.orchestra.run.trial068.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-18T20:58:11.715 INFO:teuthology.orchestra.run.trial068.stdout:ANSI_COLOR="0;31" 2026-02-18T20:58:11.716 INFO:teuthology.orchestra.run.trial068.stdout:LOGO="fedora-logo-icon" 2026-02-18T20:58:11.716 INFO:teuthology.orchestra.run.trial068.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-18T20:58:11.716 INFO:teuthology.orchestra.run.trial068.stdout:HOME_URL="https://centos.org/" 2026-02-18T20:58:11.716 INFO:teuthology.orchestra.run.trial068.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-18T20:58:11.716 INFO:teuthology.orchestra.run.trial068.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-18T20:58:11.716 INFO:teuthology.orchestra.run.trial068.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-18T20:58:11.717 INFO:teuthology.lock.ops:Updating trial068.front.sepia.ceph.com on lock server 2026-02-18T20:58:11.807 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-18T20:58:11.824 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-18T20:58:11.835 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-18T20:58:11.835 DEBUG:teuthology.orchestra.run.trial068:> test '!' -e /home/ubuntu/cephtest 2026-02-18T20:58:11.850 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-18T20:58:11.861 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-18T20:58:11.861 DEBUG:teuthology.orchestra.run.trial068:> test -z $(ls -A /var/lib/ceph) 2026-02-18T20:58:11.906 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-18T20:58:12.009 INFO:teuthology.run_tasks:Running task kernel... 2026-02-18T20:58:12.033 INFO:teuthology.task.kernel:normalize config orig: {'sha1': 'distro'} 2026-02-18T20:58:12.033 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro'}}, timeout 300 2026-02-18T20:58:12.033 DEBUG:teuthology.orchestra.run.trial068:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-18T20:58:12.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T20:58:12.048 DEBUG:teuthology.orchestra.run.trial068:> uname -r 2026-02-18T20:58:12.104 INFO:teuthology.orchestra.run.trial068.stdout:5.14.0-681.el9.x86_64 2026-02-18T20:58:12.105 INFO:teuthology.task.kernel:Running kernel on trial068: 5.14.0-681.el9.x86_64 2026-02-18T20:58:12.105 DEBUG:teuthology.orchestra.run.trial068:> sudo yum install -y kernel 2026-02-18T20:58:12.799 INFO:teuthology.orchestra.run.trial068.stdout:CentOS Stream 9 - BaseOS 28 MB/s | 8.9 MB 00:00 2026-02-18T20:58:16.651 INFO:teuthology.orchestra.run.trial068.stdout:CentOS Stream 9 - AppStream 8.1 MB/s | 27 MB 00:03 2026-02-18T20:58:19.335 INFO:teuthology.orchestra.run.trial068.stdout:CentOS Stream 9 - CRB 23 MB/s | 7.8 MB 00:00 2026-02-18T20:58:20.137 INFO:teuthology.orchestra.run.trial068.stdout:CentOS Stream 9 - Extras packages 250 kB/s | 20 kB 00:00 2026-02-18T20:58:20.658 INFO:teuthology.orchestra.run.trial068.stdout:Extra Packages for Enterprise Linux 44 MB/s | 20 MB 00:00 2026-02-18T20:58:23.852 INFO:teuthology.orchestra.run.trial068.stdout:lab-extras 2.3 MB/s | 50 kB 00:00 2026-02-18T20:58:24.866 INFO:teuthology.orchestra.run.trial068.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-18T20:58:24.866 INFO:teuthology.orchestra.run.trial068.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-18T20:58:24.885 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T20:58:24.886 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-18T20:58:24.886 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T20:58:24.910 DEBUG:teuthology.orchestra.run.trial068:> echo no | sudo yum reinstall kernel || true 2026-02-18T20:58:25.211 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:02 ago on Wed 18 Feb 2026 08:58:23 PM UTC. 2026-02-18T20:58:25.291 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T20:58:25.292 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T20:58:25.292 INFO:teuthology.orchestra.run.trial068.stdout: Package Architecture Version Repository Size 2026-02-18T20:58:25.292 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T20:58:25.292 INFO:teuthology.orchestra.run.trial068.stdout:Reinstalling: 2026-02-18T20:58:25.292 INFO:teuthology.orchestra.run.trial068.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-18T20:58:25.292 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T20:58:25.292 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-18T20:58:25.292 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T20:58:25.292 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T20:58:25.293 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 803 k 2026-02-18T20:58:25.293 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 0 2026-02-18T20:58:25.293 INFO:teuthology.orchestra.run.trial068.stderr:Operation aborted. 2026-02-18T20:58:25.312 INFO:teuthology.orchestra.run.trial068.stdout:Is this ok [y/N]: 2026-02-18T20:58:25.313 DEBUG:teuthology.orchestra.run.trial068:> sudo yum reinstall -y kernel || true 2026-02-18T20:58:25.615 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:02 ago on Wed 18 Feb 2026 08:58:23 PM UTC. 2026-02-18T20:58:25.696 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T20:58:25.696 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T20:58:25.697 INFO:teuthology.orchestra.run.trial068.stdout: Package Architecture Version Repository Size 2026-02-18T20:58:25.697 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T20:58:25.697 INFO:teuthology.orchestra.run.trial068.stdout:Reinstalling: 2026-02-18T20:58:25.697 INFO:teuthology.orchestra.run.trial068.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-18T20:58:25.697 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T20:58:25.697 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-18T20:58:25.697 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T20:58:25.697 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T20:58:25.697 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 803 k 2026-02-18T20:58:25.697 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 0 2026-02-18T20:58:25.698 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-18T20:58:26.590 INFO:teuthology.orchestra.run.trial068.stdout:kernel-5.14.0-681.el9.x86_64.rpm 1.2 MB/s | 803 kB 00:00 2026-02-18T20:58:26.590 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-18T20:58:26.590 INFO:teuthology.orchestra.run.trial068.stdout:Total 899 kB/s | 803 kB 00:00 2026-02-18T20:58:26.600 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-18T20:58:26.633 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-18T20:58:26.633 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-18T20:58:26.638 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-18T20:58:26.638 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-18T20:58:26.661 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-18T20:58:26.665 INFO:teuthology.orchestra.run.trial068.stdout: Reinstalling : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-18T20:58:26.666 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-18T20:58:26.775 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 2/2 2026-02-18T20:58:26.775 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/2 2026-02-18T20:58:26.832 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 2/2 2026-02-18T20:58:26.832 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T20:58:26.832 INFO:teuthology.orchestra.run.trial068.stdout:Reinstalled: 2026-02-18T20:58:26.832 INFO:teuthology.orchestra.run.trial068.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-18T20:58:26.833 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T20:58:26.833 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T20:58:26.858 DEBUG:teuthology.orchestra.run.trial068:> rpm -q kernel | sort -rV | head -n 1 2026-02-18T20:58:26.882 INFO:teuthology.orchestra.run.trial068.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-18T20:58:26.883 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-18T20:58:26.883 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2026-02-18T20:58:26.883 DEBUG:teuthology.parallel:result is None 2026-02-18T20:58:26.883 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-18T20:58:26.895 INFO:teuthology.task.internal:Creating test directory... 2026-02-18T20:58:26.895 DEBUG:teuthology.orchestra.run.trial068:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-18T20:58:26.940 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-18T20:58:26.951 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-18T20:58:26.968 INFO:teuthology.task.internal:Creating archive directory... 2026-02-18T20:58:26.968 DEBUG:teuthology.orchestra.run.trial068:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-18T20:58:27.002 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-18T20:58:27.014 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-18T20:58:27.015 DEBUG:teuthology.orchestra.run.trial068:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-18T20:58:27.062 INFO:teuthology.orchestra.run.trial068.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T20:58:27.070 INFO:teuthology.orchestra.run.trial068.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-18T20:58:27.072 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-18T20:58:27.084 INFO:teuthology.task.internal:Configuring sudo... 2026-02-18T20:58:27.085 DEBUG:teuthology.orchestra.run.trial068:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-18T20:58:27.136 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-18T20:58:27.150 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-18T20:58:27.151 DEBUG:teuthology.orchestra.run.trial068:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-18T20:58:27.194 DEBUG:teuthology.orchestra.run.trial068:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T20:58:27.352 DEBUG:teuthology.orchestra.run.trial068:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T20:58:27.375 DEBUG:teuthology.orchestra.run.trial068:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T20:58:27.523 DEBUG:teuthology.orchestra.run.trial068:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T20:58:27.546 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T20:58:27.546 DEBUG:teuthology.orchestra.run.trial068:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-18T20:58:27.610 DEBUG:teuthology.orchestra.run.trial068:> sudo service rsyslog restart 2026-02-18T20:58:27.677 INFO:teuthology.orchestra.run.trial068.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T20:58:28.077 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-18T20:58:28.089 INFO:teuthology.task.internal:Starting timer... 2026-02-18T20:58:28.089 INFO:teuthology.run_tasks:Running task pcp... 2026-02-18T20:58:28.109 INFO:teuthology.run_tasks:Running task selinux... 2026-02-18T20:58:28.126 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-18T20:58:28.127 DEBUG:teuthology.orchestra.run.trial068:> sudo service auditd rotate 2026-02-18T20:58:28.155 INFO:teuthology.orchestra.run.trial068.stdout:Rotating logs: 2026-02-18T20:58:28.157 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-18T20:58:28.157 DEBUG:teuthology.orchestra.run.trial068:> /usr/sbin/getenforce 2026-02-18T20:58:28.214 INFO:teuthology.orchestra.run.trial068.stdout:Permissive 2026-02-18T20:58:28.214 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial068.front.sepia.ceph.com': 'permissive'} 2026-02-18T20:58:28.214 DEBUG:teuthology.orchestra.run.trial068:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-18T20:58:28.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T20:58:28.279 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-18T20:58:28.279 DEBUG:teuthology.orchestra.run.trial068:> sudo /usr/sbin/setenforce permissive 2026-02-18T20:58:28.343 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-18T20:58:28.359 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-18T20:58:28.371 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-18T20:58:28.373 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial068.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-18T20:59:34.550 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial068.front.sepia.ceph.com')] 2026-02-18T20:59:34.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial068.front.sepia.ceph.com' 2026-02-18T20:59:34.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial068.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-18T20:59:34.661 DEBUG:teuthology.orchestra.run.trial068:> true 2026-02-18T20:59:34.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial068.front.sepia.ceph.com' 2026-02-18T20:59:34.740 INFO:teuthology.run_tasks:Running task clock... 2026-02-18T20:59:34.749 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-18T20:59:34.749 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-18T20:59:34.749 DEBUG:teuthology.orchestra.run.trial068:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T20:59:34.809 INFO:teuthology.orchestra.run.trial068.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-18T20:59:34.821 INFO:teuthology.orchestra.run.trial068.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-18T20:59:34.842 INFO:teuthology.orchestra.run.trial068.stderr:sudo: ntpd: command not found 2026-02-18T20:59:34.851 INFO:teuthology.orchestra.run.trial068.stdout:506 Cannot talk to daemon 2026-02-18T20:59:34.863 INFO:teuthology.orchestra.run.trial068.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-18T20:59:34.875 INFO:teuthology.orchestra.run.trial068.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-18T20:59:34.924 INFO:teuthology.orchestra.run.trial068.stderr:bash: line 1: ntpq: command not found 2026-02-18T20:59:34.948 INFO:teuthology.orchestra.run.trial068.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T20:59:34.948 INFO:teuthology.orchestra.run.trial068.stdout:=============================================================================== 2026-02-18T20:59:34.948 INFO:teuthology.orchestra.run.trial068.stdout:^? 172-234-37-140.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T20:59:34.948 INFO:teuthology.orchestra.run.trial068.stdout:^? ntpool0.603.newcontinuum> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T20:59:34.948 INFO:teuthology.orchestra.run.trial068.stdout:^? 170-187-147-56.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T20:59:34.948 INFO:teuthology.orchestra.run.trial068.stdout:^? as393746.mci.trtnw.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-18T20:59:34.949 INFO:teuthology.run_tasks:Running task install... 2026-02-18T20:59:34.963 DEBUG:teuthology.task.install:project ceph 2026-02-18T20:59:34.963 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5c7d9533eb2b3fdb031dd48c8022c4d967a9a910'}} 2026-02-18T20:59:34.963 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': '5c7d9533eb2b3fdb031dd48c8022c4d967a9a910'} 2026-02-18T20:59:34.963 INFO:teuthology.task.install:Using flavor: default 2026-02-18T20:59:34.972 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-18T20:59:34.972 INFO:teuthology.task.install:extra packages: ['librados2'] 2026-02-18T20:59:34.972 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5c7d9533eb2b3fdb031dd48c8022c4d967a9a910', 'tag': None, 'wait_for_package': False} 2026-02-18T20:59:34.973 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-18T20:59:34.973 INFO:teuthology.packaging:ref: None 2026-02-18T20:59:34.973 INFO:teuthology.packaging:tag: None 2026-02-18T20:59:34.973 INFO:teuthology.packaging:branch: quincy 2026-02-18T20:59:34.973 INFO:teuthology.packaging:sha1: 5c7d9533eb2b3fdb031dd48c8022c4d967a9a910 2026-02-18T20:59:34.973 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2026-02-18T20:59:35.150 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/quincy/69bf48f20731a4b0d742613f6c6335ccb54dd217/centos/9/flavors/default/ 2026-02-18T20:59:35.150 INFO:teuthology.task.install.rpm:Package version is 17.2.9-0 2026-02-18T20:59:35.251 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/quincy/69bf48f20731a4b0d742613f6c6335ccb54dd217/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/quincy/69bf48f20731a4b0d742613f6c6335ccb54dd217/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/quincy/69bf48f20731a4b0d742613f6c6335ccb54dd217/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-18T20:59:35.251 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T20:59:35.251 DEBUG:teuthology.orchestra.run.trial068:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-18T20:59:35.277 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2026-02-18T20:59:35.277 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-18T20:59:35.277 INFO:teuthology.packaging:ref: None 2026-02-18T20:59:35.277 INFO:teuthology.packaging:tag: None 2026-02-18T20:59:35.277 INFO:teuthology.packaging:branch: quincy 2026-02-18T20:59:35.277 INFO:teuthology.packaging:sha1: 5c7d9533eb2b3fdb031dd48c8022c4d967a9a910 2026-02-18T20:59:35.277 DEBUG:teuthology.orchestra.run.trial068:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-18T20:59:35.341 DEBUG:teuthology.orchestra.run.trial068:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-18T20:59:35.414 DEBUG:teuthology.orchestra.run.trial068:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-18T20:59:35.479 INFO:teuthology.orchestra.run.trial068.stdout:check_obsoletes = 1 2026-02-18T20:59:35.481 DEBUG:teuthology.orchestra.run.trial068:> sudo yum clean all 2026-02-18T20:59:35.639 INFO:teuthology.orchestra.run.trial068.stdout:41 files removed 2026-02-18T20:59:35.654 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-radosgw 2026-02-18T20:59:35.884 INFO:teuthology.orchestra.run.trial068.stdout:ceph packages for x86_64 879 kB/s | 77 kB 00:00 2026-02-18T20:59:35.978 INFO:teuthology.orchestra.run.trial068.stdout:ceph noarch packages 151 kB/s | 11 kB 00:00 2026-02-18T20:59:36.070 INFO:teuthology.orchestra.run.trial068.stdout:ceph source packages 29 kB/s | 2.1 kB 00:00 2026-02-18T20:59:37.634 INFO:teuthology.orchestra.run.trial068.stdout:CentOS Stream 9 - BaseOS 5.8 MB/s | 8.9 MB 00:01 2026-02-18T21:00:04.806 INFO:teuthology.orchestra.run.trial068.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 27 MB 00:26 2026-02-18T21:00:08.799 INFO:teuthology.orchestra.run.trial068.stdout:CentOS Stream 9 - CRB 5.0 MB/s | 7.8 MB 00:01 2026-02-18T21:00:10.065 INFO:teuthology.orchestra.run.trial068.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 20 kB 00:00 2026-02-18T21:00:11.003 INFO:teuthology.orchestra.run.trial068.stdout:Extra Packages for Enterprise Linux 23 MB/s | 20 MB 00:00 2026-02-18T21:00:14.127 INFO:teuthology.orchestra.run.trial068.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-18T21:00:15.316 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:00:15.317 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:15.317 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repository Size 2026-02-18T21:00:15.317 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:15.318 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-18T21:00:15.318 INFO:teuthology.orchestra.run.trial068.stdout: ceph-radosgw x86_64 2:17.2.9-0.el9 ceph 14 M 2026-02-18T21:00:15.318 INFO:teuthology.orchestra.run.trial068.stdout:Upgrading: 2026-02-18T21:00:15.318 INFO:teuthology.orchestra.run.trial068.stdout: librados2 x86_64 2:17.2.9-0.el9 ceph 3.1 M 2026-02-18T21:00:15.318 INFO:teuthology.orchestra.run.trial068.stdout: librbd1 x86_64 2:17.2.9-0.el9 ceph 2.9 M 2026-02-18T21:00:15.318 INFO:teuthology.orchestra.run.trial068.stdout:Installing dependencies: 2026-02-18T21:00:15.318 INFO:teuthology.orchestra.run.trial068.stdout: ceph-base x86_64 2:17.2.9-0.el9 ceph 5.0 M 2026-02-18T21:00:15.318 INFO:teuthology.orchestra.run.trial068.stdout: ceph-common x86_64 2:17.2.9-0.el9 ceph 22 M 2026-02-18T21:00:15.318 INFO:teuthology.orchestra.run.trial068.stdout: ceph-selinux x86_64 2:17.2.9-0.el9 ceph 25 k 2026-02-18T21:00:15.318 INFO:teuthology.orchestra.run.trial068.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-18T21:00:15.318 INFO:teuthology.orchestra.run.trial068.stdout: libcephfs2 x86_64 2:17.2.9-0.el9 ceph 637 k 2026-02-18T21:00:15.319 INFO:teuthology.orchestra.run.trial068.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-18T21:00:15.319 INFO:teuthology.orchestra.run.trial068.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-18T21:00:15.319 INFO:teuthology.orchestra.run.trial068.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-18T21:00:15.319 INFO:teuthology.orchestra.run.trial068.stdout: libradosstriper1 x86_64 2:17.2.9-0.el9 ceph 457 k 2026-02-18T21:00:15.319 INFO:teuthology.orchestra.run.trial068.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-18T21:00:15.319 INFO:teuthology.orchestra.run.trial068.stdout: librgw2 x86_64 2:17.2.9-0.el9 ceph 4.9 M 2026-02-18T21:00:15.319 INFO:teuthology.orchestra.run.trial068.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-18T21:00:15.319 INFO:teuthology.orchestra.run.trial068.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-18T21:00:15.319 INFO:teuthology.orchestra.run.trial068.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-18T21:00:15.319 INFO:teuthology.orchestra.run.trial068.stdout: python3-ceph-argparse x86_64 2:17.2.9-0.el9 ceph 45 k 2026-02-18T21:00:15.319 INFO:teuthology.orchestra.run.trial068.stdout: python3-ceph-common x86_64 2:17.2.9-0.el9 ceph 120 k 2026-02-18T21:00:15.319 INFO:teuthology.orchestra.run.trial068.stdout: python3-cephfs x86_64 2:17.2.9-0.el9 ceph 157 k 2026-02-18T21:00:15.319 INFO:teuthology.orchestra.run.trial068.stdout: python3-rados x86_64 2:17.2.9-0.el9 ceph 320 k 2026-02-18T21:00:15.320 INFO:teuthology.orchestra.run.trial068.stdout: python3-rbd x86_64 2:17.2.9-0.el9 ceph 296 k 2026-02-18T21:00:15.320 INFO:teuthology.orchestra.run.trial068.stdout: python3-rgw x86_64 2:17.2.9-0.el9 ceph 100 k 2026-02-18T21:00:15.320 INFO:teuthology.orchestra.run.trial068.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-18T21:00:15.320 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:15.320 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-18T21:00:15.320 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:15.320 INFO:teuthology.orchestra.run.trial068.stdout:Install 22 Packages 2026-02-18T21:00:15.320 INFO:teuthology.orchestra.run.trial068.stdout:Upgrade 2 Packages 2026-02-18T21:00:15.320 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:15.321 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 58 M 2026-02-18T21:00:15.321 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-18T21:00:15.695 INFO:teuthology.orchestra.run.trial068.stdout:(1/24): ceph-base-17.2.9-0.el9.x86_64.rpm 44 MB/s | 5.0 MB 00:00 2026-02-18T21:00:15.705 INFO:teuthology.orchestra.run.trial068.stdout:(2/24): ceph-selinux-17.2.9-0.el9.x86_64.rpm 2.3 MB/s | 25 kB 00:00 2026-02-18T21:00:15.717 INFO:teuthology.orchestra.run.trial068.stdout:(3/24): libcephfs2-17.2.9-0.el9.x86_64.rpm 52 MB/s | 637 kB 00:00 2026-02-18T21:00:15.728 INFO:teuthology.orchestra.run.trial068.stdout:(4/24): libradosstriper1-17.2.9-0.el9.x86_64.rp 42 MB/s | 457 kB 00:00 2026-02-18T21:00:15.775 INFO:teuthology.orchestra.run.trial068.stdout:(5/24): ceph-radosgw-17.2.9-0.el9.x86_64.rpm 75 MB/s | 14 MB 00:00 2026-02-18T21:00:15.787 INFO:teuthology.orchestra.run.trial068.stdout:(6/24): python3-ceph-argparse-17.2.9-0.el9.x86_ 3.8 MB/s | 45 kB 00:00 2026-02-18T21:00:15.797 INFO:teuthology.orchestra.run.trial068.stdout:(7/24): python3-ceph-common-17.2.9-0.el9.x86_64 12 MB/s | 120 kB 00:00 2026-02-18T21:00:15.807 INFO:teuthology.orchestra.run.trial068.stdout:(8/24): librgw2-17.2.9-0.el9.x86_64.rpm 62 MB/s | 4.9 MB 00:00 2026-02-18T21:00:15.808 INFO:teuthology.orchestra.run.trial068.stdout:(9/24): python3-cephfs-17.2.9-0.el9.x86_64.rpm 13 MB/s | 157 kB 00:00 2026-02-18T21:00:15.818 INFO:teuthology.orchestra.run.trial068.stdout:(10/24): python3-rados-17.2.9-0.el9.x86_64.rpm 29 MB/s | 320 kB 00:00 2026-02-18T21:00:15.819 INFO:teuthology.orchestra.run.trial068.stdout:(11/24): python3-rbd-17.2.9-0.el9.x86_64.rpm 26 MB/s | 296 kB 00:00 2026-02-18T21:00:15.828 INFO:teuthology.orchestra.run.trial068.stdout:(12/24): python3-rgw-17.2.9-0.el9.x86_64.rpm 10 MB/s | 100 kB 00:00 2026-02-18T21:00:15.830 INFO:teuthology.orchestra.run.trial068.stdout:(13/24): mailcap-2.1.49-5.el9.noarch.rpm 3.1 MB/s | 33 kB 00:00 2026-02-18T21:00:15.866 INFO:teuthology.orchestra.run.trial068.stdout:(14/24): ceph-common-17.2.9-0.el9.x86_64.rpm 79 MB/s | 22 MB 00:00 2026-02-18T21:00:16.368 INFO:teuthology.orchestra.run.trial068.stdout:(15/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 84 kB/s | 45 kB 00:00 2026-02-18T21:00:16.517 INFO:teuthology.orchestra.run.trial068.stdout:(16/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 232 kB/s | 160 kB 00:00 2026-02-18T21:00:16.688 INFO:teuthology.orchestra.run.trial068.stdout:(17/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.8 MB/s | 308 kB 00:00 2026-02-18T21:00:16.709 INFO:teuthology.orchestra.run.trial068.stdout:(18/24): liboath-2.6.12-1.el9.x86_64.rpm 2.2 MB/s | 49 kB 00:00 2026-02-18T21:00:16.732 INFO:teuthology.orchestra.run.trial068.stdout:(19/24): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2026-02-18T21:00:16.805 INFO:teuthology.orchestra.run.trial068.stdout:(20/24): thrift-0.15.0-4.el9.x86_64.rpm 22 MB/s | 1.6 MB 00:00 2026-02-18T21:00:16.861 INFO:teuthology.orchestra.run.trial068.stdout:(21/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 593 kB/s | 292 kB 00:00 2026-02-18T21:00:16.913 INFO:teuthology.orchestra.run.trial068.stdout:(22/24): librados2-17.2.9-0.el9.x86_64.rpm 28 MB/s | 3.1 MB 00:00 2026-02-18T21:00:16.919 INFO:teuthology.orchestra.run.trial068.stdout:(23/24): librbd1-17.2.9-0.el9.x86_64.rpm 51 MB/s | 2.9 MB 00:00 2026-02-18T21:00:17.156 INFO:teuthology.orchestra.run.trial068.stdout:(24/24): librdkafka-1.6.1-102.el9.x86_64.rpm 513 kB/s | 662 kB 00:01 2026-02-18T21:00:17.162 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-18T21:00:17.162 INFO:teuthology.orchestra.run.trial068.stdout:Total 32 MB/s | 58 MB 00:01 2026-02-18T21:00:17.203 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-18T21:00:17.219 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-18T21:00:17.219 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-18T21:00:17.453 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-18T21:00:17.453 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-18T21:00:17.715 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-18T21:00:17.851 INFO:teuthology.orchestra.run.trial068.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2026-02-18T21:00:17.854 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : librados2-2:17.2.9-0.el9.x86_64 2/26 2026-02-18T21:00:17.884 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librados2-2:17.2.9-0.el9.x86_64 2/26 2026-02-18T21:00:17.911 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-rados-2:17.2.9-0.el9.x86_64 3/26 2026-02-18T21:00:17.912 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libcephfs2-2:17.2.9-0.el9.x86_64 4/26 2026-02-18T21:00:17.938 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: libcephfs2-2:17.2.9-0.el9.x86_64 4/26 2026-02-18T21:00:17.947 INFO:teuthology.orchestra.run.trial068.stdout: Installing : thrift-0.15.0-4.el9.x86_64 5/26 2026-02-18T21:00:17.950 INFO:teuthology.orchestra.run.trial068.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2026-02-18T21:00:18.156 INFO:teuthology.orchestra.run.trial068.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2026-02-18T21:00:18.157 INFO:teuthology.orchestra.run.trial068.stdout: Installing : librgw2-2:17.2.9-0.el9.x86_64 8/26 2026-02-18T21:00:18.169 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librgw2-2:17.2.9-0.el9.x86_64 8/26 2026-02-18T21:00:18.174 INFO:teuthology.orchestra.run.trial068.stdout: Installing : liboath-2.6.12-1.el9.x86_64 9/26 2026-02-18T21:00:18.182 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-ceph-argparse-2:17.2.9-0.el9.x86_64 10/26 2026-02-18T21:00:18.188 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-cephfs-2:17.2.9-0.el9.x86_64 11/26 2026-02-18T21:00:18.209 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-rgw-2:17.2.9-0.el9.x86_64 12/26 2026-02-18T21:00:18.209 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libradosstriper1-2:17.2.9-0.el9.x86_64 13/26 2026-02-18T21:00:18.221 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: libradosstriper1-2:17.2.9-0.el9.x86_64 13/26 2026-02-18T21:00:18.229 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2026-02-18T21:00:18.234 INFO:teuthology.orchestra.run.trial068.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2026-02-18T21:00:18.366 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 16/26 2026-02-18T21:00:18.367 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : librbd1-2:17.2.9-0.el9.x86_64 17/26 2026-02-18T21:00:18.391 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librbd1-2:17.2.9-0.el9.x86_64 17/26 2026-02-18T21:00:18.394 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-rbd-2:17.2.9-0.el9.x86_64 18/26 2026-02-18T21:00:18.416 INFO:teuthology.orchestra.run.trial068.stdout: Installing : mailcap-2.1.49-5.el9.noarch 19/26 2026-02-18T21:00:18.417 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-ceph-common-2:17.2.9-0.el9.x86_64 20/26 2026-02-18T21:00:19.417 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-common-2:17.2.9-0.el9.x86_64 21/26 2026-02-18T21:00:19.420 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-common-2:17.2.9-0.el9.x86_64 21/26 2026-02-18T21:00:19.680 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-common-2:17.2.9-0.el9.x86_64 21/26 2026-02-18T21:00:19.683 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-base-2:17.2.9-0.el9.x86_64 22/26 2026-02-18T21:00:19.722 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-base-2:17.2.9-0.el9.x86_64 22/26 2026-02-18T21:00:19.722 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-18T21:00:19.723 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-18T21:00:19.723 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:19.726 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-selinux-2:17.2.9-0.el9.x86_64 23/26 2026-02-18T21:00:24.205 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-selinux-2:17.2.9-0.el9.x86_64 23/26 2026-02-18T21:00:24.205 INFO:teuthology.orchestra.run.trial068.stdout:skipping the directory /sys 2026-02-18T21:00:24.205 INFO:teuthology.orchestra.run.trial068.stdout:skipping the directory /proc 2026-02-18T21:00:24.205 INFO:teuthology.orchestra.run.trial068.stdout:skipping the directory /mnt 2026-02-18T21:00:24.205 INFO:teuthology.orchestra.run.trial068.stdout:skipping the directory /var/tmp 2026-02-18T21:00:24.205 INFO:teuthology.orchestra.run.trial068.stdout:skipping the directory /home 2026-02-18T21:00:24.206 INFO:teuthology.orchestra.run.trial068.stdout:skipping the directory /root 2026-02-18T21:00:24.206 INFO:teuthology.orchestra.run.trial068.stdout:skipping the directory /tmp 2026-02-18T21:00:24.206 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:24.813 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-radosgw-2:17.2.9-0.el9.x86_64 24/26 2026-02-18T21:00:24.844 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-radosgw-2:17.2.9-0.el9.x86_64 24/26 2026-02-18T21:00:24.844 INFO:teuthology.orchestra.run.trial068.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T21:00:24.844 INFO:teuthology.orchestra.run.trial068.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-18T21:00:24.844 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T21:00:24.844 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-18T21:00:24.844 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:24.845 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2026-02-18T21:00:24.858 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2026-02-18T21:00:24.858 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2026-02-18T21:00:25.178 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2026-02-18T21:00:25.179 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-base-2:17.2.9-0.el9.x86_64 1/26 2026-02-18T21:00:25.179 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-common-2:17.2.9-0.el9.x86_64 2/26 2026-02-18T21:00:25.179 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-radosgw-2:17.2.9-0.el9.x86_64 3/26 2026-02-18T21:00:25.179 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-selinux-2:17.2.9-0.el9.x86_64 4/26 2026-02-18T21:00:25.179 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libcephfs2-2:17.2.9-0.el9.x86_64 5/26 2026-02-18T21:00:25.179 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libradosstriper1-2:17.2.9-0.el9.x86_64 6/26 2026-02-18T21:00:25.179 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librgw2-2:17.2.9-0.el9.x86_64 7/26 2026-02-18T21:00:25.179 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-ceph-argparse-2:17.2.9-0.el9.x86_64 8/26 2026-02-18T21:00:25.180 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-ceph-common-2:17.2.9-0.el9.x86_64 9/26 2026-02-18T21:00:25.180 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-cephfs-2:17.2.9-0.el9.x86_64 10/26 2026-02-18T21:00:25.180 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-rados-2:17.2.9-0.el9.x86_64 11/26 2026-02-18T21:00:25.180 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-rbd-2:17.2.9-0.el9.x86_64 12/26 2026-02-18T21:00:25.180 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-rgw-2:17.2.9-0.el9.x86_64 13/26 2026-02-18T21:00:25.180 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/26 2026-02-18T21:00:25.180 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/26 2026-02-18T21:00:25.180 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/26 2026-02-18T21:00:25.180 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/26 2026-02-18T21:00:25.180 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/26 2026-02-18T21:00:25.180 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2026-02-18T21:00:25.181 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 20/26 2026-02-18T21:00:25.181 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2026-02-18T21:00:25.181 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 22/26 2026-02-18T21:00:25.181 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librados2-2:17.2.9-0.el9.x86_64 23/26 2026-02-18T21:00:25.181 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2026-02-18T21:00:25.181 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librbd1-2:17.2.9-0.el9.x86_64 25/26 2026-02-18T21:00:25.236 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2026-02-18T21:00:25.236 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:25.236 INFO:teuthology.orchestra.run.trial068.stdout:Upgraded: 2026-02-18T21:00:25.236 INFO:teuthology.orchestra.run.trial068.stdout: librados2-2:17.2.9-0.el9.x86_64 librbd1-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:25.236 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-18T21:00:25.237 INFO:teuthology.orchestra.run.trial068.stdout: ceph-base-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:25.237 INFO:teuthology.orchestra.run.trial068.stdout: ceph-common-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:25.237 INFO:teuthology.orchestra.run.trial068.stdout: ceph-radosgw-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:25.237 INFO:teuthology.orchestra.run.trial068.stdout: ceph-selinux-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:25.237 INFO:teuthology.orchestra.run.trial068.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-18T21:00:25.237 INFO:teuthology.orchestra.run.trial068.stdout: libcephfs2-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:25.237 INFO:teuthology.orchestra.run.trial068.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-18T21:00:25.237 INFO:teuthology.orchestra.run.trial068.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-18T21:00:25.237 INFO:teuthology.orchestra.run.trial068.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-18T21:00:25.237 INFO:teuthology.orchestra.run.trial068.stdout: libradosstriper1-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:25.237 INFO:teuthology.orchestra.run.trial068.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-18T21:00:25.238 INFO:teuthology.orchestra.run.trial068.stdout: librgw2-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:25.238 INFO:teuthology.orchestra.run.trial068.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-18T21:00:25.238 INFO:teuthology.orchestra.run.trial068.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-18T21:00:25.238 INFO:teuthology.orchestra.run.trial068.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-18T21:00:25.238 INFO:teuthology.orchestra.run.trial068.stdout: python3-ceph-argparse-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:25.238 INFO:teuthology.orchestra.run.trial068.stdout: python3-ceph-common-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:25.238 INFO:teuthology.orchestra.run.trial068.stdout: python3-cephfs-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:25.238 INFO:teuthology.orchestra.run.trial068.stdout: python3-rados-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:25.238 INFO:teuthology.orchestra.run.trial068.stdout: python3-rbd-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:25.238 INFO:teuthology.orchestra.run.trial068.stdout: python3-rgw-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:25.238 INFO:teuthology.orchestra.run.trial068.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-18T21:00:25.238 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:25.239 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:00:25.276 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-test 2026-02-18T21:00:25.584 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:11 ago on Wed 18 Feb 2026 09:00:14 PM UTC. 2026-02-18T21:00:25.664 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:00:25.665 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:25.666 INFO:teuthology.orchestra.run.trial068.stdout: Package Architecture Version Repository Size 2026-02-18T21:00:25.666 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:25.666 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-18T21:00:25.666 INFO:teuthology.orchestra.run.trial068.stdout: ceph-test x86_64 2:17.2.9-0.el9 ceph 48 M 2026-02-18T21:00:25.666 INFO:teuthology.orchestra.run.trial068.stdout:Installing dependencies: 2026-02-18T21:00:25.666 INFO:teuthology.orchestra.run.trial068.stdout: libcephsqlite x86_64 2:17.2.9-0.el9 ceph 163 k 2026-02-18T21:00:25.666 INFO:teuthology.orchestra.run.trial068.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-18T21:00:25.666 INFO:teuthology.orchestra.run.trial068.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-18T21:00:25.667 INFO:teuthology.orchestra.run.trial068.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-18T21:00:25.667 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:25.667 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-18T21:00:25.667 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:25.667 INFO:teuthology.orchestra.run.trial068.stdout:Install 5 Packages 2026-02-18T21:00:25.667 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:25.667 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 49 M 2026-02-18T21:00:25.667 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 194 M 2026-02-18T21:00:25.667 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-18T21:00:25.816 INFO:teuthology.orchestra.run.trial068.stdout:(1/5): libcephsqlite-17.2.9-0.el9.x86_64.rpm 2.6 MB/s | 163 kB 00:00 2026-02-18T21:00:25.908 INFO:teuthology.orchestra.run.trial068.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 1.5 MB/s | 233 kB 00:00 2026-02-18T21:00:25.937 INFO:teuthology.orchestra.run.trial068.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.2 MB/s | 64 kB 00:00 2026-02-18T21:00:25.977 INFO:teuthology.orchestra.run.trial068.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 1.8 MB/s | 303 kB 00:00 2026-02-18T21:00:26.181 INFO:teuthology.orchestra.run.trial068.stdout:(5/5): ceph-test-17.2.9-0.el9.x86_64.rpm 113 MB/s | 48 MB 00:00 2026-02-18T21:00:26.182 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-18T21:00:26.182 INFO:teuthology.orchestra.run.trial068.stdout:Total 94 MB/s | 49 MB 00:00 2026-02-18T21:00:26.207 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-18T21:00:26.215 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-18T21:00:26.216 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-18T21:00:26.391 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-18T21:00:26.392 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-18T21:00:26.595 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-18T21:00:26.600 INFO:teuthology.orchestra.run.trial068.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-18T21:00:26.604 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-18T21:00:26.613 INFO:teuthology.orchestra.run.trial068.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-18T21:00:26.613 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libcephsqlite-2:17.2.9-0.el9.x86_64 4/5 2026-02-18T21:00:28.834 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: libcephsqlite-2:17.2.9-0.el9.x86_64 4/5 2026-02-18T21:00:28.852 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-test-2:17.2.9-0.el9.x86_64 5/5 2026-02-18T21:00:29.077 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-test-2:17.2.9-0.el9.x86_64 5/5 2026-02-18T21:00:29.077 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-test-2:17.2.9-0.el9.x86_64 1/5 2026-02-18T21:00:29.078 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libcephsqlite-2:17.2.9-0.el9.x86_64 2/5 2026-02-18T21:00:29.078 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-18T21:00:29.078 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-18T21:00:29.129 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-18T21:00:29.130 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:29.130 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-18T21:00:29.130 INFO:teuthology.orchestra.run.trial068.stdout: ceph-test-2:17.2.9-0.el9.x86_64 libcephsqlite-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:29.130 INFO:teuthology.orchestra.run.trial068.stdout: libxslt-1.1.34-12.el9.x86_64 socat-1.7.4.1-8.el9.x86_64 2026-02-18T21:00:29.130 INFO:teuthology.orchestra.run.trial068.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-18T21:00:29.130 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:29.130 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:00:29.162 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph 2026-02-18T21:00:29.466 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:15 ago on Wed 18 Feb 2026 09:00:14 PM UTC. 2026-02-18T21:00:29.549 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:00:29.550 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:29.551 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repository Size 2026-02-18T21:00:29.551 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:29.551 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-18T21:00:29.551 INFO:teuthology.orchestra.run.trial068.stdout: ceph x86_64 2:17.2.9-0.el9 ceph 6.4 k 2026-02-18T21:00:29.551 INFO:teuthology.orchestra.run.trial068.stdout:Installing dependencies: 2026-02-18T21:00:29.551 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mds x86_64 2:17.2.9-0.el9 ceph 2.1 M 2026-02-18T21:00:29.551 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr x86_64 2:17.2.9-0.el9 ceph 1.4 M 2026-02-18T21:00:29.551 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-modules-core noarch 2:17.2.9-0.el9 ceph-noarch 240 k 2026-02-18T21:00:29.551 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mon x86_64 2:17.2.9-0.el9 ceph 3.9 M 2026-02-18T21:00:29.552 INFO:teuthology.orchestra.run.trial068.stdout: ceph-osd x86_64 2:17.2.9-0.el9 ceph 15 M 2026-02-18T21:00:29.552 INFO:teuthology.orchestra.run.trial068.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-18T21:00:29.552 INFO:teuthology.orchestra.run.trial068.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-18T21:00:29.552 INFO:teuthology.orchestra.run.trial068.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-18T21:00:29.552 INFO:teuthology.orchestra.run.trial068.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-18T21:00:29.552 INFO:teuthology.orchestra.run.trial068.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-18T21:00:29.552 INFO:teuthology.orchestra.run.trial068.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-18T21:00:29.552 INFO:teuthology.orchestra.run.trial068.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-18T21:00:29.552 INFO:teuthology.orchestra.run.trial068.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-18T21:00:29.552 INFO:teuthology.orchestra.run.trial068.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-18T21:00:29.552 INFO:teuthology.orchestra.run.trial068.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-18T21:00:29.552 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-18T21:00:29.553 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-18T21:00:29.553 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-18T21:00:29.553 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-18T21:00:29.553 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-18T21:00:29.553 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-18T21:00:29.553 INFO:teuthology.orchestra.run.trial068.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-18T21:00:29.553 INFO:teuthology.orchestra.run.trial068.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-18T21:00:29.553 INFO:teuthology.orchestra.run.trial068.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-18T21:00:29.553 INFO:teuthology.orchestra.run.trial068.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-18T21:00:29.553 INFO:teuthology.orchestra.run.trial068.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-18T21:00:29.553 INFO:teuthology.orchestra.run.trial068.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-18T21:00:29.553 INFO:teuthology.orchestra.run.trial068.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-18T21:00:29.553 INFO:teuthology.orchestra.run.trial068.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-18T21:00:29.554 INFO:teuthology.orchestra.run.trial068.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-18T21:00:29.554 INFO:teuthology.orchestra.run.trial068.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-18T21:00:29.554 INFO:teuthology.orchestra.run.trial068.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-18T21:00:29.554 INFO:teuthology.orchestra.run.trial068.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-18T21:00:29.554 INFO:teuthology.orchestra.run.trial068.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-18T21:00:29.554 INFO:teuthology.orchestra.run.trial068.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-18T21:00:29.554 INFO:teuthology.orchestra.run.trial068.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-18T21:00:29.554 INFO:teuthology.orchestra.run.trial068.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-18T21:00:29.554 INFO:teuthology.orchestra.run.trial068.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-18T21:00:29.554 INFO:teuthology.orchestra.run.trial068.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-18T21:00:29.554 INFO:teuthology.orchestra.run.trial068.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-18T21:00:29.554 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:29.555 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-18T21:00:29.555 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:29.555 INFO:teuthology.orchestra.run.trial068.stdout:Install 41 Packages 2026-02-18T21:00:29.555 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:29.555 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 28 M 2026-02-18T21:00:29.556 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 99 M 2026-02-18T21:00:29.556 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-18T21:00:30.238 INFO:teuthology.orchestra.run.trial068.stdout:(1/41): ceph-17.2.9-0.el9.x86_64.rpm 173 kB/s | 6.4 kB 00:00 2026-02-18T21:00:30.289 INFO:teuthology.orchestra.run.trial068.stdout:(2/41): ceph-mgr-17.2.9-0.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2026-02-18T21:00:30.304 INFO:teuthology.orchestra.run.trial068.stdout:(3/41): ceph-mds-17.2.9-0.el9.x86_64.rpm 20 MB/s | 2.1 MB 00:00 2026-02-18T21:00:30.316 INFO:teuthology.orchestra.run.trial068.stdout:(4/41): ceph-mon-17.2.9-0.el9.x86_64.rpm 50 MB/s | 3.9 MB 00:00 2026-02-18T21:00:30.317 INFO:teuthology.orchestra.run.trial068.stdout:(5/41): ceph-mgr-modules-core-17.2.9-0.el9.noar 18 MB/s | 240 kB 00:00 2026-02-18T21:00:30.386 INFO:teuthology.orchestra.run.trial068.stdout:(6/41): ceph-osd-17.2.9-0.el9.x86_64.rpm 159 MB/s | 15 MB 00:00 2026-02-18T21:00:30.871 INFO:teuthology.orchestra.run.trial068.stdout:(7/41): ledmon-libs-1.1.0-3.el9.x86_64.rpm 73 kB/s | 40 kB 00:00 2026-02-18T21:00:30.954 INFO:teuthology.orchestra.run.trial068.stdout:(8/41): libconfig-1.7.2-9.el9.x86_64.rpm 113 kB/s | 72 kB 00:00 2026-02-18T21:00:31.191 INFO:teuthology.orchestra.run.trial068.stdout:(9/41): python3-ply-3.11-14.el9.noarch.rpm 449 kB/s | 106 kB 00:00 2026-02-18T21:00:31.249 INFO:teuthology.orchestra.run.trial068.stdout:(10/41): python3-cffi-1.14.5-5.el9.x86_64.rpm 293 kB/s | 253 kB 00:00 2026-02-18T21:00:31.506 INFO:teuthology.orchestra.run.trial068.stdout:(11/41): python3-pycparser-2.20-6.el9.noarch.rp 429 kB/s | 135 kB 00:00 2026-02-18T21:00:31.564 INFO:teuthology.orchestra.run.trial068.stdout:(12/41): python3-pyparsing-2.4.7-9.el9.noarch.r 478 kB/s | 150 kB 00:00 2026-02-18T21:00:31.743 INFO:teuthology.orchestra.run.trial068.stdout:(13/41): python3-requests-2.25.1-10.el9.noarch. 533 kB/s | 126 kB 00:00 2026-02-18T21:00:31.957 INFO:teuthology.orchestra.run.trial068.stdout:(14/41): python3-urllib3-1.26.5-7.el9.noarch.rp 555 kB/s | 218 kB 00:00 2026-02-18T21:00:32.533 INFO:teuthology.orchestra.run.trial068.stdout:(15/41): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 312 kB/s | 246 kB 00:00 2026-02-18T21:00:32.687 INFO:teuthology.orchestra.run.trial068.stdout:(16/41): python3-libstoragemgmt-1.10.1-1.el9.x8 242 kB/s | 177 kB 00:00 2026-02-18T21:00:33.258 INFO:teuthology.orchestra.run.trial068.stdout:(17/41): python3-markupsafe-1.1.1-12.el9.x86_64 61 kB/s | 35 kB 00:00 2026-02-18T21:00:33.262 INFO:teuthology.orchestra.run.trial068.stdout:(18/41): python3-mako-1.1.4-6.el9.noarch.rpm 236 kB/s | 172 kB 00:00 2026-02-18T21:00:33.366 INFO:teuthology.orchestra.run.trial068.stdout:(19/41): python3-cryptography-36.0.1-5.el9.x86_ 511 kB/s | 1.2 MB 00:02 2026-02-18T21:00:33.430 INFO:teuthology.orchestra.run.trial068.stdout:(20/41): python3-autocommand-2.2.2-8.el9.noarch 465 kB/s | 29 kB 00:00 2026-02-18T21:00:33.468 INFO:teuthology.orchestra.run.trial068.stdout:(21/41): python3-backports-tarfile-1.2.0-1.el9. 1.5 MB/s | 60 kB 00:00 2026-02-18T21:00:33.498 INFO:teuthology.orchestra.run.trial068.stdout:(22/41): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.4 MB/s | 43 kB 00:00 2026-02-18T21:00:33.543 INFO:teuthology.orchestra.run.trial068.stdout:(23/41): python3-cheroot-10.0.1-4.el9.noarch.rp 3.8 MB/s | 173 kB 00:00 2026-02-18T21:00:33.589 INFO:teuthology.orchestra.run.trial068.stdout:(24/41): python3-cherrypy-18.6.1-2.el9.noarch.r 7.5 MB/s | 358 kB 00:00 2026-02-18T21:00:33.630 INFO:teuthology.orchestra.run.trial068.stdout:(25/41): python3-jaraco-8.2.1-3.el9.noarch.rpm 267 kB/s | 11 kB 00:00 2026-02-18T21:00:33.659 INFO:teuthology.orchestra.run.trial068.stdout:(26/41): python3-jaraco-classes-3.2.1-5.el9.noa 600 kB/s | 18 kB 00:00 2026-02-18T21:00:33.698 INFO:teuthology.orchestra.run.trial068.stdout:(27/41): python3-jaraco-collections-3.0.0-8.el9 593 kB/s | 23 kB 00:00 2026-02-18T21:00:33.727 INFO:teuthology.orchestra.run.trial068.stdout:(28/41): python3-jaraco-context-6.0.1-3.el9.noa 693 kB/s | 20 kB 00:00 2026-02-18T21:00:33.759 INFO:teuthology.orchestra.run.trial068.stdout:(29/41): python3-jaraco-functools-3.5.0-2.el9.n 602 kB/s | 19 kB 00:00 2026-02-18T21:00:33.793 INFO:teuthology.orchestra.run.trial068.stdout:(30/41): python3-jaraco-text-4.0.0-2.el9.noarch 785 kB/s | 26 kB 00:00 2026-02-18T21:00:33.827 INFO:teuthology.orchestra.run.trial068.stdout:(31/41): python3-logutils-0.3.5-21.el9.noarch.r 1.3 MB/s | 46 kB 00:00 2026-02-18T21:00:33.837 INFO:teuthology.orchestra.run.trial068.stdout:(32/41): python3-toml-0.10.2-6.el9.noarch.rpm 72 kB/s | 42 kB 00:00 2026-02-18T21:00:33.851 INFO:teuthology.orchestra.run.trial068.stdout:(33/41): python3-more-itertools-8.12.0-2.el9.no 3.2 MB/s | 79 kB 00:00 2026-02-18T21:00:33.876 INFO:teuthology.orchestra.run.trial068.stdout:(34/41): python3-portend-3.1.0-2.el9.noarch.rpm 652 kB/s | 16 kB 00:00 2026-02-18T21:00:33.898 INFO:teuthology.orchestra.run.trial068.stdout:(35/41): python3-packaging-20.9-5.el9.noarch.rp 120 kB/s | 77 kB 00:00 2026-02-18T21:00:33.905 INFO:teuthology.orchestra.run.trial068.stdout:(36/41): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.0 MB/s | 90 kB 00:00 2026-02-18T21:00:33.936 INFO:teuthology.orchestra.run.trial068.stdout:(37/41): python3-webob-1.8.8-2.el9.noarch.rpm 7.3 MB/s | 230 kB 00:00 2026-02-18T21:00:33.945 INFO:teuthology.orchestra.run.trial068.stdout:(38/41): python3-tempora-5.0.0-2.el9.noarch.rpm 758 kB/s | 36 kB 00:00 2026-02-18T21:00:33.946 INFO:teuthology.orchestra.run.trial068.stdout:(39/41): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2026-02-18T21:00:33.980 INFO:teuthology.orchestra.run.trial068.stdout:(40/41): python3-werkzeug-2.0.3-3.el9.1.noarch. 9.6 MB/s | 427 kB 00:00 2026-02-18T21:00:33.987 INFO:teuthology.orchestra.run.trial068.stdout:(41/41): python3-zc-lockfile-2.0-10.el9.noarch. 481 kB/s | 20 kB 00:00 2026-02-18T21:00:33.989 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-18T21:00:33.990 INFO:teuthology.orchestra.run.trial068.stdout:Total 6.3 MB/s | 28 MB 00:04 2026-02-18T21:00:34.119 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-18T21:00:34.136 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-18T21:00:34.136 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-18T21:00:34.274 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-18T21:00:34.274 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-18T21:00:34.465 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-18T21:00:34.467 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/41 2026-02-18T21:00:34.468 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/41 2026-02-18T21:00:34.473 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 3/41 2026-02-18T21:00:34.478 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 4/41 2026-02-18T21:00:34.509 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 5/41 2026-02-18T21:00:34.530 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 6/41 2026-02-18T21:00:34.539 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 7/41 2026-02-18T21:00:34.546 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 8/41 2026-02-18T21:00:34.549 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 9/41 2026-02-18T21:00:34.555 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 10/41 2026-02-18T21:00:34.561 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 11/41 2026-02-18T21:00:34.564 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 12/41 2026-02-18T21:00:34.570 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 13/41 2026-02-18T21:00:34.573 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 14/41 2026-02-18T21:00:34.580 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 15/41 2026-02-18T21:00:34.584 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/41 2026-02-18T21:00:34.589 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/41 2026-02-18T21:00:34.613 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/41 2026-02-18T21:00:34.667 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/41 2026-02-18T21:00:34.691 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/41 2026-02-18T21:00:34.706 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 21/41 2026-02-18T21:00:34.712 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 22/41 2026-02-18T21:00:34.721 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 23/41 2026-02-18T21:00:34.728 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-packaging-20.9-5.el9.noarch 24/41 2026-02-18T21:00:34.742 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-ply-3.11-14.el9.noarch 25/41 2026-02-18T21:00:34.757 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 26/41 2026-02-18T21:00:34.832 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 27/41 2026-02-18T21:00:34.841 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 28/41 2026-02-18T21:00:34.864 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/41 2026-02-18T21:00:34.893 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 30/41 2026-02-18T21:00:34.901 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 31/41 2026-02-18T21:00:34.945 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 32/41 2026-02-18T21:00:35.008 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-mgr-modules-core-2:17.2.9-0.el9.noarch 33/41 2026-02-18T21:00:35.009 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-mgr-2:17.2.9-0.el9.x86_64 34/41 2026-02-18T21:00:35.034 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mgr-2:17.2.9-0.el9.x86_64 34/41 2026-02-18T21:00:35.034 INFO:teuthology.orchestra.run.trial068.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T21:00:35.034 INFO:teuthology.orchestra.run.trial068.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-18T21:00:35.034 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T21:00:35.034 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-18T21:00:35.035 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:35.039 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 35/41 2026-02-18T21:00:35.058 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 36/41 2026-02-18T21:00:35.059 INFO:teuthology.orchestra.run.trial068.stdout:Creating group 'libstoragemgmt' with GID 992. 2026-02-18T21:00:35.059 INFO:teuthology.orchestra.run.trial068.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 992 and GID 992. 2026-02-18T21:00:35.059 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:35.067 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 36/41 2026-02-18T21:00:35.090 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 36/41 2026-02-18T21:00:35.090 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-18T21:00:35.090 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:35.738 INFO:teuthology.orchestra.run.trial068.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 37/41 2026-02-18T21:00:35.740 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-osd-2:17.2.9-0.el9.x86_64 38/41 2026-02-18T21:00:35.764 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-osd-2:17.2.9-0.el9.x86_64 38/41 2026-02-18T21:00:35.764 INFO:teuthology.orchestra.run.trial068.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T21:00:35.764 INFO:teuthology.orchestra.run.trial068.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-18T21:00:35.764 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T21:00:35.764 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-18T21:00:35.765 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:35.933 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-mon-2:17.2.9-0.el9.x86_64 39/41 2026-02-18T21:00:35.954 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mon-2:17.2.9-0.el9.x86_64 39/41 2026-02-18T21:00:35.955 INFO:teuthology.orchestra.run.trial068.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T21:00:35.955 INFO:teuthology.orchestra.run.trial068.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-18T21:00:35.955 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T21:00:35.955 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-18T21:00:35.955 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:36.042 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-mds-2:17.2.9-0.el9.x86_64 40/41 2026-02-18T21:00:36.062 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mds-2:17.2.9-0.el9.x86_64 40/41 2026-02-18T21:00:36.062 INFO:teuthology.orchestra.run.trial068.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T21:00:36.062 INFO:teuthology.orchestra.run.trial068.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-18T21:00:36.063 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T21:00:36.063 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-18T21:00:36.063 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:36.079 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-2:17.2.9-0.el9.x86_64 41/41 2026-02-18T21:00:36.411 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-2:17.2.9-0.el9.x86_64 41/41 2026-02-18T21:00:36.411 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-2:17.2.9-0.el9.x86_64 1/41 2026-02-18T21:00:36.412 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mds-2:17.2.9-0.el9.x86_64 2/41 2026-02-18T21:00:36.412 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mgr-2:17.2.9-0.el9.x86_64 3/41 2026-02-18T21:00:36.412 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mon-2:17.2.9-0.el9.x86_64 4/41 2026-02-18T21:00:36.412 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-osd-2:17.2.9-0.el9.x86_64 5/41 2026-02-18T21:00:36.412 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mgr-modules-core-2:17.2.9-0.el9.noarch 6/41 2026-02-18T21:00:36.412 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/41 2026-02-18T21:00:36.412 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/41 2026-02-18T21:00:36.412 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/41 2026-02-18T21:00:36.412 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/41 2026-02-18T21:00:36.413 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/41 2026-02-18T21:00:36.413 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/41 2026-02-18T21:00:36.413 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/41 2026-02-18T21:00:36.413 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/41 2026-02-18T21:00:36.413 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/41 2026-02-18T21:00:36.413 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 16/41 2026-02-18T21:00:36.413 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 17/41 2026-02-18T21:00:36.413 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 18/41 2026-02-18T21:00:36.413 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 19/41 2026-02-18T21:00:36.413 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 20/41 2026-02-18T21:00:36.413 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 21/41 2026-02-18T21:00:36.413 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 22/41 2026-02-18T21:00:36.414 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 23/41 2026-02-18T21:00:36.414 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 24/41 2026-02-18T21:00:36.414 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 25/41 2026-02-18T21:00:36.414 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 26/41 2026-02-18T21:00:36.414 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 27/41 2026-02-18T21:00:36.414 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 28/41 2026-02-18T21:00:36.414 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 29/41 2026-02-18T21:00:36.414 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 30/41 2026-02-18T21:00:36.414 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 31/41 2026-02-18T21:00:36.414 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 32/41 2026-02-18T21:00:36.414 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 33/41 2026-02-18T21:00:36.415 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 34/41 2026-02-18T21:00:36.416 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 35/41 2026-02-18T21:00:36.416 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 36/41 2026-02-18T21:00:36.416 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 37/41 2026-02-18T21:00:36.416 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 38/41 2026-02-18T21:00:36.416 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 39/41 2026-02-18T21:00:36.417 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 40/41 2026-02-18T21:00:36.469 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 41/41 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: ceph-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mds-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-modules-core-2:17.2.9-0.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mon-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: ceph-osd-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-ply-3.11-14.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-18T21:00:36.470 INFO:teuthology.orchestra.run.trial068.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-18T21:00:36.471 INFO:teuthology.orchestra.run.trial068.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-18T21:00:36.471 INFO:teuthology.orchestra.run.trial068.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-18T21:00:36.471 INFO:teuthology.orchestra.run.trial068.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-18T21:00:36.471 INFO:teuthology.orchestra.run.trial068.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-18T21:00:36.471 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:36.471 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:00:36.507 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-base 2026-02-18T21:00:36.819 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:22 ago on Wed 18 Feb 2026 09:00:14 PM UTC. 2026-02-18T21:00:36.884 INFO:teuthology.orchestra.run.trial068.stdout:Package ceph-base-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-18T21:00:36.900 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:00:36.901 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-18T21:00:36.901 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:00:36.923 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-immutable-object-cache 2026-02-18T21:00:37.226 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:23 ago on Wed 18 Feb 2026 09:00:14 PM UTC. 2026-02-18T21:00:37.308 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:00:37.308 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:37.308 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repo Size 2026-02-18T21:00:37.309 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:37.309 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-18T21:00:37.309 INFO:teuthology.orchestra.run.trial068.stdout: ceph-immutable-object-cache x86_64 2:17.2.9-0.el9 ceph 137 k 2026-02-18T21:00:37.309 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:37.309 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-18T21:00:37.309 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:37.309 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-18T21:00:37.309 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:37.309 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 137 k 2026-02-18T21:00:37.309 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 379 k 2026-02-18T21:00:37.309 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-18T21:00:37.372 INFO:teuthology.orchestra.run.trial068.stdout:ceph-immutable-object-cache-17.2.9-0.el9.x86_64 2.1 MB/s | 137 kB 00:00 2026-02-18T21:00:37.373 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-18T21:00:37.373 INFO:teuthology.orchestra.run.trial068.stdout:Total 2.1 MB/s | 137 kB 00:00 2026-02-18T21:00:37.373 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-18T21:00:37.377 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-18T21:00:37.377 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-18T21:00:37.402 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-18T21:00:37.403 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-18T21:00:37.450 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-18T21:00:37.452 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:37.474 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:37.474 INFO:teuthology.orchestra.run.trial068.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T21:00:37.474 INFO:teuthology.orchestra.run.trial068.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-18T21:00:37.474 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:37.740 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:37.740 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:37.740 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-18T21:00:37.740 INFO:teuthology.orchestra.run.trial068.stdout: ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:37.740 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:37.740 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:00:37.767 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-mgr 2026-02-18T21:00:38.074 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:24 ago on Wed 18 Feb 2026 09:00:14 PM UTC. 2026-02-18T21:00:38.139 INFO:teuthology.orchestra.run.trial068.stdout:Package ceph-mgr-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-18T21:00:38.155 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:00:38.156 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-18T21:00:38.156 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:00:38.178 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install ceph-fuse 2026-02-18T21:00:38.487 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:24 ago on Wed 18 Feb 2026 09:00:14 PM UTC. 2026-02-18T21:00:38.569 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:00:38.569 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:38.569 INFO:teuthology.orchestra.run.trial068.stdout: Package Architecture Version Repository Size 2026-02-18T21:00:38.569 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:38.569 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-18T21:00:38.570 INFO:teuthology.orchestra.run.trial068.stdout: ceph-fuse x86_64 2:17.2.9-0.el9 ceph 813 k 2026-02-18T21:00:38.570 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:38.570 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-18T21:00:38.570 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:38.570 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-18T21:00:38.570 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:38.570 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 813 k 2026-02-18T21:00:38.570 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 2.4 M 2026-02-18T21:00:38.570 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-18T21:00:38.652 INFO:teuthology.orchestra.run.trial068.stdout:ceph-fuse-17.2.9-0.el9.x86_64.rpm 9.7 MB/s | 813 kB 00:00 2026-02-18T21:00:38.652 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-18T21:00:38.653 INFO:teuthology.orchestra.run.trial068.stdout:Total 9.6 MB/s | 813 kB 00:00 2026-02-18T21:00:38.653 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-18T21:00:38.656 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-18T21:00:38.656 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-18T21:00:38.684 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-18T21:00:38.684 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-18T21:00:38.765 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-18T21:00:38.780 INFO:teuthology.orchestra.run.trial068.stdout: Installing : ceph-fuse-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:38.992 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-fuse-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:39.046 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-fuse-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:39.046 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:39.046 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-18T21:00:39.046 INFO:teuthology.orchestra.run.trial068.stdout: ceph-fuse-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:39.046 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:39.046 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:00:39.074 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install librados-devel 2026-02-18T21:00:39.379 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:25 ago on Wed 18 Feb 2026 09:00:14 PM UTC. 2026-02-18T21:00:39.462 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:00:39.462 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:39.462 INFO:teuthology.orchestra.run.trial068.stdout: Package Architecture Version Repository Size 2026-02-18T21:00:39.463 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:39.463 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-18T21:00:39.463 INFO:teuthology.orchestra.run.trial068.stdout: librados-devel x86_64 2:17.2.9-0.el9 ceph 126 k 2026-02-18T21:00:39.463 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:39.463 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-18T21:00:39.463 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:39.463 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-18T21:00:39.463 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:39.463 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 126 k 2026-02-18T21:00:39.463 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 448 k 2026-02-18T21:00:39.463 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-18T21:00:39.522 INFO:teuthology.orchestra.run.trial068.stdout:librados-devel-17.2.9-0.el9.x86_64.rpm 2.1 MB/s | 126 kB 00:00 2026-02-18T21:00:39.523 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-18T21:00:39.523 INFO:teuthology.orchestra.run.trial068.stdout:Total 2.0 MB/s | 126 kB 00:00 2026-02-18T21:00:39.523 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-18T21:00:39.525 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-18T21:00:39.526 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-18T21:00:39.551 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-18T21:00:39.551 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-18T21:00:39.599 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-18T21:00:39.614 INFO:teuthology.orchestra.run.trial068.stdout: Installing : librados-devel-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:39.689 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librados-devel-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:39.743 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librados-devel-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:39.743 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:39.743 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-18T21:00:39.743 INFO:teuthology.orchestra.run.trial068.stdout: librados-devel-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:39.743 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:39.744 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:00:39.770 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install libcephfs2 2026-02-18T21:00:40.076 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:26 ago on Wed 18 Feb 2026 09:00:14 PM UTC. 2026-02-18T21:00:40.140 INFO:teuthology.orchestra.run.trial068.stdout:Package libcephfs2-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-18T21:00:40.157 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:00:40.158 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-18T21:00:40.158 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:00:40.179 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install libcephfs-devel 2026-02-18T21:00:40.486 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:26 ago on Wed 18 Feb 2026 09:00:14 PM UTC. 2026-02-18T21:00:40.568 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:00:40.568 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:40.569 INFO:teuthology.orchestra.run.trial068.stdout: Package Architecture Version Repository Size 2026-02-18T21:00:40.569 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:40.569 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-18T21:00:40.569 INFO:teuthology.orchestra.run.trial068.stdout: libcephfs-devel x86_64 2:17.2.9-0.el9 ceph 25 k 2026-02-18T21:00:40.569 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:40.569 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-18T21:00:40.569 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:40.569 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-18T21:00:40.569 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:40.570 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 25 k 2026-02-18T21:00:40.570 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 110 k 2026-02-18T21:00:40.570 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-18T21:00:40.614 INFO:teuthology.orchestra.run.trial068.stdout:libcephfs-devel-17.2.9-0.el9.x86_64.rpm 549 kB/s | 25 kB 00:00 2026-02-18T21:00:40.615 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-18T21:00:40.615 INFO:teuthology.orchestra.run.trial068.stdout:Total 539 kB/s | 25 kB 00:00 2026-02-18T21:00:40.615 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-18T21:00:40.616 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-18T21:00:40.616 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-18T21:00:40.617 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-18T21:00:40.617 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-18T21:00:40.636 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-18T21:00:40.650 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libcephfs-devel-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:40.701 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: libcephfs-devel-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:40.754 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libcephfs-devel-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:40.755 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:40.755 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-18T21:00:40.755 INFO:teuthology.orchestra.run.trial068.stdout: libcephfs-devel-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:40.755 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:40.755 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:00:40.781 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install librados2 2026-02-18T21:00:41.094 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:27 ago on Wed 18 Feb 2026 09:00:14 PM UTC. 2026-02-18T21:00:41.158 INFO:teuthology.orchestra.run.trial068.stdout:Package librados2-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-18T21:00:41.175 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:00:41.176 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-18T21:00:41.176 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:00:41.197 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install librbd1 2026-02-18T21:00:41.504 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:27 ago on Wed 18 Feb 2026 09:00:14 PM UTC. 2026-02-18T21:00:41.568 INFO:teuthology.orchestra.run.trial068.stdout:Package librbd1-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-18T21:00:41.585 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:00:41.586 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-18T21:00:41.586 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:00:41.607 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install python3-rados 2026-02-18T21:00:41.913 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:27 ago on Wed 18 Feb 2026 09:00:14 PM UTC. 2026-02-18T21:00:41.978 INFO:teuthology.orchestra.run.trial068.stdout:Package python3-rados-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-18T21:00:41.994 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:00:41.995 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-18T21:00:41.995 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:00:42.016 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install python3-rgw 2026-02-18T21:00:42.315 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:28 ago on Wed 18 Feb 2026 09:00:14 PM UTC. 2026-02-18T21:00:42.379 INFO:teuthology.orchestra.run.trial068.stdout:Package python3-rgw-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-18T21:00:42.396 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:00:42.397 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-18T21:00:42.397 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:00:42.417 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install python3-cephfs 2026-02-18T21:00:42.721 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:28 ago on Wed 18 Feb 2026 09:00:14 PM UTC. 2026-02-18T21:00:42.786 INFO:teuthology.orchestra.run.trial068.stdout:Package python3-cephfs-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-18T21:00:42.803 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:00:42.804 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-18T21:00:42.804 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:00:42.825 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install python3-rbd 2026-02-18T21:00:43.130 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:29 ago on Wed 18 Feb 2026 09:00:14 PM UTC. 2026-02-18T21:00:43.194 INFO:teuthology.orchestra.run.trial068.stdout:Package python3-rbd-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-18T21:00:43.211 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:00:43.212 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-18T21:00:43.212 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:00:43.233 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install rbd-fuse 2026-02-18T21:00:43.541 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:29 ago on Wed 18 Feb 2026 09:00:14 PM UTC. 2026-02-18T21:00:43.622 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:00:43.623 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:43.623 INFO:teuthology.orchestra.run.trial068.stdout: Package Architecture Version Repository Size 2026-02-18T21:00:43.623 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:43.623 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-18T21:00:43.623 INFO:teuthology.orchestra.run.trial068.stdout: rbd-fuse x86_64 2:17.2.9-0.el9 ceph 82 k 2026-02-18T21:00:43.623 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:43.623 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-18T21:00:43.623 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:43.623 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-18T21:00:43.624 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:43.624 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 82 k 2026-02-18T21:00:43.624 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 222 k 2026-02-18T21:00:43.624 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-18T21:00:43.675 INFO:teuthology.orchestra.run.trial068.stdout:rbd-fuse-17.2.9-0.el9.x86_64.rpm 1.5 MB/s | 82 kB 00:00 2026-02-18T21:00:43.676 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-18T21:00:43.676 INFO:teuthology.orchestra.run.trial068.stdout:Total 1.5 MB/s | 82 kB 00:00 2026-02-18T21:00:43.677 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-18T21:00:43.679 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-18T21:00:43.680 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-18T21:00:43.705 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-18T21:00:43.705 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-18T21:00:43.749 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-18T21:00:43.764 INFO:teuthology.orchestra.run.trial068.stdout: Installing : rbd-fuse-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:43.838 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: rbd-fuse-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:43.892 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : rbd-fuse-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:43.892 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:43.892 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-18T21:00:43.892 INFO:teuthology.orchestra.run.trial068.stdout: rbd-fuse-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:43.892 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:43.893 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:00:43.920 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install rbd-mirror 2026-02-18T21:00:44.226 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:30 ago on Wed 18 Feb 2026 09:00:14 PM UTC. 2026-02-18T21:00:44.309 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:00:44.309 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:44.309 INFO:teuthology.orchestra.run.trial068.stdout: Package Architecture Version Repository Size 2026-02-18T21:00:44.309 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:44.310 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-18T21:00:44.310 INFO:teuthology.orchestra.run.trial068.stdout: rbd-mirror x86_64 2:17.2.9-0.el9 ceph 2.9 M 2026-02-18T21:00:44.310 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:44.310 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-18T21:00:44.310 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:44.311 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-18T21:00:44.311 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:44.311 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 2.9 M 2026-02-18T21:00:44.311 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 12 M 2026-02-18T21:00:44.311 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-18T21:00:44.412 INFO:teuthology.orchestra.run.trial068.stdout:rbd-mirror-17.2.9-0.el9.x86_64.rpm 29 MB/s | 2.9 MB 00:00 2026-02-18T21:00:44.412 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-18T21:00:44.413 INFO:teuthology.orchestra.run.trial068.stdout:Total 28 MB/s | 2.9 MB 00:00 2026-02-18T21:00:44.413 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-18T21:00:44.416 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-18T21:00:44.416 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-18T21:00:44.450 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-18T21:00:44.450 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-18T21:00:44.627 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-18T21:00:44.628 INFO:teuthology.orchestra.run.trial068.stdout: Installing : rbd-mirror-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:44.652 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: rbd-mirror-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:44.652 INFO:teuthology.orchestra.run.trial068.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-18T21:00:44.652 INFO:teuthology.orchestra.run.trial068.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-18T21:00:44.652 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T21:00:44.652 INFO:teuthology.orchestra.run.trial068.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-18T21:00:44.652 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:44.941 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : rbd-mirror-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:44.941 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:44.941 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-18T21:00:44.941 INFO:teuthology.orchestra.run.trial068.stdout: rbd-mirror-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:44.941 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:44.941 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:00:44.970 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install rbd-nbd 2026-02-18T21:00:45.274 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:31 ago on Wed 18 Feb 2026 09:00:14 PM UTC. 2026-02-18T21:00:45.355 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:00:45.355 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:45.355 INFO:teuthology.orchestra.run.trial068.stdout: Package Architecture Version Repository Size 2026-02-18T21:00:45.355 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:45.355 INFO:teuthology.orchestra.run.trial068.stdout:Installing: 2026-02-18T21:00:45.355 INFO:teuthology.orchestra.run.trial068.stdout: rbd-nbd x86_64 2:17.2.9-0.el9 ceph 165 k 2026-02-18T21:00:45.355 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:45.356 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-18T21:00:45.356 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:00:45.356 INFO:teuthology.orchestra.run.trial068.stdout:Install 1 Package 2026-02-18T21:00:45.356 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:45.356 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 165 k 2026-02-18T21:00:45.356 INFO:teuthology.orchestra.run.trial068.stdout:Installed size: 477 k 2026-02-18T21:00:45.356 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-18T21:00:45.417 INFO:teuthology.orchestra.run.trial068.stdout:rbd-nbd-17.2.9-0.el9.x86_64.rpm 2.6 MB/s | 165 kB 00:00 2026-02-18T21:00:45.417 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-18T21:00:45.417 INFO:teuthology.orchestra.run.trial068.stdout:Total 2.6 MB/s | 165 kB 00:00 2026-02-18T21:00:45.417 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-18T21:00:45.420 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-18T21:00:45.421 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-18T21:00:45.446 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-18T21:00:45.446 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-18T21:00:45.495 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-18T21:00:45.511 INFO:teuthology.orchestra.run.trial068.stdout: Installing : rbd-nbd-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:45.591 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: rbd-nbd-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:45.645 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : rbd-nbd-2:17.2.9-0.el9.x86_64 1/1 2026-02-18T21:00:45.645 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:45.645 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-18T21:00:45.646 INFO:teuthology.orchestra.run.trial068.stdout: rbd-nbd-2:17.2.9-0.el9.x86_64 2026-02-18T21:00:45.646 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:45.646 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:00:45.672 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y install librados2 2026-02-18T21:00:45.988 INFO:teuthology.orchestra.run.trial068.stdout:Last metadata expiration check: 0:00:31 ago on Wed 18 Feb 2026 09:00:14 PM UTC. 2026-02-18T21:00:46.052 INFO:teuthology.orchestra.run.trial068.stdout:Package librados2-2:17.2.9-0.el9.x86_64 is already installed. 2026-02-18T21:00:46.070 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:00:46.070 INFO:teuthology.orchestra.run.trial068.stdout:Nothing to do. 2026-02-18T21:00:46.070 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:00:46.094 DEBUG:teuthology.parallel:result is None 2026-02-18T21:00:46.094 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-18T21:00:46.095 INFO:teuthology.packaging:ref: None 2026-02-18T21:00:46.095 INFO:teuthology.packaging:tag: None 2026-02-18T21:00:46.095 INFO:teuthology.packaging:branch: quincy 2026-02-18T21:00:46.095 INFO:teuthology.packaging:sha1: 5c7d9533eb2b3fdb031dd48c8022c4d967a9a910 2026-02-18T21:00:46.095 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2026-02-18T21:00:46.273 DEBUG:teuthology.orchestra.run.trial068:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-18T21:00:46.294 INFO:teuthology.orchestra.run.trial068.stdout:17.2.9-0.el9 2026-02-18T21:00:46.294 INFO:teuthology.packaging:The installed version of ceph is 17.2.9-0.el9 2026-02-18T21:00:46.295 INFO:teuthology.task.install:The correct ceph version 17.2.9-0 is installed. 2026-02-18T21:00:46.296 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-18T21:00:46.297 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:00:46.297 DEBUG:teuthology.orchestra.run.trial068:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-18T21:00:46.359 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-18T21:00:46.359 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:00:46.360 DEBUG:teuthology.orchestra.run.trial068:> sudo dd of=/usr/bin/daemon-helper 2026-02-18T21:00:46.422 DEBUG:teuthology.orchestra.run.trial068:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-18T21:00:46.485 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-18T21:00:46.485 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:00:46.486 DEBUG:teuthology.orchestra.run.trial068:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-18T21:00:46.549 DEBUG:teuthology.orchestra.run.trial068:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-18T21:00:46.614 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-18T21:00:46.614 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:00:46.614 DEBUG:teuthology.orchestra.run.trial068:> sudo dd of=/usr/bin/stdin-killer 2026-02-18T21:00:46.677 DEBUG:teuthology.orchestra.run.trial068:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-18T21:00:46.741 INFO:teuthology.run_tasks:Running task print... 2026-02-18T21:00:46.756 INFO:teuthology.task.print:**** done installing quincy 2026-02-18T21:00:46.756 INFO:teuthology.run_tasks:Running task ceph... 2026-02-18T21:00:46.863 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-18T21:00:46.863 DEBUG:teuthology.orchestra.run.trial068:> sudo chmod 777 /var/log/ceph 2026-02-18T21:00:46.888 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-18T21:00:46.888 DEBUG:teuthology.orchestra.run.trial068:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-18T21:00:46.951 INFO:tasks.ceph:Creating extra log directories... 2026-02-18T21:00:46.951 DEBUG:teuthology.orchestra.run.trial068:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-18T21:00:47.027 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-18T21:00:47.028 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'MGR_MODULE_ERROR', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'pg .* is stuck peering', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-18T21:00:47.028 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:34:58-fs-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53280', 'branch': 'wip-jcollin-testing-20260217.080557-squid', 'description': 'fs/upgrade/nofs/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} kernel no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-from/quincy 1-upgrade}}', 'email': 'jcollin@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '53280', 'kernel': {'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'meta': [{'desc': 'install ceph/quincy latest\n'}], 'name': 'jcollin-2026-02-17_12:34:58-fs-wip-jcollin-testing-20260217.080557-squid-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-jcollin-testing-20260217.080557-squid'}, 'ceph': {'cluster-conf': {'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'MGR_MODULE_ERROR', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'pg .* is stuck peering', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'sha1': '5c7d9533eb2b3fdb031dd48c8022c4d967a9a910'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '5c7d9533eb2b3fdb031dd48c8022c4d967a9a910'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-jcollin-testing-20260217.080557-squid', 'sha1': '5c7d9533eb2b3fdb031dd48c8022c4d967a9a910'}}, 'owner': 'scheduled_jcollin@soko04.front.sepia.ceph.com', 'priority': 200, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 974, 'sha1': '5c7d9533eb2b3fdb031dd48c8022c4d967a9a910', 'sleep_before_teardown': 0, 'subset': '302/2048', 'suite': 'fs', 'suite_branch': 'wip-jcollin-testing-20260217.080557-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_5c7d9533eb2b3fdb031dd48c8022c4d967a9a910/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '5c7d9533eb2b3fdb031dd48c8022c4d967a9a910', 'targets': {'trial068.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH8poxxRcP+hSeBsGno65yJ+iOaLENt9umTxrA0SZKSmU8YFjDxy63vMNmqvEp7uXeisFDWfmPUgY22nEtj8ycM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'quincy', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': '5c7d9533eb2b3fdb031dd48c8022c4d967a9a910'}}, {'print': '**** done installing quincy'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'MGR_MODULE_ERROR', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'pg .* is stuck peering', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'cluster-conf': {'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}}, 'flavor': 'default', 'fs': 'xfs', 'sha1': '5c7d9533eb2b3fdb031dd48c8022c4d967a9a910', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client quincy']}}, {'print': '**** done ceph'}, {'print': '*** upgrading, no cephfs present'}, {'exec': {'mon.a': ['ceph fs dump']}}, {'install.upgrade': {'mon.a': None}}, {'print': '**** done install.upgrade'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph versions', 'ceph osd dump -f json-pretty', 'ceph fs dump', 'ceph osd require-osd-release squid', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local branch = yaml.kernel.branch\nif branch and not yaml.kernel.branch:find "-all$" then\n log.debug("removing default kernel specification: %s", yaml.kernel)\n py_attrgetter(yaml.kernel).pop(\'branch\', nil)\n py_attrgetter(yaml.kernel).pop(\'deb\', nil)\n py_attrgetter(yaml.kernel).pop(\'flavor\', nil)\n py_attrgetter(yaml.kernel).pop(\'kdb\', nil)\n py_attrgetter(yaml.kernel).pop(\'koji\', nil)\n py_attrgetter(yaml.kernel).pop(\'koji_task\', nil)\n py_attrgetter(yaml.kernel).pop(\'rpm\', nil)\n py_attrgetter(yaml.kernel).pop(\'sha1\', nil)\n py_attrgetter(yaml.kernel).pop(\'tag\', nil)\nend\n']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-17_12:34:58', 'tube': 'trial', 'user': 'jcollin', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682'} 2026-02-18T21:00:47.029 DEBUG:teuthology.orchestra.run.trial068:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-18T21:00:47.071 DEBUG:teuthology.orchestra.run.trial068:> sudo install -d -m0777 -- /var/run/ceph 2026-02-18T21:00:47.137 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:00:47.137 DEBUG:teuthology.orchestra.run.trial068:> dd if=/scratch_devs of=/dev/stdout 2026-02-18T21:00:47.194 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-18T21:00:47.194 DEBUG:teuthology.orchestra.run.trial068:> stat /dev/vg_nvme/lv_1 2026-02-18T21:00:47.252 INFO:teuthology.orchestra.run.trial068.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-18T21:00:47.252 INFO:teuthology.orchestra.run.trial068.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T21:00:47.252 INFO:teuthology.orchestra.run.trial068.stdout:Device: 6h/6d Inode: 910 Links: 1 2026-02-18T21:00:47.252 INFO:teuthology.orchestra.run.trial068.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T21:00:47.252 INFO:teuthology.orchestra.run.trial068.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T21:00:47.252 INFO:teuthology.orchestra.run.trial068.stdout:Access: 2026-02-18 21:00:44.793298744 +0000 2026-02-18T21:00:47.252 INFO:teuthology.orchestra.run.trial068.stdout:Modify: 2026-02-18 20:59:23.804517266 +0000 2026-02-18T21:00:47.253 INFO:teuthology.orchestra.run.trial068.stdout:Change: 2026-02-18 20:59:23.804517266 +0000 2026-02-18T21:00:47.253 INFO:teuthology.orchestra.run.trial068.stdout: Birth: 2026-02-18 20:59:23.804517266 +0000 2026-02-18T21:00:47.253 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-18T21:00:47.314 INFO:teuthology.orchestra.run.trial068.stderr:1+0 records in 2026-02-18T21:00:47.314 INFO:teuthology.orchestra.run.trial068.stderr:1+0 records out 2026-02-18T21:00:47.314 INFO:teuthology.orchestra.run.trial068.stderr:512 bytes copied, 0.000153232 s, 3.3 MB/s 2026-02-18T21:00:47.315 DEBUG:teuthology.orchestra.run.trial068:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-18T21:00:47.373 DEBUG:teuthology.orchestra.run.trial068:> stat /dev/vg_nvme/lv_2 2026-02-18T21:00:47.428 INFO:teuthology.orchestra.run.trial068.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-18T21:00:47.429 INFO:teuthology.orchestra.run.trial068.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T21:00:47.429 INFO:teuthology.orchestra.run.trial068.stdout:Device: 6h/6d Inode: 935 Links: 1 2026-02-18T21:00:47.429 INFO:teuthology.orchestra.run.trial068.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T21:00:47.429 INFO:teuthology.orchestra.run.trial068.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T21:00:47.429 INFO:teuthology.orchestra.run.trial068.stdout:Access: 2026-02-18 21:00:44.793298744 +0000 2026-02-18T21:00:47.429 INFO:teuthology.orchestra.run.trial068.stdout:Modify: 2026-02-18 20:59:24.041508759 +0000 2026-02-18T21:00:47.429 INFO:teuthology.orchestra.run.trial068.stdout:Change: 2026-02-18 20:59:24.041508759 +0000 2026-02-18T21:00:47.429 INFO:teuthology.orchestra.run.trial068.stdout: Birth: 2026-02-18 20:59:24.041508759 +0000 2026-02-18T21:00:47.430 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-18T21:00:47.494 INFO:teuthology.orchestra.run.trial068.stderr:1+0 records in 2026-02-18T21:00:47.494 INFO:teuthology.orchestra.run.trial068.stderr:1+0 records out 2026-02-18T21:00:47.494 INFO:teuthology.orchestra.run.trial068.stderr:512 bytes copied, 0.000147925 s, 3.5 MB/s 2026-02-18T21:00:47.495 DEBUG:teuthology.orchestra.run.trial068:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-18T21:00:47.553 DEBUG:teuthology.orchestra.run.trial068:> stat /dev/vg_nvme/lv_3 2026-02-18T21:00:47.610 INFO:teuthology.orchestra.run.trial068.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-18T21:00:47.610 INFO:teuthology.orchestra.run.trial068.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T21:00:47.610 INFO:teuthology.orchestra.run.trial068.stdout:Device: 6h/6d Inode: 967 Links: 1 2026-02-18T21:00:47.610 INFO:teuthology.orchestra.run.trial068.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T21:00:47.611 INFO:teuthology.orchestra.run.trial068.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T21:00:47.611 INFO:teuthology.orchestra.run.trial068.stdout:Access: 2026-02-18 21:00:44.793298744 +0000 2026-02-18T21:00:47.611 INFO:teuthology.orchestra.run.trial068.stdout:Modify: 2026-02-18 20:59:24.284500036 +0000 2026-02-18T21:00:47.611 INFO:teuthology.orchestra.run.trial068.stdout:Change: 2026-02-18 20:59:24.284500036 +0000 2026-02-18T21:00:47.611 INFO:teuthology.orchestra.run.trial068.stdout: Birth: 2026-02-18 20:59:24.284500036 +0000 2026-02-18T21:00:47.611 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-18T21:00:47.675 INFO:teuthology.orchestra.run.trial068.stderr:1+0 records in 2026-02-18T21:00:47.675 INFO:teuthology.orchestra.run.trial068.stderr:1+0 records out 2026-02-18T21:00:47.675 INFO:teuthology.orchestra.run.trial068.stderr:512 bytes copied, 0.000166456 s, 3.1 MB/s 2026-02-18T21:00:47.676 DEBUG:teuthology.orchestra.run.trial068:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-18T21:00:47.733 DEBUG:teuthology.orchestra.run.trial068:> stat /dev/vg_nvme/lv_4 2026-02-18T21:00:47.791 INFO:teuthology.orchestra.run.trial068.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-18T21:00:47.791 INFO:teuthology.orchestra.run.trial068.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-18T21:00:47.791 INFO:teuthology.orchestra.run.trial068.stdout:Device: 6h/6d Inode: 995 Links: 1 2026-02-18T21:00:47.791 INFO:teuthology.orchestra.run.trial068.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-18T21:00:47.791 INFO:teuthology.orchestra.run.trial068.stdout:Context: system_u:object_r:device_t:s0 2026-02-18T21:00:47.791 INFO:teuthology.orchestra.run.trial068.stdout:Access: 2026-02-18 21:00:44.793298744 +0000 2026-02-18T21:00:47.791 INFO:teuthology.orchestra.run.trial068.stdout:Modify: 2026-02-18 20:59:24.533491098 +0000 2026-02-18T21:00:47.791 INFO:teuthology.orchestra.run.trial068.stdout:Change: 2026-02-18 20:59:24.533491098 +0000 2026-02-18T21:00:47.791 INFO:teuthology.orchestra.run.trial068.stdout: Birth: 2026-02-18 20:59:24.533491098 +0000 2026-02-18T21:00:47.792 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-18T21:00:47.853 INFO:teuthology.orchestra.run.trial068.stderr:1+0 records in 2026-02-18T21:00:47.853 INFO:teuthology.orchestra.run.trial068.stderr:1+0 records out 2026-02-18T21:00:47.854 INFO:teuthology.orchestra.run.trial068.stderr:512 bytes copied, 0.000142112 s, 3.6 MB/s 2026-02-18T21:00:47.855 DEBUG:teuthology.orchestra.run.trial068:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-18T21:00:47.912 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-18T21:00:47.913 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial068.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-18T21:00:47.913 INFO:tasks.ceph:Generating config... 2026-02-18T21:00:47.915 INFO:tasks.ceph:[global] mon warn on pool no app = False 2026-02-18T21:00:47.915 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-18T21:00:47.915 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2026-02-18T21:00:47.915 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2026-02-18T21:00:47.915 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2026-02-18T21:00:47.916 INFO:tasks.ceph:[client] client mount timeout = 600 2026-02-18T21:00:47.916 INFO:tasks.ceph:[client] debug client = 20 2026-02-18T21:00:47.916 INFO:tasks.ceph:[client] debug ms = 1 2026-02-18T21:00:47.916 INFO:tasks.ceph:[client] rados mon op timeout = 900 2026-02-18T21:00:47.916 INFO:tasks.ceph:[client] rados osd op timeout = 900 2026-02-18T21:00:47.916 INFO:tasks.ceph:[mds] debug mds = 20 2026-02-18T21:00:47.916 INFO:tasks.ceph:[mds] debug mds balancer = 20 2026-02-18T21:00:47.916 INFO:tasks.ceph:[mds] debug ms = 1 2026-02-18T21:00:47.916 INFO:tasks.ceph:[mds] mds debug frag = True 2026-02-18T21:00:47.916 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2026-02-18T21:00:47.916 INFO:tasks.ceph:[mds] mds op complaint time = 180 2026-02-18T21:00:47.916 INFO:tasks.ceph:[mds] mds verify scatter = True 2026-02-18T21:00:47.917 INFO:tasks.ceph:[mds] osd op complaint time = 180 2026-02-18T21:00:47.917 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2026-02-18T21:00:47.917 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2026-02-18T21:00:47.917 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-18T21:00:47.917 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-18T21:00:47.917 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-18T21:00:47.917 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-18T21:00:47.917 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-18T21:00:47.917 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2026-02-18T21:00:47.917 INFO:tasks.ceph:[mon] mon op complaint time = 120 2026-02-18T21:00:47.917 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2026-02-18T21:00:47.917 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-18T21:00:47.918 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-18T21:00:47.918 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2026-02-18T21:00:47.918 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-18T21:00:47.918 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-18T21:00:47.918 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2026-02-18T21:00:47.918 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2026-02-18T21:00:47.918 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-18T21:00:47.918 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-18T21:00:47.918 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2026-02-18T21:00:47.918 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-18T21:00:47.918 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-18T21:00:47.919 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-18T21:00:47.919 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-18T21:00:47.919 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-18T21:00:47.919 INFO:tasks.ceph:[osd] osd op complaint time = 180 2026-02-18T21:00:47.919 INFO:tasks.ceph:Setting up mon.a... 2026-02-18T21:00:47.919 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-18T21:00:47.985 INFO:teuthology.orchestra.run.trial068.stdout:creating /etc/ceph/ceph.keyring 2026-02-18T21:00:47.987 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-18T21:00:48.061 DEBUG:teuthology.orchestra.run.trial068:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-18T21:00:48.126 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.68'), ('mon.b', '[v2:10.20.193.68:3301,v1:10.20.193.68:6790]'), ('mon.c', '[v2:10.20.193.68:3302,v1:10.20.193.68:6791]')] 2026-02-18T21:00:48.127 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.68,[v2:10.20.193.68:3301,v1:10.20.193.68:6790],[v2:10.20.193.68:3302,v1:10.20.193.68:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2026-02-18T21:00:48.129 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:00:48.129 DEBUG:teuthology.orchestra.run.trial068:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-18T21:00:48.182 DEBUG:teuthology.orchestra.run.trial068:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.68 --addv b '[v2:10.20.193.68:3301,v1:10.20.193.68:6790]' --addv c '[v2:10.20.193.68:3302,v1:10.20.193.68:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-18T21:00:48.254 INFO:teuthology.orchestra.run.trial068.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-18T21:00:48.254 INFO:teuthology.orchestra.run.trial068.stdout:monmaptool: generated fsid 73558818-cfd1-494a-84aa-56d128598ef4 2026-02-18T21:00:48.255 INFO:teuthology.orchestra.run.trial068.stdout:setting min_mon_release = octopus 2026-02-18T21:00:48.255 INFO:teuthology.orchestra.run.trial068.stdout:epoch 0 2026-02-18T21:00:48.255 INFO:teuthology.orchestra.run.trial068.stdout:fsid 73558818-cfd1-494a-84aa-56d128598ef4 2026-02-18T21:00:48.255 INFO:teuthology.orchestra.run.trial068.stdout:last_changed 2026-02-18T21:00:48.254583+0000 2026-02-18T21:00:48.255 INFO:teuthology.orchestra.run.trial068.stdout:created 2026-02-18T21:00:48.254583+0000 2026-02-18T21:00:48.255 INFO:teuthology.orchestra.run.trial068.stdout:min_mon_release 15 (octopus) 2026-02-18T21:00:48.255 INFO:teuthology.orchestra.run.trial068.stdout:election_strategy: 1 2026-02-18T21:00:48.255 INFO:teuthology.orchestra.run.trial068.stdout:0: [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] mon.a 2026-02-18T21:00:48.255 INFO:teuthology.orchestra.run.trial068.stdout:1: [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] mon.b 2026-02-18T21:00:48.255 INFO:teuthology.orchestra.run.trial068.stdout:2: [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] mon.c 2026-02-18T21:00:48.256 INFO:teuthology.orchestra.run.trial068.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-18T21:00:48.257 DEBUG:teuthology.orchestra.run.trial068:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-18T21:00:48.315 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 73558818-cfd1-494a-84aa-56d128598ef4... 2026-02-18T21:00:48.317 DEBUG:teuthology.orchestra.run.trial068:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-18T21:00:48.394 INFO:teuthology.orchestra.run.trial068.stdout:[global] 2026-02-18T21:00:48.395 INFO:teuthology.orchestra.run.trial068.stdout: chdir = "" 2026-02-18T21:00:48.395 INFO:teuthology.orchestra.run.trial068.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-18T21:00:48.395 INFO:teuthology.orchestra.run.trial068.stdout: auth supported = cephx 2026-02-18T21:00:48.395 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.395 INFO:teuthology.orchestra.run.trial068.stdout: filestore xattr use omap = true 2026-02-18T21:00:48.395 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.396 INFO:teuthology.orchestra.run.trial068.stdout: mon clock drift allowed = 1.000 2026-02-18T21:00:48.396 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.396 INFO:teuthology.orchestra.run.trial068.stdout: osd crush chooseleaf type = 0 2026-02-18T21:00:48.396 INFO:teuthology.orchestra.run.trial068.stdout: auth debug = true 2026-02-18T21:00:48.396 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.396 INFO:teuthology.orchestra.run.trial068.stdout: ms die on old message = true 2026-02-18T21:00:48.396 INFO:teuthology.orchestra.run.trial068.stdout: ms die on bug = true 2026-02-18T21:00:48.396 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.397 INFO:teuthology.orchestra.run.trial068.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-18T21:00:48.397 INFO:teuthology.orchestra.run.trial068.stdout: mon pg warn max object skew = 0 2026-02-18T21:00:48.397 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.397 INFO:teuthology.orchestra.run.trial068.stdout: # disable pg_autoscaler by default for new pools 2026-02-18T21:00:48.397 INFO:teuthology.orchestra.run.trial068.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-18T21:00:48.397 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.397 INFO:teuthology.orchestra.run.trial068.stdout: osd pool default size = 2 2026-02-18T21:00:48.397 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.398 INFO:teuthology.orchestra.run.trial068.stdout: mon osd allow primary affinity = true 2026-02-18T21:00:48.398 INFO:teuthology.orchestra.run.trial068.stdout: mon osd allow pg remap = true 2026-02-18T21:00:48.398 INFO:teuthology.orchestra.run.trial068.stdout: mon warn on legacy crush tunables = false 2026-02-18T21:00:48.398 INFO:teuthology.orchestra.run.trial068.stdout: mon warn on crush straw calc version zero = false 2026-02-18T21:00:48.398 INFO:teuthology.orchestra.run.trial068.stdout: mon warn on no sortbitwise = false 2026-02-18T21:00:48.398 INFO:teuthology.orchestra.run.trial068.stdout: mon warn on osd down out interval zero = false 2026-02-18T21:00:48.398 INFO:teuthology.orchestra.run.trial068.stdout: mon warn on too few osds = false 2026-02-18T21:00:48.399 INFO:teuthology.orchestra.run.trial068.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-18T21:00:48.399 INFO:teuthology.orchestra.run.trial068.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-18T21:00:48.399 INFO:teuthology.orchestra.run.trial068.stdout: mon_allow_pool_size_one = true 2026-02-18T21:00:48.399 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.399 INFO:teuthology.orchestra.run.trial068.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-18T21:00:48.399 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.399 INFO:teuthology.orchestra.run.trial068.stdout: osd default data pool replay window = 5 2026-02-18T21:00:48.399 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.400 INFO:teuthology.orchestra.run.trial068.stdout: mon allow pool delete = true 2026-02-18T21:00:48.400 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.400 INFO:teuthology.orchestra.run.trial068.stdout: mon cluster log file level = debug 2026-02-18T21:00:48.400 INFO:teuthology.orchestra.run.trial068.stdout: debug asserts on shutdown = true 2026-02-18T21:00:48.400 INFO:teuthology.orchestra.run.trial068.stdout: mon health detail to clog = false 2026-02-18T21:00:48.400 INFO:teuthology.orchestra.run.trial068.stdout: mon host = "10.20.193.68,[v2:10.20.193.68:3301,v1:10.20.193.68:6790],[v2:10.20.193.68:3302,v1:10.20.193.68:6791]" 2026-02-18T21:00:48.400 INFO:teuthology.orchestra.run.trial068.stdout: mon warn on pool no app = False 2026-02-18T21:00:48.400 INFO:teuthology.orchestra.run.trial068.stdout: ms bind msgr2 = False 2026-02-18T21:00:48.401 INFO:teuthology.orchestra.run.trial068.stdout: bluestore warn on legacy statfs = False 2026-02-18T21:00:48.401 INFO:teuthology.orchestra.run.trial068.stdout: bluestore warn on no per pool omap = False 2026-02-18T21:00:48.401 INFO:teuthology.orchestra.run.trial068.stdout: mon pg warn min per osd = 0 2026-02-18T21:00:48.401 INFO:teuthology.orchestra.run.trial068.stdout: fsid = 73558818-cfd1-494a-84aa-56d128598ef4 2026-02-18T21:00:48.401 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.401 INFO:teuthology.orchestra.run.trial068.stdout:[osd] 2026-02-18T21:00:48.401 INFO:teuthology.orchestra.run.trial068.stdout: osd journal size = 100 2026-02-18T21:00:48.401 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.402 INFO:teuthology.orchestra.run.trial068.stdout: osd scrub load threshold = 5.0 2026-02-18T21:00:48.402 INFO:teuthology.orchestra.run.trial068.stdout: osd scrub max interval = 600 2026-02-18T21:00:48.402 INFO:teuthology.orchestra.run.trial068.stdout: osd mclock profile = high_recovery_ops 2026-02-18T21:00:48.402 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.402 INFO:teuthology.orchestra.run.trial068.stdout: osd recover clone overlap = true 2026-02-18T21:00:48.402 INFO:teuthology.orchestra.run.trial068.stdout: osd recovery max chunk = 1048576 2026-02-18T21:00:48.402 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.403 INFO:teuthology.orchestra.run.trial068.stdout: osd debug shutdown = true 2026-02-18T21:00:48.403 INFO:teuthology.orchestra.run.trial068.stdout: osd debug op order = true 2026-02-18T21:00:48.403 INFO:teuthology.orchestra.run.trial068.stdout: osd debug verify stray on activate = true 2026-02-18T21:00:48.403 INFO:teuthology.orchestra.run.trial068.stdout: osd debug trim objects = true 2026-02-18T21:00:48.403 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.403 INFO:teuthology.orchestra.run.trial068.stdout: osd open classes on start = true 2026-02-18T21:00:48.403 INFO:teuthology.orchestra.run.trial068.stdout: osd debug pg log writeout = true 2026-02-18T21:00:48.403 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.404 INFO:teuthology.orchestra.run.trial068.stdout: osd deep scrub update digest min age = 30 2026-02-18T21:00:48.404 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.404 INFO:teuthology.orchestra.run.trial068.stdout: osd map max advance = 10 2026-02-18T21:00:48.404 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.404 INFO:teuthology.orchestra.run.trial068.stdout: journal zero on create = true 2026-02-18T21:00:48.404 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.404 INFO:teuthology.orchestra.run.trial068.stdout: filestore ondisk finisher threads = 3 2026-02-18T21:00:48.404 INFO:teuthology.orchestra.run.trial068.stdout: filestore apply finisher threads = 3 2026-02-18T21:00:48.405 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.405 INFO:teuthology.orchestra.run.trial068.stdout: bdev debug aio = true 2026-02-18T21:00:48.405 INFO:teuthology.orchestra.run.trial068.stdout: osd debug misdirected ops = true 2026-02-18T21:00:48.405 INFO:teuthology.orchestra.run.trial068.stdout: bdev async discard = True 2026-02-18T21:00:48.405 INFO:teuthology.orchestra.run.trial068.stdout: bdev enable discard = True 2026-02-18T21:00:48.405 INFO:teuthology.orchestra.run.trial068.stdout: bluestore allocator = bitmap 2026-02-18T21:00:48.405 INFO:teuthology.orchestra.run.trial068.stdout: bluestore block size = 96636764160 2026-02-18T21:00:48.405 INFO:teuthology.orchestra.run.trial068.stdout: bluestore fsck on mount = True 2026-02-18T21:00:48.406 INFO:teuthology.orchestra.run.trial068.stdout: debug bluefs = 1/20 2026-02-18T21:00:48.406 INFO:teuthology.orchestra.run.trial068.stdout: debug bluestore = 1/20 2026-02-18T21:00:48.406 INFO:teuthology.orchestra.run.trial068.stdout: debug ms = 1 2026-02-18T21:00:48.406 INFO:teuthology.orchestra.run.trial068.stdout: debug osd = 20 2026-02-18T21:00:48.406 INFO:teuthology.orchestra.run.trial068.stdout: debug rocksdb = 4/10 2026-02-18T21:00:48.406 INFO:teuthology.orchestra.run.trial068.stdout: mon osd backfillfull_ratio = 0.85 2026-02-18T21:00:48.406 INFO:teuthology.orchestra.run.trial068.stdout: mon osd full ratio = 0.9 2026-02-18T21:00:48.406 INFO:teuthology.orchestra.run.trial068.stdout: mon osd nearfull ratio = 0.8 2026-02-18T21:00:48.406 INFO:teuthology.orchestra.run.trial068.stdout: osd failsafe full ratio = 0.95 2026-02-18T21:00:48.407 INFO:teuthology.orchestra.run.trial068.stdout: osd objectstore = bluestore 2026-02-18T21:00:48.407 INFO:teuthology.orchestra.run.trial068.stdout: osd op complaint time = 180 2026-02-18T21:00:48.407 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.407 INFO:teuthology.orchestra.run.trial068.stdout:[mgr] 2026-02-18T21:00:48.407 INFO:teuthology.orchestra.run.trial068.stdout: debug ms = 1 2026-02-18T21:00:48.407 INFO:teuthology.orchestra.run.trial068.stdout: debug mgr = 20 2026-02-18T21:00:48.407 INFO:teuthology.orchestra.run.trial068.stdout: debug mon = 20 2026-02-18T21:00:48.407 INFO:teuthology.orchestra.run.trial068.stdout: debug auth = 20 2026-02-18T21:00:48.408 INFO:teuthology.orchestra.run.trial068.stdout: mon reweight min pgs per osd = 4 2026-02-18T21:00:48.408 INFO:teuthology.orchestra.run.trial068.stdout: mon reweight min bytes per osd = 10 2026-02-18T21:00:48.408 INFO:teuthology.orchestra.run.trial068.stdout: mgr/telemetry/nag = false 2026-02-18T21:00:48.408 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.408 INFO:teuthology.orchestra.run.trial068.stdout:[mon] 2026-02-18T21:00:48.408 INFO:teuthology.orchestra.run.trial068.stdout: debug ms = 1 2026-02-18T21:00:48.408 INFO:teuthology.orchestra.run.trial068.stdout: debug mon = 20 2026-02-18T21:00:48.408 INFO:teuthology.orchestra.run.trial068.stdout: debug paxos = 20 2026-02-18T21:00:48.409 INFO:teuthology.orchestra.run.trial068.stdout: debug auth = 20 2026-02-18T21:00:48.409 INFO:teuthology.orchestra.run.trial068.stdout: mon data avail warn = 5 2026-02-18T21:00:48.409 INFO:teuthology.orchestra.run.trial068.stdout: mon mgr mkfs grace = 240 2026-02-18T21:00:48.409 INFO:teuthology.orchestra.run.trial068.stdout: mon reweight min pgs per osd = 4 2026-02-18T21:00:48.409 INFO:teuthology.orchestra.run.trial068.stdout: mon osd reporter subtree level = osd 2026-02-18T21:00:48.409 INFO:teuthology.orchestra.run.trial068.stdout: mon osd prime pg temp = true 2026-02-18T21:00:48.409 INFO:teuthology.orchestra.run.trial068.stdout: mon reweight min bytes per osd = 10 2026-02-18T21:00:48.409 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.410 INFO:teuthology.orchestra.run.trial068.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-18T21:00:48.410 INFO:teuthology.orchestra.run.trial068.stdout: auth mon ticket ttl = 660 # 11m 2026-02-18T21:00:48.410 INFO:teuthology.orchestra.run.trial068.stdout: auth service ticket ttl = 240 # 4m 2026-02-18T21:00:48.410 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.410 INFO:teuthology.orchestra.run.trial068.stdout: # don't complain about insecure global_id in the test suite 2026-02-18T21:00:48.410 INFO:teuthology.orchestra.run.trial068.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-18T21:00:48.410 INFO:teuthology.orchestra.run.trial068.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-18T21:00:48.410 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.411 INFO:teuthology.orchestra.run.trial068.stdout: # 1m isn't quite enough 2026-02-18T21:00:48.411 INFO:teuthology.orchestra.run.trial068.stdout: mon_down_mkfs_grace = 2m 2026-02-18T21:00:48.411 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.411 INFO:teuthology.orchestra.run.trial068.stdout: mon_warn_on_filestore_osds = false 2026-02-18T21:00:48.411 INFO:teuthology.orchestra.run.trial068.stdout: mon down mkfs grace = 300 2026-02-18T21:00:48.411 INFO:teuthology.orchestra.run.trial068.stdout: mon op complaint time = 120 2026-02-18T21:00:48.411 INFO:teuthology.orchestra.run.trial068.stdout: mon warn on osd down out interval zero = False 2026-02-18T21:00:48.411 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:00:48.412 INFO:teuthology.orchestra.run.trial068.stdout:[client] 2026-02-18T21:00:48.412 INFO:teuthology.orchestra.run.trial068.stdout: rgw cache enabled = true 2026-02-18T21:00:48.412 INFO:teuthology.orchestra.run.trial068.stdout: rgw enable ops log = true 2026-02-18T21:00:48.412 INFO:teuthology.orchestra.run.trial068.stdout: rgw enable usage log = true 2026-02-18T21:00:48.412 INFO:teuthology.orchestra.run.trial068.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-18T21:00:48.412 INFO:teuthology.orchestra.run.trial068.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-18T21:00:48.412 INFO:teuthology.orchestra.run.trial068.stdout: client mount timeout = 600 2026-02-18T21:00:48.412 INFO:teuthology.orchestra.run.trial068.stdout: debug client = 20 2026-02-18T21:00:48.413 INFO:teuthology.orchestra.run.trial068.stdout: debug ms = 1 2026-02-18T21:00:48.413 INFO:teuthology.orchestra.run.trial068.stdout: rados mon op timeout = 900 2026-02-18T21:00:48.413 INFO:teuthology.orchestra.run.trial068.stdout: rados osd op timeout = 900 2026-02-18T21:00:48.413 INFO:teuthology.orchestra.run.trial068.stdout:[mon.a] 2026-02-18T21:00:48.413 INFO:teuthology.orchestra.run.trial068.stdout:[mon.b] 2026-02-18T21:00:48.413 INFO:teuthology.orchestra.run.trial068.stdout:[mon.c] 2026-02-18T21:00:48.413 INFO:teuthology.orchestra.run.trial068.stdout:[mds] 2026-02-18T21:00:48.413 INFO:teuthology.orchestra.run.trial068.stdout: debug mds = 20 2026-02-18T21:00:48.414 INFO:teuthology.orchestra.run.trial068.stdout: debug mds balancer = 20 2026-02-18T21:00:48.414 INFO:teuthology.orchestra.run.trial068.stdout: debug ms = 1 2026-02-18T21:00:48.414 INFO:teuthology.orchestra.run.trial068.stdout: mds debug frag = True 2026-02-18T21:00:48.414 INFO:teuthology.orchestra.run.trial068.stdout: mds debug scatterstat = True 2026-02-18T21:00:48.414 INFO:teuthology.orchestra.run.trial068.stdout: mds op complaint time = 180 2026-02-18T21:00:48.414 INFO:teuthology.orchestra.run.trial068.stdout: mds verify scatter = True 2026-02-18T21:00:48.414 INFO:teuthology.orchestra.run.trial068.stdout: osd op complaint time = 180 2026-02-18T21:00:48.414 INFO:teuthology.orchestra.run.trial068.stdout: rados mon op timeout = 900 2026-02-18T21:00:48.414 INFO:teuthology.orchestra.run.trial068.stdout: rados osd op timeout = 900 2026-02-18T21:00:48.416 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-18T21:00:48.417 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-18T21:00:48.497 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-18T21:00:48.497 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:00:48.497 DEBUG:teuthology.orchestra.run.trial068:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-18T21:00:48.554 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:00:48.554 DEBUG:teuthology.orchestra.run.trial068:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-18T21:00:48.611 INFO:tasks.ceph:Sending monmap to node ubuntu@trial068.front.sepia.ceph.com 2026-02-18T21:00:48.611 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:00:48.611 DEBUG:teuthology.orchestra.run.trial068:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-18T21:00:48.611 DEBUG:teuthology.orchestra.run.trial068:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-18T21:00:48.686 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:00:48.686 DEBUG:teuthology.orchestra.run.trial068:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-18T21:00:48.744 INFO:tasks.ceph:Setting up mon nodes... 2026-02-18T21:00:48.744 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-18T21:00:48.745 DEBUG:teuthology.orchestra.run.trial068:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-18T21:00:48.825 INFO:teuthology.orchestra.run.trial068.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-18T21:00:48.828 DEBUG:teuthology.orchestra.run.trial068:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-18T21:00:48.910 INFO:teuthology.orchestra.run.trial068.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-18T21:00:48.911 INFO:tasks.ceph:Setting up mds nodes... 2026-02-18T21:00:48.912 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-18T21:00:48.912 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-18T21:00:48.912 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial068.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2026-02-18T21:00:48.912 DEBUG:teuthology.orchestra.run.trial068:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-18T21:00:48.976 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-18T21:00:48.976 INFO:tasks.ceph:role: osd.0 2026-02-18T21:00:48.976 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial068.front.sepia.ceph.com 2026-02-18T21:00:48.976 DEBUG:teuthology.orchestra.run.trial068:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-18T21:00:49.041 INFO:teuthology.orchestra.run.trial068.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-18T21:00:49.042 INFO:teuthology.orchestra.run.trial068.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-18T21:00:49.042 INFO:teuthology.orchestra.run.trial068.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-18T21:00:49.042 INFO:teuthology.orchestra.run.trial068.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-18T21:00:49.042 INFO:teuthology.orchestra.run.trial068.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-18T21:00:49.042 INFO:teuthology.orchestra.run.trial068.stdout: = sunit=0 swidth=0 blks 2026-02-18T21:00:49.042 INFO:teuthology.orchestra.run.trial068.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-18T21:00:49.042 INFO:teuthology.orchestra.run.trial068.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-18T21:00:49.042 INFO:teuthology.orchestra.run.trial068.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-18T21:00:49.042 INFO:teuthology.orchestra.run.trial068.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-18T21:00:49.612 INFO:teuthology.orchestra.run.trial068.stdout:Discarding blocks...Done. 2026-02-18T21:00:49.614 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial068.front.sepia.ceph.com -o noatime 2026-02-18T21:00:49.614 DEBUG:teuthology.orchestra.run.trial068:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-18T21:00:49.683 DEBUG:teuthology.orchestra.run.trial068:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-18T21:00:49.751 DEBUG:teuthology.orchestra.run.trial068:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-18T21:00:49.815 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-18T21:00:49.816 INFO:tasks.ceph:role: osd.1 2026-02-18T21:00:49.816 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial068.front.sepia.ceph.com 2026-02-18T21:00:49.816 DEBUG:teuthology.orchestra.run.trial068:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-18T21:00:49.880 INFO:teuthology.orchestra.run.trial068.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-18T21:00:49.881 INFO:teuthology.orchestra.run.trial068.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-18T21:00:49.881 INFO:teuthology.orchestra.run.trial068.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-18T21:00:49.881 INFO:teuthology.orchestra.run.trial068.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-18T21:00:49.881 INFO:teuthology.orchestra.run.trial068.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-18T21:00:49.881 INFO:teuthology.orchestra.run.trial068.stdout: = sunit=0 swidth=0 blks 2026-02-18T21:00:49.881 INFO:teuthology.orchestra.run.trial068.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-18T21:00:49.881 INFO:teuthology.orchestra.run.trial068.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-18T21:00:49.881 INFO:teuthology.orchestra.run.trial068.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-18T21:00:49.882 INFO:teuthology.orchestra.run.trial068.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-18T21:00:50.440 INFO:teuthology.orchestra.run.trial068.stdout:Discarding blocks...Done. 2026-02-18T21:00:50.442 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial068.front.sepia.ceph.com -o noatime 2026-02-18T21:00:50.443 DEBUG:teuthology.orchestra.run.trial068:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-18T21:00:50.510 DEBUG:teuthology.orchestra.run.trial068:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-18T21:00:50.578 DEBUG:teuthology.orchestra.run.trial068:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-18T21:00:50.644 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-18T21:00:50.644 INFO:tasks.ceph:role: osd.2 2026-02-18T21:00:50.644 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial068.front.sepia.ceph.com 2026-02-18T21:00:50.644 DEBUG:teuthology.orchestra.run.trial068:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-18T21:00:50.709 INFO:teuthology.orchestra.run.trial068.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-18T21:00:50.709 INFO:teuthology.orchestra.run.trial068.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-18T21:00:50.709 INFO:teuthology.orchestra.run.trial068.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-18T21:00:50.710 INFO:teuthology.orchestra.run.trial068.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-18T21:00:50.710 INFO:teuthology.orchestra.run.trial068.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-18T21:00:50.710 INFO:teuthology.orchestra.run.trial068.stdout: = sunit=0 swidth=0 blks 2026-02-18T21:00:50.710 INFO:teuthology.orchestra.run.trial068.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-18T21:00:50.710 INFO:teuthology.orchestra.run.trial068.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-18T21:00:50.710 INFO:teuthology.orchestra.run.trial068.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-18T21:00:50.710 INFO:teuthology.orchestra.run.trial068.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-18T21:00:51.267 INFO:teuthology.orchestra.run.trial068.stdout:Discarding blocks...Done. 2026-02-18T21:00:51.270 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial068.front.sepia.ceph.com -o noatime 2026-02-18T21:00:51.270 DEBUG:teuthology.orchestra.run.trial068:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-18T21:00:51.337 DEBUG:teuthology.orchestra.run.trial068:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-18T21:00:51.405 DEBUG:teuthology.orchestra.run.trial068:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-18T21:00:51.470 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2026-02-18T21:00:51.470 INFO:tasks.ceph:role: osd.3 2026-02-18T21:00:51.470 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial068.front.sepia.ceph.com 2026-02-18T21:00:51.470 DEBUG:teuthology.orchestra.run.trial068:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-18T21:00:51.536 INFO:teuthology.orchestra.run.trial068.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-18T21:00:51.536 INFO:teuthology.orchestra.run.trial068.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-18T21:00:51.536 INFO:teuthology.orchestra.run.trial068.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-18T21:00:51.536 INFO:teuthology.orchestra.run.trial068.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-18T21:00:51.537 INFO:teuthology.orchestra.run.trial068.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-18T21:00:51.537 INFO:teuthology.orchestra.run.trial068.stdout: = sunit=0 swidth=0 blks 2026-02-18T21:00:51.537 INFO:teuthology.orchestra.run.trial068.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-18T21:00:51.537 INFO:teuthology.orchestra.run.trial068.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-18T21:00:51.537 INFO:teuthology.orchestra.run.trial068.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-18T21:00:51.537 INFO:teuthology.orchestra.run.trial068.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-18T21:00:52.093 INFO:teuthology.orchestra.run.trial068.stdout:Discarding blocks...Done. 2026-02-18T21:00:52.095 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial068.front.sepia.ceph.com -o noatime 2026-02-18T21:00:52.095 DEBUG:teuthology.orchestra.run.trial068:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2026-02-18T21:00:52.164 DEBUG:teuthology.orchestra.run.trial068:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-18T21:00:52.231 DEBUG:teuthology.orchestra.run.trial068:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-18T21:00:52.308 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:52.307+0000 7f8e73016440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-18T21:00:52.308 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:52.308+0000 7f8e73016440 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-18T21:00:52.308 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:52.308+0000 7f8e73016440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2026-02-18T21:00:52.308 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:52.308+0000 7f8e73016440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2026-02-18T21:00:52.309 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:52.308+0000 7f8e73016440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2026-02-18T21:00:52.309 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:52.308+0000 7f8e73016440 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-18T21:00:52.830 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:52.829+0000 7f8e73016440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-18T21:00:53.592 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:53.591+0000 7f8e73016440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-18T21:00:54.353 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:54.353+0000 7f8e73016440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-18T21:00:55.147 DEBUG:teuthology.orchestra.run.trial068:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-18T21:00:55.214 DEBUG:teuthology.orchestra.run.trial068:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-18T21:00:55.290 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:55.289+0000 7f10d09c8440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-18T21:00:55.290 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:55.290+0000 7f10d09c8440 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-18T21:00:55.290 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:55.290+0000 7f10d09c8440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2026-02-18T21:00:55.290 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:55.290+0000 7f10d09c8440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2026-02-18T21:00:55.290 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:55.290+0000 7f10d09c8440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2026-02-18T21:00:55.290 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:55.290+0000 7f10d09c8440 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-18T21:00:55.813 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:55.812+0000 7f10d09c8440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-18T21:00:56.574 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:56.574+0000 7f10d09c8440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-18T21:00:57.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:57.336+0000 7f10d09c8440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-18T21:00:58.131 DEBUG:teuthology.orchestra.run.trial068:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-18T21:00:58.197 DEBUG:teuthology.orchestra.run.trial068:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-18T21:00:58.272 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:58.271+0000 7f62f7e35440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-18T21:00:58.272 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:58.271+0000 7f62f7e35440 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-18T21:00:58.272 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:58.271+0000 7f62f7e35440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2026-02-18T21:00:58.272 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:58.271+0000 7f62f7e35440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2026-02-18T21:00:58.272 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:58.271+0000 7f62f7e35440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2026-02-18T21:00:58.273 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:58.271+0000 7f62f7e35440 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-18T21:00:58.794 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:58.793+0000 7f62f7e35440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-18T21:00:59.555 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:00:59.553+0000 7f62f7e35440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-18T21:01:00.317 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:00.316+0000 7f62f7e35440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-18T21:01:01.111 DEBUG:teuthology.orchestra.run.trial068:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-18T21:01:01.177 DEBUG:teuthology.orchestra.run.trial068:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-18T21:01:01.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:01.251+0000 7f0eab212440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-18T21:01:01.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:01.251+0000 7f0eab212440 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-18T21:01:01.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:01.251+0000 7f0eab212440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2026-02-18T21:01:01.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:01.251+0000 7f0eab212440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2026-02-18T21:01:01.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:01.251+0000 7f0eab212440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2026-02-18T21:01:01.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:01.252+0000 7f0eab212440 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-18T21:01:01.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:01.771+0000 7f0eab212440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-18T21:01:02.536 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:02.534+0000 7f0eab212440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-18T21:01:03.299 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:03.297+0000 7f0eab212440 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2026-02-18T21:01:04.090 DEBUG:teuthology.orchestra.run.trial068:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-18T21:01:04.156 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-18T21:01:04.156 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:01:04.156 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-18T21:01:04.221 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:01:04.221 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-18T21:01:04.284 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:01:04.284 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-18T21:01:04.349 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:01:04.349 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-18T21:01:04.412 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:01:04.413 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-18T21:01:04.476 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:01:04.476 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-18T21:01:04.542 INFO:tasks.ceph:Adding keys to all mons... 2026-02-18T21:01:04.542 DEBUG:teuthology.orchestra.run.trial068:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-18T21:01:04.604 INFO:teuthology.orchestra.run.trial068.stdout:[mgr.x] 2026-02-18T21:01:04.604 INFO:teuthology.orchestra.run.trial068.stdout: key = AQCAKJZpr9k7MRAAF1MygP0uxlhhHyqP22M+bQ== 2026-02-18T21:01:04.604 INFO:teuthology.orchestra.run.trial068.stdout:[mgr.y] 2026-02-18T21:01:04.604 INFO:teuthology.orchestra.run.trial068.stdout: key = AQCAKJZpWLJENhAAPZqLZX6Zr80xH70rPifkuQ== 2026-02-18T21:01:04.604 INFO:teuthology.orchestra.run.trial068.stdout:[osd.0] 2026-02-18T21:01:04.604 INFO:teuthology.orchestra.run.trial068.stdout: key = AQCEKJZp3lNeEhAAaMxJenJQ+bNlge/ri2wSSA== 2026-02-18T21:01:04.605 INFO:teuthology.orchestra.run.trial068.stdout:[osd.1] 2026-02-18T21:01:04.605 INFO:teuthology.orchestra.run.trial068.stdout: key = AQCHKJZpkjdMERAAIXBdebe7o5ykSSpXHJSc8g== 2026-02-18T21:01:04.605 INFO:teuthology.orchestra.run.trial068.stdout:[osd.2] 2026-02-18T21:01:04.605 INFO:teuthology.orchestra.run.trial068.stdout: key = AQCKKJZpgBo7EBAArw8uTN4PfMQUsxVdk8cByQ== 2026-02-18T21:01:04.605 INFO:teuthology.orchestra.run.trial068.stdout:[osd.3] 2026-02-18T21:01:04.605 INFO:teuthology.orchestra.run.trial068.stdout: key = AQCNKJZpncwTDxAAKE9rU3o8+x9hTilbkzmLhg== 2026-02-18T21:01:04.606 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-18T21:01:04.685 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-18T21:01:04.764 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-18T21:01:04.843 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-18T21:01:04.920 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-18T21:01:04.997 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-18T21:01:05.075 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-18T21:01:05.075 DEBUG:teuthology.orchestra.run.trial068:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-18T21:01:05.139 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-18T21:01:05.219 DEBUG:teuthology.orchestra.run.trial068:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-18T21:01:05.283 DEBUG:teuthology.orchestra.run.trial068:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-18T21:01:05.349 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-18T21:01:05.430 DEBUG:teuthology.orchestra.run.trial068:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-18T21:01:05.495 DEBUG:teuthology.orchestra.run.trial068:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-18T21:01:05.559 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-18T21:01:05.638 DEBUG:teuthology.orchestra.run.trial068:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-18T21:01:05.702 DEBUG:teuthology.orchestra.run.trial068:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-18T21:01:05.758 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-18T21:01:05.758 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-18T21:01:05.759 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-18T21:01:05.801 INFO:tasks.ceph.mon.a:Started 2026-02-18T21:01:05.801 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-18T21:01:05.801 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-18T21:01:05.803 INFO:tasks.ceph.mon.b:Started 2026-02-18T21:01:05.803 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-18T21:01:05.803 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-18T21:01:05.805 INFO:tasks.ceph.mon.c:Started 2026-02-18T21:01:05.805 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-18T21:01:05.805 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-18T21:01:05.806 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-18T21:01:05.807 INFO:tasks.ceph.mgr.x:Started 2026-02-18T21:01:05.808 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-18T21:01:05.808 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2026-02-18T21:01:05.809 INFO:tasks.ceph.mgr.y:Started 2026-02-18T21:01:05.810 INFO:tasks.ceph:Setting crush tunables to default 2026-02-18T21:01:05.810 DEBUG:teuthology.orchestra.run.trial068:> sudo ceph --cluster ceph osd crush tunables default 2026-02-18T21:01:05.877 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.873+0000 7f2ae906d640 1 Processor -- start 2026-02-18T21:01:05.877 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.873+0000 7f2ae906d640 1 -- start start 2026-02-18T21:01:05.877 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.873+0000 7f2ae906d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 0x7f2ae406d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:05.877 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae906d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 0x7f2ae406e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:05.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae906d640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 0x7f2ae412eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:05.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae906d640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae4088170 con 0x7f2ae412c710 2026-02-18T21:01:05.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae906d640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae4088b90 con 0x7f2ae4098d30 2026-02-18T21:01:05.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae906d640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae406f970 con 0x7f2ae406ddc0 2026-02-18T21:01:05.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae2d9d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 0x7f2ae406d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:05.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae2d9d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 0x7f2ae406d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:44280/0 (socket says 10.20.193.68:44280) 2026-02-18T21:01:05.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae2d9d640 1 -- 10.20.193.68:0/995863684 learned_addr learned my addr 10.20.193.68:0/995863684 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:05.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae359e640 1 --2- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 0x7f2ae412eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:05.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae259c640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 0x7f2ae406e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:05.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae2d9d640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 msgr2=0x7f2ae406d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-18T21:01:05.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae2d9d640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 msgr2=0x7f2ae406d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-18T21:01:05.879 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae2d9d640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 0x7f2ae406d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-18T21:01:05.879 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae359e640 1 -- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 msgr2=0x7f2ae412eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-18T21:01:05.879 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae359e640 1 -- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 msgr2=0x7f2ae412eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-18T21:01:05.879 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae359e640 1 --2- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 0x7f2ae412eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-18T21:01:05.879 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae259c640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 msgr2=0x7f2ae406e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-18T21:01:05.879 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae259c640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 msgr2=0x7f2ae406e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-18T21:01:05.879 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae2d9d640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 0x7f2ae406d880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-18T21:01:05.879 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae259c640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 0x7f2ae406e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-18T21:01:05.879 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae359e640 1 --2- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 0x7f2ae412eaf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-18T21:01:05.879 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:05.874+0000 7f2ae259c640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 0x7f2ae406e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-18T21:01:06.078 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.075+0000 7f2ae2d9d640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 0x7f2ae406d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:06.078 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.075+0000 7f2ae359e640 1 --2- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 0x7f2ae412eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:06.078 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.075+0000 7f2ae259c640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 0x7f2ae406e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:06.078 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.075+0000 7f2ae2d9d640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 msgr2=0x7f2ae406d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-18T21:01:06.078 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.075+0000 7f2ae2d9d640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 msgr2=0x7f2ae406d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-18T21:01:06.078 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.075+0000 7f2ae2d9d640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 0x7f2ae406d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-18T21:01:06.078 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.075+0000 7f2ae359e640 1 -- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 msgr2=0x7f2ae412eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-18T21:01:06.078 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.075+0000 7f2ae359e640 1 -- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 msgr2=0x7f2ae412eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-18T21:01:06.078 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.075+0000 7f2ae2d9d640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 0x7f2ae406d880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-18T21:01:06.079 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.075+0000 7f2ae359e640 1 --2- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 0x7f2ae412eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-18T21:01:06.079 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.075+0000 7f2ae359e640 1 --2- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 0x7f2ae412eaf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-18T21:01:06.079 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.075+0000 7f2ae259c640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 msgr2=0x7f2ae406e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-18T21:01:06.079 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.075+0000 7f2ae259c640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 msgr2=0x7f2ae406e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-18T21:01:06.079 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.075+0000 7f2ae259c640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 0x7f2ae406e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-18T21:01:06.079 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.075+0000 7f2ae259c640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 0x7f2ae406e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-18T21:01:06.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.476+0000 7f2ae259c640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 0x7f2ae406e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:06.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.476+0000 7f2ae2d9d640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 0x7f2ae406d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:06.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.476+0000 7f2ae359e640 1 --2- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 0x7f2ae412eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:06.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.476+0000 7f2ae259c640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 msgr2=0x7f2ae406e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-18T21:01:06.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.476+0000 7f2ae259c640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 msgr2=0x7f2ae406e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-18T21:01:06.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.476+0000 7f2ae259c640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 0x7f2ae406e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-18T21:01:06.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.476+0000 7f2ae2d9d640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 msgr2=0x7f2ae406d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-18T21:01:06.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.476+0000 7f2ae2d9d640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 msgr2=0x7f2ae406d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-18T21:01:06.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.476+0000 7f2ae2d9d640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 0x7f2ae406d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-18T21:01:06.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.476+0000 7f2ae259c640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 0x7f2ae406e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-18T21:01:06.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.476+0000 7f2ae359e640 1 -- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 msgr2=0x7f2ae412eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-18T21:01:06.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.476+0000 7f2ae359e640 1 -- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 msgr2=0x7f2ae412eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-18T21:01:06.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.476+0000 7f2ae2d9d640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 0x7f2ae406d880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-18T21:01:06.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.476+0000 7f2ae359e640 1 --2- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 0x7f2ae412eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-18T21:01:06.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:06.476+0000 7f2ae359e640 1 --2- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 0x7f2ae412eaf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-18T21:01:07.279 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:07.277+0000 7f2ae359e640 1 --2- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 0x7f2ae412eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:07.279 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:07.277+0000 7f2ae259c640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 0x7f2ae406e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:07.280 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:07.277+0000 7f2ae2d9d640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 0x7f2ae406d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:07.280 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:07.277+0000 7f2ae259c640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 msgr2=0x7f2ae406e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2026-02-18T21:01:07.280 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:07.277+0000 7f2ae259c640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 msgr2=0x7f2ae406e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-18T21:01:07.280 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:07.277+0000 7f2ae259c640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 0x7f2ae406e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-18T21:01:07.280 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:07.277+0000 7f2ae359e640 1 -- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 msgr2=0x7f2ae412eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2026-02-18T21:01:07.280 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:07.277+0000 7f2ae359e640 1 -- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 msgr2=0x7f2ae412eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-18T21:01:07.280 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:07.277+0000 7f2ae359e640 1 --2- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 0x7f2ae412eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-18T21:01:07.280 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:07.277+0000 7f2ae259c640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 0x7f2ae406e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-18T21:01:07.280 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:07.277+0000 7f2ae2d9d640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 msgr2=0x7f2ae406d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2026-02-18T21:01:07.280 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:07.277+0000 7f2ae2d9d640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 msgr2=0x7f2ae406d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-18T21:01:07.280 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:07.277+0000 7f2ae359e640 1 --2- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 0x7f2ae412eaf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-18T21:01:07.281 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:07.277+0000 7f2ae2d9d640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 0x7f2ae406d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2026-02-18T21:01:07.281 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:07.277+0000 7f2ae2d9d640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 0x7f2ae406d880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-18T21:01:08.876 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:08.874+0000 7f2ae0d99640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 msgr2=0x7f2ae406e1d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-18T21:01:08.876 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:08.874+0000 7f2ae0d99640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 0x7f2ae406e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:08.876 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:08.874+0000 7f2ae0d99640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 msgr2=0x7f2ae406d880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-18T21:01:08.877 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:08.874+0000 7f2ae0d99640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 0x7f2ae406d880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:08.877 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:08.874+0000 7f2ae0d99640 1 -- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 msgr2=0x7f2ae412eaf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-18T21:01:08.877 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:08.874+0000 7f2ae0d99640 1 --2- 10.20.193.68:0/995863684 >> v2:10.20.193.68:3300/0 conn(0x7f2ae412c710 0x7f2ae412eaf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:08.877 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:08.874+0000 7f2ae0d99640 1 -- 10.20.193.68:0/995863684 --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae4088330 con 0x7f2acc003680 2026-02-18T21:01:11.081 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.074+0000 7f2ae1d9b640 1 -- 10.20.193.68:0/995863684 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055463573 0 0) 0x7f2ae4088330 con 0x7f2acc003680 2026-02-18T21:01:11.081 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.075+0000 7f2ae1d9b640 1 -- 10.20.193.68:0/995863684 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ad00034e0 con 0x7f2acc003680 2026-02-18T21:01:11.081 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.075+0000 7f2ae1d9b640 1 -- 10.20.193.68:0/995863684 <== mon.0 v1:10.20.193.68:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4189940918 0 0) 0x7f2ad00034e0 con 0x7f2acc003680 2026-02-18T21:01:11.081 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.075+0000 7f2ae1d9b640 1 -- 10.20.193.68:0/995863684 --> v1:10.20.193.68:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2acc008390 con 0x7f2acc003680 2026-02-18T21:01:11.081 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.075+0000 7f2ae1d9b640 1 -- 10.20.193.68:0/995863684 <== mon.0 v1:10.20.193.68:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 378130486 0 0) 0x7f2ad400c2f0 con 0x7f2acc003680 2026-02-18T21:01:11.081 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.075+0000 7f2ae1d9b640 1 -- 10.20.193.68:0/995863684 >> v1:10.20.193.68:6789/0 conn(0x7f2acc003680 legacy=0x7f2acc005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.082 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.075+0000 7f2ae1d9b640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2ad0003b10 0x7f2ad0003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.082 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.075+0000 7f2ae1d9b640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 0x7f2ad00047a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.082 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.075+0000 7f2ae1d9b640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 0x7f2ad0004f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.082 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.075+0000 7f2ae1d9b640 1 -- 10.20.193.68:0/995863684 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad000b9d0 con 0x7f2ad0003b10 2026-02-18T21:01:11.082 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.075+0000 7f2ae1d9b640 1 -- 10.20.193.68:0/995863684 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad000bb10 con 0x7f2ae4098d30 2026-02-18T21:01:11.082 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.075+0000 7f2ae1d9b640 1 -- 10.20.193.68:0/995863684 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad000bc50 con 0x7f2ae406ddc0 2026-02-18T21:01:11.083 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.075+0000 7f2ae2d9d640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2ad0003b10 0x7f2ad0003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.083 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.075+0000 7f2ae259c640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 0x7f2ad00047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.083 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.075+0000 7f2ae359e640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 0x7f2ad0004f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.083 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.075+0000 7f2ae2d9d640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 msgr2=0x7f2ad00047a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:11.083 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.075+0000 7f2ae2d9d640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ae406ddc0 0x7f2ad00047a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.083 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.075+0000 7f2ae2d9d640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 msgr2=0x7f2ad0004f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:11.083 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.075+0000 7f2ae2d9d640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae4098d30 0x7f2ad0004f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.083 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.075+0000 7f2ae2d9d640 1 -- 10.20.193.68:0/995863684 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad00034e0 con 0x7f2ad0003b10 2026-02-18T21:01:11.083 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.075+0000 7f2ae2d9d640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2ad0003b10 0x7f2ad0003ee0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4006f60 tx=0x7f2ad40304e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c89f126b6632e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:11.083 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.076+0000 7f2ae1d9b640 1 -- 10.20.193.68:0/995863684 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad403a400 con 0x7f2ad0003b10 2026-02-18T21:01:11.083 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.076+0000 7f2ae1d9b640 1 -- 10.20.193.68:0/995863684 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad4034070 con 0x7f2ad0003b10 2026-02-18T21:01:11.084 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.076+0000 7f2ae1d9b640 1 -- 10.20.193.68:0/995863684 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad403a5c0 con 0x7f2ad0003b10 2026-02-18T21:01:11.084 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.076+0000 7f2ae906d640 1 -- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2ad0003b10 msgr2=0x7f2ad0003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.084 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.076+0000 7f2ae906d640 1 --2- 10.20.193.68:0/995863684 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2ad0003b10 0x7f2ad0003ee0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4006f60 tx=0x7f2ad40304e0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.084 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.076+0000 7f2ae359e640 1 -- 10.20.193.68:0/995863684 reap_dead start 2026-02-18T21:01:11.084 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.076+0000 7f2ae906d640 1 -- 10.20.193.68:0/995863684 shutdown_connections 2026-02-18T21:01:11.084 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.076+0000 7f2ae906d640 1 -- 10.20.193.68:0/995863684 >> 10.20.193.68:0/995863684 conn(0x7f2ae409c020 msgr2=0x7f2ae406ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:11.084 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.076+0000 7f2ae906d640 1 -- 10.20.193.68:0/995863684 shutdown_connections 2026-02-18T21:01:11.084 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.076+0000 7f2ae906d640 1 -- 10.20.193.68:0/995863684 wait complete. 2026-02-18T21:01:11.084 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae906d640 1 Processor -- start 2026-02-18T21:01:11.084 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae906d640 1 -- start start 2026-02-18T21:01:11.084 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae906d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ad0003b10 0x7f2ae412bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.084 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae906d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae412c240 0x7f2ae4094270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.085 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae906d640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2ae40947b0 0x7f2ae4094c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.085 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae906d640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae4095d90 con 0x7f2ae40947b0 2026-02-18T21:01:11.085 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae906d640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae4097a60 con 0x7f2ae412c240 2026-02-18T21:01:11.085 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae906d640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae4097d10 con 0x7f2ad0003b10 2026-02-18T21:01:11.085 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae2d9d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ad0003b10 0x7f2ae412bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.085 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae359e640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2ae40947b0 0x7f2ae4094c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.085 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae2d9d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ad0003b10 0x7f2ae412bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60196/0 (socket says 10.20.193.68:60196) 2026-02-18T21:01:11.085 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae2d9d640 1 -- 10.20.193.68:0/499672732 learned_addr learned my addr 10.20.193.68:0/499672732 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:11.085 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae259c640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae412c240 0x7f2ae4094270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.085 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae359e640 1 -- 10.20.193.68:0/499672732 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ad0003b10 msgr2=0x7f2ae412bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.085 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae359e640 1 --2- 10.20.193.68:0/499672732 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ad0003b10 0x7f2ae412bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.086 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae359e640 1 -- 10.20.193.68:0/499672732 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae412c240 msgr2=0x7f2ae4094270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.086 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae359e640 1 --2- 10.20.193.68:0/499672732 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae412c240 0x7f2ae4094270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.086 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae359e640 1 -- 10.20.193.68:0/499672732 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae4096e00 con 0x7f2ae40947b0 2026-02-18T21:01:11.086 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae359e640 1 --2- 10.20.193.68:0/499672732 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2ae40947b0 0x7f2ae4094c50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40992d0 tx=0x7f2adc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:11.086 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2acb7fe640 1 -- 10.20.193.68:0/499672732 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc009aa0 con 0x7f2ae40947b0 2026-02-18T21:01:11.086 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2acb7fe640 1 -- 10.20.193.68:0/499672732 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc0148b0 con 0x7f2ae40947b0 2026-02-18T21:01:11.086 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae906d640 1 -- 10.20.193.68:0/499672732 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae40975e0 con 0x7f2ae40947b0 2026-02-18T21:01:11.086 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2acb7fe640 1 -- 10.20.193.68:0/499672732 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc014c50 con 0x7f2ae40947b0 2026-02-18T21:01:11.086 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2ae906d640 1 -- 10.20.193.68:0/499672732 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae41c2a70 con 0x7f2ae40947b0 2026-02-18T21:01:11.086 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2acb7fe640 1 -- 10.20.193.68:0/499672732 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f2adc003040 con 0x7f2ae40947b0 2026-02-18T21:01:11.086 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.077+0000 7f2acb7fe640 1 -- 10.20.193.68:0/499672732 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2adc020750 con 0x7f2ae40947b0 2026-02-18T21:01:11.087 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.078+0000 7f2ae906d640 1 -- 10.20.193.68:0/499672732 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae405f010 con 0x7f2ae40947b0 2026-02-18T21:01:11.087 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.079+0000 7f2acb7fe640 1 -- 10.20.193.68:0/499672732 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7f2adc03e990 con 0x7f2ae40947b0 2026-02-18T21:01:11.111 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.109+0000 7f2ae906d640 1 -- 10.20.193.68:0/499672732 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2ae4063430 con 0x7f2ae40947b0 2026-02-18T21:01:11.113 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.111+0000 7f2acb7fe640 1 -- 10.20.193.68:0/499672732 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2adc02d020 con 0x7f2ae40947b0 2026-02-18T21:01:11.113 INFO:teuthology.orchestra.run.trial068.stderr:adjusted tunables profile to default 2026-02-18T21:01:11.114 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.111+0000 7f2ae906d640 1 -- 10.20.193.68:0/499672732 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2ae40947b0 msgr2=0x7f2ae4094c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.114 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.111+0000 7f2ae906d640 1 --2- 10.20.193.68:0/499672732 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2ae40947b0 0x7f2ae4094c50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40992d0 tx=0x7f2adc00b040 comp rx=0 tx=0).stop 2026-02-18T21:01:11.114 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.111+0000 7f2ae906d640 1 -- 10.20.193.68:0/499672732 shutdown_connections 2026-02-18T21:01:11.114 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.111+0000 7f2ae906d640 1 --2- 10.20.193.68:0/499672732 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2ae40947b0 0x7f2ae4094c50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.114 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.111+0000 7f2ae906d640 1 --2- 10.20.193.68:0/499672732 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2ae412c240 0x7f2ae4094270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.114 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.111+0000 7f2ae906d640 1 --2- 10.20.193.68:0/499672732 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2ad0003b10 0x7f2ae412bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.114 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.111+0000 7f2ae906d640 1 -- 10.20.193.68:0/499672732 >> 10.20.193.68:0/499672732 conn(0x7f2ae409c020 msgr2=0x7f2ae408bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:11.115 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.112+0000 7f2ae906d640 1 -- 10.20.193.68:0/499672732 shutdown_connections 2026-02-18T21:01:11.115 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.112+0000 7f2ae906d640 1 -- 10.20.193.68:0/499672732 wait complete. 2026-02-18T21:01:11.121 INFO:tasks.ceph:check_enable_crimson: False 2026-02-18T21:01:11.121 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-18T21:01:11.122 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:01:11.122 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-18T21:01:11.148 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:01:11.148 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-18T21:01:11.212 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:01:11.212 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-18T21:01:11.277 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:01:11.277 DEBUG:teuthology.orchestra.run.trial068:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-18T21:01:11.342 DEBUG:teuthology.orchestra.run.trial068:> sudo ceph --cluster ceph osd new bb5f8e54-3a43-41d6-b266-aa412a7f170e 0 2026-02-18T21:01:11.445 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.441+0000 7fbccda1d640 1 Processor -- start 2026-02-18T21:01:11.446 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.441+0000 7fbccda1d640 1 -- start start 2026-02-18T21:01:11.446 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.441+0000 7fbccda1d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcc8096a50 0x7fbcc8096e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.446 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.441+0000 7fbccda1d640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fbcc8097360 0x7fbcc8129f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.446 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.441+0000 7fbccda1d640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc809a6b0 con 0x7fbcc812a480 2026-02-18T21:01:11.446 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.441+0000 7fbccda1d640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc8099b90 con 0x7fbcc8097360 2026-02-18T21:01:11.446 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.441+0000 7fbccda1d640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc8099400 con 0x7fbcc8096a50 2026-02-18T21:01:11.446 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.442+0000 7fbcc6ffd640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcc8096a50 0x7fbcc8096e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.446 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.442+0000 7fbcc67fc640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fbcc8097360 0x7fbcc8129f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.446 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.442+0000 7fbcc6ffd640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcc8096a50 0x7fbcc8096e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60206/0 (socket says 10.20.193.68:60206) 2026-02-18T21:01:11.447 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.442+0000 7fbcc6ffd640 1 -- 10.20.193.68:0/62406885 learned_addr learned my addr 10.20.193.68:0/62406885 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:11.447 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.442+0000 7fbcc6ffd640 1 -- 10.20.193.68:0/62406885 >> v2:10.20.193.68:3300/0 conn(0x7fbcc8097360 msgr2=0x7fbcc8129f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:11.447 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.442+0000 7fbcc6ffd640 1 --2- 10.20.193.68:0/62406885 >> v2:10.20.193.68:3300/0 conn(0x7fbcc8097360 0x7fbcc8129f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.447 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.442+0000 7fbcc6ffd640 1 -- 10.20.193.68:0/62406885 >> v1:10.20.193.68:6789/0 conn(0x7fbcc812a480 legacy=0x7fbcc8131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.447 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.442+0000 7fbcc6ffd640 1 -- 10.20.193.68:0/62406885 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc809a3f0 con 0x7fbcc8096a50 2026-02-18T21:01:11.447 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.442+0000 7fbcc6ffd640 1 --2- 10.20.193.68:0/62406885 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcc8096a50 0x7fbcc8096e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8009910 tx=0x7fbcb802ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ae379b76d0bdbd7 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:11.447 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.442+0000 7fbcc5ffb640 1 -- 10.20.193.68:0/62406885 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb802f970 con 0x7fbcc8096a50 2026-02-18T21:01:11.447 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.442+0000 7fbcc5ffb640 1 -- 10.20.193.68:0/62406885 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb802fad0 con 0x7fbcc8096a50 2026-02-18T21:01:11.447 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.442+0000 7fbcc5ffb640 1 -- 10.20.193.68:0/62406885 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8037440 con 0x7fbcc8096a50 2026-02-18T21:01:11.447 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.443+0000 7fbccda1d640 1 -- 10.20.193.68:0/62406885 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcc8096a50 msgr2=0x7fbcc8096e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.447 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.443+0000 7fbccda1d640 1 --2- 10.20.193.68:0/62406885 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcc8096a50 0x7fbcc8096e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8009910 tx=0x7fbcb802ee10 comp rx=0 tx=0).stop 2026-02-18T21:01:11.447 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.443+0000 7fbccda1d640 1 -- 10.20.193.68:0/62406885 shutdown_connections 2026-02-18T21:01:11.448 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.443+0000 7fbccda1d640 1 --2- 10.20.193.68:0/62406885 >> v2:10.20.193.68:3300/0 conn(0x7fbcc8097360 0x7fbcc8129f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.448 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.443+0000 7fbccda1d640 1 --2- 10.20.193.68:0/62406885 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcc8096a50 0x7fbcc8096e20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.448 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.443+0000 7fbccda1d640 1 -- 10.20.193.68:0/62406885 >> 10.20.193.68:0/62406885 conn(0x7fbcc809d940 msgr2=0x7fbcc809dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:11.448 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.443+0000 7fbccda1d640 1 -- 10.20.193.68:0/62406885 shutdown_connections 2026-02-18T21:01:11.448 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.443+0000 7fbccda1d640 1 -- 10.20.193.68:0/62406885 wait complete. 2026-02-18T21:01:11.448 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.443+0000 7fbccda1d640 1 Processor -- start 2026-02-18T21:01:11.448 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbccda1d640 1 -- start start 2026-02-18T21:01:11.451 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbccda1d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbcc8096a50 0x7fbcc81be770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.451 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbccda1d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcc8097360 0x7fbcc81becb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.451 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbccda1d640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbcc812a480 0x7fbcc81bf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.451 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbccda1d640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc8121c50 con 0x7fbcc812a480 2026-02-18T21:01:11.451 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbccda1d640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc8120a80 con 0x7fbcc8096a50 2026-02-18T21:01:11.451 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbccda1d640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc8121e80 con 0x7fbcc8097360 2026-02-18T21:01:11.451 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbcc67fc640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcc8097360 0x7fbcc81becb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.451 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbcc77fe640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbcc812a480 0x7fbcc81bf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.452 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbcc67fc640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcc8097360 0x7fbcc81becb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60208/0 (socket says 10.20.193.68:60208) 2026-02-18T21:01:11.452 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbcc67fc640 1 -- 10.20.193.68:0/3633559654 learned_addr learned my addr 10.20.193.68:0/3633559654 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:11.452 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbcc6ffd640 1 --2- 10.20.193.68:0/3633559654 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbcc8096a50 0x7fbcc81be770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.452 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbcc77fe640 1 -- 10.20.193.68:0/3633559654 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcc8097360 msgr2=0x7fbcc81becb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.452 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbcc77fe640 1 --2- 10.20.193.68:0/3633559654 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcc8097360 0x7fbcc81becb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.452 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbcc77fe640 1 -- 10.20.193.68:0/3633559654 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbcc8096a50 msgr2=0x7fbcc81be770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.452 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbcc77fe640 1 --2- 10.20.193.68:0/3633559654 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbcc8096a50 0x7fbcc81be770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.452 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbcc77fe640 1 -- 10.20.193.68:0/3633559654 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb8009450 con 0x7fbcc812a480 2026-02-18T21:01:11.452 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbcc77fe640 1 --2- 10.20.193.68:0/3633559654 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbcc812a480 0x7fbcc81bf1f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0007fd0 tx=0x7fbcc0001660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:11.452 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbcaffff640 1 -- 10.20.193.68:0/3633559654 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc000a820 con 0x7fbcc812a480 2026-02-18T21:01:11.452 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbcaffff640 1 -- 10.20.193.68:0/3633559654 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc000a9a0 con 0x7fbcc812a480 2026-02-18T21:01:11.452 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbccda1d640 1 -- 10.20.193.68:0/3633559654 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc8120180 con 0x7fbcc812a480 2026-02-18T21:01:11.452 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbcaffff640 1 -- 10.20.193.68:0/3633559654 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc000ada0 con 0x7fbcc812a480 2026-02-18T21:01:11.453 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbccda1d640 1 -- 10.20.193.68:0/3633559654 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc811e920 con 0x7fbcc812a480 2026-02-18T21:01:11.453 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbcaffff640 1 -- 10.20.193.68:0/3633559654 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fbcc0003030 con 0x7fbcc812a480 2026-02-18T21:01:11.453 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.444+0000 7fbcaffff640 1 -- 10.20.193.68:0/3633559654 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fbcc001b400 con 0x7fbcc812a480 2026-02-18T21:01:11.453 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.445+0000 7fbccda1d640 1 -- 10.20.193.68:0/3633559654 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc805f010 con 0x7fbcc812a480 2026-02-18T21:01:11.453 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.446+0000 7fbcaffff640 1 -- 10.20.193.68:0/3633559654 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7fbcc0012630 con 0x7fbcc812a480 2026-02-18T21:01:11.480 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.478+0000 7fbccda1d640 1 -- 10.20.193.68:0/3633559654 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bb5f8e54-3a43-41d6-b266-aa412a7f170e", "id": 0} v 0) v1 -- 0x7fbcc81298f0 con 0x7fbcc812a480 2026-02-18T21:01:11.482 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.480+0000 7fbcaffff640 1 -- 10.20.193.68:0/3633559654 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bb5f8e54-3a43-41d6-b266-aa412a7f170e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbcc001b5c0 con 0x7fbcc812a480 2026-02-18T21:01:11.482 INFO:teuthology.orchestra.run.trial068.stdout:0 2026-02-18T21:01:11.483 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.480+0000 7fbccda1d640 1 -- 10.20.193.68:0/3633559654 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbcc812a480 msgr2=0x7fbcc81bf1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.483 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.480+0000 7fbccda1d640 1 --2- 10.20.193.68:0/3633559654 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbcc812a480 0x7fbcc81bf1f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0007fd0 tx=0x7fbcc0001660 comp rx=0 tx=0).stop 2026-02-18T21:01:11.483 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.480+0000 7fbccda1d640 1 -- 10.20.193.68:0/3633559654 shutdown_connections 2026-02-18T21:01:11.483 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.480+0000 7fbccda1d640 1 --2- 10.20.193.68:0/3633559654 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbcc812a480 0x7fbcc81bf1f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.483 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.480+0000 7fbccda1d640 1 --2- 10.20.193.68:0/3633559654 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcc8097360 0x7fbcc81becb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.483 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.480+0000 7fbccda1d640 1 --2- 10.20.193.68:0/3633559654 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbcc8096a50 0x7fbcc81be770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.484 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.480+0000 7fbccda1d640 1 -- 10.20.193.68:0/3633559654 >> 10.20.193.68:0/3633559654 conn(0x7fbcc809d940 msgr2=0x7fbcc81177c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:11.484 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.481+0000 7fbccda1d640 1 -- 10.20.193.68:0/3633559654 shutdown_connections 2026-02-18T21:01:11.484 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.481+0000 7fbccda1d640 1 -- 10.20.193.68:0/3633559654 wait complete. 2026-02-18T21:01:11.489 DEBUG:teuthology.orchestra.run.trial068:> sudo ceph --cluster ceph osd new e26d8762-250e-42e7-8768-23caa22edb04 1 2026-02-18T21:01:11.557 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.550+0000 7fcd8dadb640 1 Processor -- start 2026-02-18T21:01:11.557 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.550+0000 7fcd8dadb640 1 -- start start 2026-02-18T21:01:11.557 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd8dadb640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd88096a50 0x7fcd88096e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.557 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd8dadb640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd88097360 0x7fcd88129f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.557 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd8dadb640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fcd8812a480 0x7fcd8812a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.558 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd8dadb640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd88099b90 con 0x7fcd8812a480 2026-02-18T21:01:11.558 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd8dadb640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8812ae40 con 0x7fcd88096a50 2026-02-18T21:01:11.558 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd8dadb640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8809a6b0 con 0x7fcd88097360 2026-02-18T21:01:11.558 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd877fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd88096a50 0x7fcd88096e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.558 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd7ffff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd88097360 0x7fcd88129f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.558 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd7ffff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd88097360 0x7fcd88129f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60214/0 (socket says 10.20.193.68:60214) 2026-02-18T21:01:11.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd7ffff640 1 -- 10.20.193.68:0/2050677459 learned_addr learned my addr 10.20.193.68:0/2050677459 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:11.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd87fff640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fcd8812a480 0x7fcd8812a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd877fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd88096a50 0x7fcd88096e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:55656/0 (socket says 10.20.193.68:55656) 2026-02-18T21:01:11.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd7ffff640 1 -- 10.20.193.68:0/2050677459 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd88096a50 msgr2=0x7fcd88096e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:11.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd7ffff640 1 --2- 10.20.193.68:0/2050677459 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd88096a50 0x7fcd88096e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd7ffff640 1 -- 10.20.193.68:0/2050677459 >> v2:10.20.193.68:3300/0 conn(0x7fcd8812a480 msgr2=0x7fcd8812a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:11.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd7ffff640 1 --2- 10.20.193.68:0/2050677459 >> v2:10.20.193.68:3300/0 conn(0x7fcd8812a480 0x7fcd8812a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd7ffff640 1 -- 10.20.193.68:0/2050677459 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd88099400 con 0x7fcd88097360 2026-02-18T21:01:11.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd7ffff640 1 --2- 10.20.193.68:0/2050677459 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd88097360 0x7fcd88129f40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcd70009940 tx=0x7fcd7002ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a07dc0d2be0f12b server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:11.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd86ffd640 1 -- 10.20.193.68:0/2050677459 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7002f950 con 0x7fcd88097360 2026-02-18T21:01:11.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd86ffd640 1 -- 10.20.193.68:0/2050677459 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7002fab0 con 0x7fcd88097360 2026-02-18T21:01:11.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.551+0000 7fcd86ffd640 1 -- 10.20.193.68:0/2050677459 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7002fe50 con 0x7fcd88097360 2026-02-18T21:01:11.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.552+0000 7fcd8dadb640 1 -- 10.20.193.68:0/2050677459 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd88097360 msgr2=0x7fcd88129f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.552+0000 7fcd8dadb640 1 --2- 10.20.193.68:0/2050677459 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd88097360 0x7fcd88129f40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcd70009940 tx=0x7fcd7002ee80 comp rx=0 tx=0).stop 2026-02-18T21:01:11.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.552+0000 7fcd8dadb640 1 -- 10.20.193.68:0/2050677459 shutdown_connections 2026-02-18T21:01:11.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.552+0000 7fcd8dadb640 1 --2- 10.20.193.68:0/2050677459 >> v2:10.20.193.68:3300/0 conn(0x7fcd8812a480 0x7fcd8812a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.552+0000 7fcd8dadb640 1 --2- 10.20.193.68:0/2050677459 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd88097360 0x7fcd88129f40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.552+0000 7fcd8dadb640 1 --2- 10.20.193.68:0/2050677459 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd88096a50 0x7fcd88096e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.552+0000 7fcd8dadb640 1 -- 10.20.193.68:0/2050677459 >> 10.20.193.68:0/2050677459 conn(0x7fcd8809d940 msgr2=0x7fcd8809dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:11.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.552+0000 7fcd8dadb640 1 -- 10.20.193.68:0/2050677459 shutdown_connections 2026-02-18T21:01:11.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.552+0000 7fcd8dadb640 1 -- 10.20.193.68:0/2050677459 wait complete. 2026-02-18T21:01:11.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.552+0000 7fcd8dadb640 1 Processor -- start 2026-02-18T21:01:11.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.552+0000 7fcd8dadb640 1 -- start start 2026-02-18T21:01:11.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.552+0000 7fcd8dadb640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fcd88096a50 0x7fcd88119220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.552+0000 7fcd8dadb640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd88097360 0x7fcd88119760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.552+0000 7fcd8dadb640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd8812a480 0x7fcd88119ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.552+0000 7fcd8dadb640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8811ae10 con 0x7fcd88096a50 2026-02-18T21:01:11.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.552+0000 7fcd8dadb640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8811a2d0 con 0x7fcd8812a480 2026-02-18T21:01:11.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.552+0000 7fcd8dadb640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8811c9c0 con 0x7fcd88097360 2026-02-18T21:01:11.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.553+0000 7fcd877fe640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fcd88096a50 0x7fcd88119220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.553+0000 7fcd877fe640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fcd88096a50 0x7fcd88119220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:36992/0 (socket says 10.20.193.68:36992) 2026-02-18T21:01:11.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.553+0000 7fcd7ffff640 1 --2- 10.20.193.68:0/1223494070 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd88097360 0x7fcd88119760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.553+0000 7fcd877fe640 1 -- 10.20.193.68:0/1223494070 learned_addr learned my addr 10.20.193.68:0/1223494070 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:11.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.553+0000 7fcd87fff640 1 --2- 10.20.193.68:0/1223494070 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd8812a480 0x7fcd88119ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.553+0000 7fcd877fe640 1 -- 10.20.193.68:0/1223494070 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd88097360 msgr2=0x7fcd88119760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.553+0000 7fcd877fe640 1 --2- 10.20.193.68:0/1223494070 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd88097360 0x7fcd88119760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.553+0000 7fcd877fe640 1 -- 10.20.193.68:0/1223494070 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd8812a480 msgr2=0x7fcd88119ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.553+0000 7fcd877fe640 1 --2- 10.20.193.68:0/1223494070 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd8812a480 0x7fcd88119ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.553+0000 7fcd877fe640 1 -- 10.20.193.68:0/1223494070 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd70009450 con 0x7fcd88096a50 2026-02-18T21:01:11.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.553+0000 7fcd87fff640 1 --2- 10.20.193.68:0/1223494070 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd8812a480 0x7fcd88119ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:11.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.553+0000 7fcd877fe640 1 --2- 10.20.193.68:0/1223494070 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fcd88096a50 0x7fcd88119220 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800ea20 tx=0x7fcd780090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:11.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.553+0000 7fcd84ff9640 1 -- 10.20.193.68:0/1223494070 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7800ca70 con 0x7fcd88096a50 2026-02-18T21:01:11.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.553+0000 7fcd84ff9640 1 -- 10.20.193.68:0/1223494070 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7800cbd0 con 0x7fcd88096a50 2026-02-18T21:01:11.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.553+0000 7fcd8dadb640 1 -- 10.20.193.68:0/1223494070 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8811c5f0 con 0x7fcd88096a50 2026-02-18T21:01:11.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.553+0000 7fcd84ff9640 1 -- 10.20.193.68:0/1223494070 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78013470 con 0x7fcd88096a50 2026-02-18T21:01:11.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.553+0000 7fcd8dadb640 1 -- 10.20.193.68:0/1223494070 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd881be3b0 con 0x7fcd88096a50 2026-02-18T21:01:11.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.553+0000 7fcd84ff9640 1 -- 10.20.193.68:0/1223494070 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fcd78005970 con 0x7fcd88096a50 2026-02-18T21:01:11.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.553+0000 7fcd84ff9640 1 -- 10.20.193.68:0/1223494070 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fcd78006020 con 0x7fcd88096a50 2026-02-18T21:01:11.563 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.554+0000 7fcd8dadb640 1 -- 10.20.193.68:0/1223494070 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8805f010 con 0x7fcd88096a50 2026-02-18T21:01:11.563 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.555+0000 7fcd84ff9640 1 -- 10.20.193.68:0/1223494070 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7fcd78021060 con 0x7fcd88096a50 2026-02-18T21:01:11.588 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.586+0000 7fcd8dadb640 1 -- 10.20.193.68:0/1223494070 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e26d8762-250e-42e7-8768-23caa22edb04", "id": 1} v 0) v1 -- 0x7fcd88063290 con 0x7fcd88096a50 2026-02-18T21:01:11.590 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.588+0000 7fcd84ff9640 1 -- 10.20.193.68:0/1223494070 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e26d8762-250e-42e7-8768-23caa22edb04", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcd78017070 con 0x7fcd88096a50 2026-02-18T21:01:11.590 INFO:teuthology.orchestra.run.trial068.stdout:1 2026-02-18T21:01:11.591 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.589+0000 7fcd8dadb640 1 -- 10.20.193.68:0/1223494070 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fcd88096a50 msgr2=0x7fcd88119220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.592 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.589+0000 7fcd8dadb640 1 --2- 10.20.193.68:0/1223494070 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fcd88096a50 0x7fcd88119220 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800ea20 tx=0x7fcd780090f0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.592 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.589+0000 7fcd8dadb640 1 -- 10.20.193.68:0/1223494070 shutdown_connections 2026-02-18T21:01:11.592 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.589+0000 7fcd8dadb640 1 --2- 10.20.193.68:0/1223494070 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd8812a480 0x7fcd88119ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.592 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.589+0000 7fcd8dadb640 1 --2- 10.20.193.68:0/1223494070 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd88097360 0x7fcd88119760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.592 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.589+0000 7fcd8dadb640 1 --2- 10.20.193.68:0/1223494070 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fcd88096a50 0x7fcd88119220 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.592 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.589+0000 7fcd8dadb640 1 -- 10.20.193.68:0/1223494070 >> 10.20.193.68:0/1223494070 conn(0x7fcd8809d940 msgr2=0x7fcd881b1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:11.592 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.589+0000 7fcd8dadb640 1 -- 10.20.193.68:0/1223494070 shutdown_connections 2026-02-18T21:01:11.592 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.589+0000 7fcd8dadb640 1 -- 10.20.193.68:0/1223494070 wait complete. 2026-02-18T21:01:11.598 DEBUG:teuthology.orchestra.run.trial068:> sudo ceph --cluster ceph osd new 568ee96d-39ac-4d79-92bb-d1f3f12601b6 2 2026-02-18T21:01:11.664 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.658+0000 7f9177bc3640 1 Processor -- start 2026-02-18T21:01:11.665 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.658+0000 7f9177bc3640 1 -- start start 2026-02-18T21:01:11.665 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.658+0000 7f9177bc3640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9170096450 0x7f9170096820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.665 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.658+0000 7f9177bc3640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f9170097150 0x7f9170131b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.665 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.658+0000 7f9177bc3640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917006a310 con 0x7f9170096d60 2026-02-18T21:01:11.665 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.658+0000 7f9177bc3640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9170069e10 con 0x7f9170097150 2026-02-18T21:01:11.665 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.658+0000 7f9177bc3640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917006a5e0 con 0x7f9170096450 2026-02-18T21:01:11.665 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.658+0000 7f917595f640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9170096450 0x7f9170096820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.665 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.659+0000 7f917595f640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9170096450 0x7f9170096820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:55672/0 (socket says 10.20.193.68:55672) 2026-02-18T21:01:11.665 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.659+0000 7f917595f640 1 -- 10.20.193.68:0/2152154299 learned_addr learned my addr 10.20.193.68:0/2152154299 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:11.665 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.659+0000 7f9176160640 1 --2- 10.20.193.68:0/2152154299 >> v2:10.20.193.68:3300/0 conn(0x7f9170097150 0x7f9170131b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.666 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.659+0000 7f917595f640 1 -- 10.20.193.68:0/2152154299 >> v2:10.20.193.68:3300/0 conn(0x7f9170097150 msgr2=0x7f9170131b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:11.666 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.659+0000 7f917595f640 1 --2- 10.20.193.68:0/2152154299 >> v2:10.20.193.68:3300/0 conn(0x7f9170097150 0x7f9170131b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.666 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.659+0000 7f917595f640 1 -- 10.20.193.68:0/2152154299 >> v1:10.20.193.68:6789/0 conn(0x7f9170096d60 legacy=0x7f917012e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.666 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.659+0000 7f917595f640 1 -- 10.20.193.68:0/2152154299 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9170069550 con 0x7f9170096450 2026-02-18T21:01:11.666 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.659+0000 7f917595f640 1 --2- 10.20.193.68:0/2152154299 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9170096450 0x7f9170096820 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f916c009910 tx=0x7f916c02ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec83b94945e7aed7 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:11.666 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.659+0000 7f917495d640 1 -- 10.20.193.68:0/2152154299 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c02f970 con 0x7f9170096450 2026-02-18T21:01:11.666 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.659+0000 7f917495d640 1 -- 10.20.193.68:0/2152154299 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c02fad0 con 0x7f9170096450 2026-02-18T21:01:11.666 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.659+0000 7f917495d640 1 -- 10.20.193.68:0/2152154299 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c037440 con 0x7f9170096450 2026-02-18T21:01:11.666 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.659+0000 7f9177bc3640 1 -- 10.20.193.68:0/2152154299 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9170096450 msgr2=0x7f9170096820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.666 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.659+0000 7f9177bc3640 1 --2- 10.20.193.68:0/2152154299 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9170096450 0x7f9170096820 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f916c009910 tx=0x7f916c02ee10 comp rx=0 tx=0).stop 2026-02-18T21:01:11.666 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.659+0000 7f9177bc3640 1 -- 10.20.193.68:0/2152154299 shutdown_connections 2026-02-18T21:01:11.666 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.659+0000 7f9177bc3640 1 --2- 10.20.193.68:0/2152154299 >> v2:10.20.193.68:3300/0 conn(0x7f9170097150 0x7f9170131b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.659+0000 7f9177bc3640 1 --2- 10.20.193.68:0/2152154299 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9170096450 0x7f9170096820 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.659+0000 7f9177bc3640 1 -- 10.20.193.68:0/2152154299 >> 10.20.193.68:0/2152154299 conn(0x7f917009b7f0 msgr2=0x7f917009bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:11.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.660+0000 7f9177bc3640 1 -- 10.20.193.68:0/2152154299 shutdown_connections 2026-02-18T21:01:11.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.660+0000 7f9177bc3640 1 -- 10.20.193.68:0/2152154299 wait complete. 2026-02-18T21:01:11.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.660+0000 7f9177bc3640 1 Processor -- start 2026-02-18T21:01:11.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.660+0000 7f9177bc3640 1 -- start start 2026-02-18T21:01:11.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.660+0000 7f9177bc3640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9170096450 0x7f91701318a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.660+0000 7f9177bc3640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9170096d60 0x7f9170120350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.660+0000 7f9177bc3640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9170097150 0x7f9170120890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.660+0000 7f9177bc3640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9170122960 con 0x7f9170096d60 2026-02-18T21:01:11.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.660+0000 7f9177bc3640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917009ac00 con 0x7f9170097150 2026-02-18T21:01:11.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.660+0000 7f9177bc3640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9170122b90 con 0x7f9170096450 2026-02-18T21:01:11.668 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.660+0000 7f9176160640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9170097150 0x7f9170120890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.668 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.660+0000 7f917515e640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9170096d60 0x7f9170120350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.668 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.660+0000 7f917595f640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9170096450 0x7f91701318a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.668 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.660+0000 7f9176160640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9170097150 0x7f9170120890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:55674/0 (socket says 10.20.193.68:55674) 2026-02-18T21:01:11.668 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.660+0000 7f9176160640 1 -- 10.20.193.68:0/4194610361 learned_addr learned my addr 10.20.193.68:0/4194610361 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:11.668 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.661+0000 7f917515e640 1 -- 10.20.193.68:0/4194610361 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9170096450 msgr2=0x7f91701318a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.668 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.661+0000 7f917515e640 1 --2- 10.20.193.68:0/4194610361 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9170096450 0x7f91701318a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.668 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.661+0000 7f917515e640 1 -- 10.20.193.68:0/4194610361 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9170097150 msgr2=0x7f9170120890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.668 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.661+0000 7f917515e640 1 --2- 10.20.193.68:0/4194610361 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9170097150 0x7f9170120890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.668 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.661+0000 7f917515e640 1 -- 10.20.193.68:0/4194610361 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c009450 con 0x7f9170096d60 2026-02-18T21:01:11.668 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.661+0000 7f9176160640 1 --2- 10.20.193.68:0/4194610361 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9170097150 0x7f9170120890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:11.669 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.661+0000 7f917515e640 1 --2- 10.20.193.68:0/4194610361 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9170096d60 0x7f9170120350 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f91700958b0 tx=0x7f9160007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:11.669 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.661+0000 7f91667fc640 1 -- 10.20.193.68:0/4194610361 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9160012630 con 0x7f9170096d60 2026-02-18T21:01:11.669 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.661+0000 7f91667fc640 1 -- 10.20.193.68:0/4194610361 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9160012790 con 0x7f9170096d60 2026-02-18T21:01:11.669 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.661+0000 7f9177bc3640 1 -- 10.20.193.68:0/4194610361 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917006f4b0 con 0x7f9170096d60 2026-02-18T21:01:11.669 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.661+0000 7f91667fc640 1 -- 10.20.193.68:0/4194610361 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9160012b30 con 0x7f9170096d60 2026-02-18T21:01:11.669 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.661+0000 7f9177bc3640 1 -- 10.20.193.68:0/4194610361 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9170131ef0 con 0x7f9170096d60 2026-02-18T21:01:11.670 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.661+0000 7f91667fc640 1 -- 10.20.193.68:0/4194610361 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f916001b400 con 0x7f9170096d60 2026-02-18T21:01:11.670 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.661+0000 7f91667fc640 1 -- 10.20.193.68:0/4194610361 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f916001bae0 con 0x7f9170096d60 2026-02-18T21:01:11.670 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.661+0000 7f9177bc3640 1 -- 10.20.193.68:0/4194610361 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917005f010 con 0x7f9170096d60 2026-02-18T21:01:11.670 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.663+0000 7f91667fc640 1 -- 10.20.193.68:0/4194610361 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7f916001b6b0 con 0x7f9170096d60 2026-02-18T21:01:11.697 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.695+0000 7f9177bc3640 1 -- 10.20.193.68:0/4194610361 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd new", "uuid": "568ee96d-39ac-4d79-92bb-d1f3f12601b6", "id": 2} v 0) v1 -- 0x7f9170099e50 con 0x7f9170096d60 2026-02-18T21:01:11.699 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.697+0000 7f91667fc640 1 -- 10.20.193.68:0/4194610361 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "568ee96d-39ac-4d79-92bb-d1f3f12601b6", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9160025480 con 0x7f9170096d60 2026-02-18T21:01:11.699 INFO:teuthology.orchestra.run.trial068.stdout:2 2026-02-18T21:01:11.700 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.698+0000 7f9177bc3640 1 -- 10.20.193.68:0/4194610361 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9170096d60 msgr2=0x7f9170120350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.700 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.698+0000 7f9177bc3640 1 --2- 10.20.193.68:0/4194610361 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9170096d60 0x7f9170120350 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f91700958b0 tx=0x7f9160007e10 comp rx=0 tx=0).stop 2026-02-18T21:01:11.700 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.698+0000 7f9177bc3640 1 -- 10.20.193.68:0/4194610361 shutdown_connections 2026-02-18T21:01:11.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.698+0000 7f9177bc3640 1 --2- 10.20.193.68:0/4194610361 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9170097150 0x7f9170120890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.698+0000 7f9177bc3640 1 --2- 10.20.193.68:0/4194610361 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9170096d60 0x7f9170120350 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.698+0000 7f9177bc3640 1 --2- 10.20.193.68:0/4194610361 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9170096450 0x7f91701318a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.698+0000 7f9177bc3640 1 -- 10.20.193.68:0/4194610361 >> 10.20.193.68:0/4194610361 conn(0x7f917009b7f0 msgr2=0x7f9170091260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:11.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.698+0000 7f9177bc3640 1 -- 10.20.193.68:0/4194610361 shutdown_connections 2026-02-18T21:01:11.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.698+0000 7f9177bc3640 1 -- 10.20.193.68:0/4194610361 wait complete. 2026-02-18T21:01:11.707 DEBUG:teuthology.orchestra.run.trial068:> sudo ceph --cluster ceph osd new 765a38cd-f526-4aba-b94e-c57076ca6c72 3 2026-02-18T21:01:11.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.767+0000 7fcd95d6e640 1 Processor -- start 2026-02-18T21:01:11.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.767+0000 7fcd95d6e640 1 -- start start 2026-02-18T21:01:11.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.767+0000 7fcd95d6e640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fcd90063090 0x7fcd900952c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.767+0000 7fcd95d6e640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd90095800 0x7fcd90095c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.767+0000 7fcd95d6e640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd9012ea70 0x7fcd90130e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.767+0000 7fcd95d6e640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9006ad80 con 0x7fcd90063090 2026-02-18T21:01:11.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.767+0000 7fcd95d6e640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd90093f30 con 0x7fcd90095800 2026-02-18T21:01:11.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.767+0000 7fcd95d6e640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd90096150 con 0x7fcd9012ea70 2026-02-18T21:01:11.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.767+0000 7fcd8f7fe640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fcd90063090 0x7fcd900952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.767+0000 7fcd87fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd90095800 0x7fcd90095c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.767+0000 7fcd8ffff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd9012ea70 0x7fcd90130e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.767+0000 7fcd8f7fe640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fcd90063090 0x7fcd900952c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:37028/0 (socket says 10.20.193.68:37028) 2026-02-18T21:01:11.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.767+0000 7fcd8f7fe640 1 -- 10.20.193.68:0/1583447665 learned_addr learned my addr 10.20.193.68:0/1583447665 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:11.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.767+0000 7fcd87fff640 1 -- 10.20.193.68:0/1583447665 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd9012ea70 msgr2=0x7fcd90130e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:11.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.767+0000 7fcd87fff640 1 --2- 10.20.193.68:0/1583447665 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd9012ea70 0x7fcd90130e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.767+0000 7fcd87fff640 1 -- 10.20.193.68:0/1583447665 >> v2:10.20.193.68:3300/0 conn(0x7fcd90063090 msgr2=0x7fcd900952c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:11.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.767+0000 7fcd87fff640 1 --2- 10.20.193.68:0/1583447665 >> v2:10.20.193.68:3300/0 conn(0x7fcd90063090 0x7fcd900952c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.767+0000 7fcd87fff640 1 -- 10.20.193.68:0/1583447665 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9006be80 con 0x7fcd90095800 2026-02-18T21:01:11.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.768+0000 7fcd87fff640 1 --2- 10.20.193.68:0/1583447665 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd90095800 0x7fcd90095c10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcd780098b0 tx=0x7fcd7802edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51d23477b79dab91 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:11.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.768+0000 7fcd8effd640 1 -- 10.20.193.68:0/1583447665 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7802f890 con 0x7fcd90095800 2026-02-18T21:01:11.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.768+0000 7fcd8effd640 1 -- 10.20.193.68:0/1583447665 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7802f9f0 con 0x7fcd90095800 2026-02-18T21:01:11.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.768+0000 7fcd8effd640 1 -- 10.20.193.68:0/1583447665 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7802fd90 con 0x7fcd90095800 2026-02-18T21:01:11.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.768+0000 7fcd95d6e640 1 -- 10.20.193.68:0/1583447665 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd90095800 msgr2=0x7fcd90095c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.768+0000 7fcd95d6e640 1 --2- 10.20.193.68:0/1583447665 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd90095800 0x7fcd90095c10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcd780098b0 tx=0x7fcd7802edc0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.768+0000 7fcd95d6e640 1 -- 10.20.193.68:0/1583447665 shutdown_connections 2026-02-18T21:01:11.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.768+0000 7fcd95d6e640 1 --2- 10.20.193.68:0/1583447665 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd90095800 0x7fcd90095c10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.768+0000 7fcd95d6e640 1 --2- 10.20.193.68:0/1583447665 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd9012ea70 0x7fcd90130e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.768+0000 7fcd95d6e640 1 --2- 10.20.193.68:0/1583447665 >> v2:10.20.193.68:3300/0 conn(0x7fcd90063090 0x7fcd900952c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.768+0000 7fcd95d6e640 1 -- 10.20.193.68:0/1583447665 >> 10.20.193.68:0/1583447665 conn(0x7fcd900963b0 msgr2=0x7fcd900967b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:11.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.768+0000 7fcd95d6e640 1 -- 10.20.193.68:0/1583447665 shutdown_connections 2026-02-18T21:01:11.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.768+0000 7fcd95d6e640 1 -- 10.20.193.68:0/1583447665 wait complete. 2026-02-18T21:01:11.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.768+0000 7fcd95d6e640 1 Processor -- start 2026-02-18T21:01:11.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.768+0000 7fcd95d6e640 1 -- start start 2026-02-18T21:01:11.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd95d6e640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd90063090 0x7fcd9008fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd95d6e640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd90095800 0x7fcd90090340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.777 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd95d6e640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fcd9012ea70 0x7fcd90090880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.777 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd95d6e640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd90093130 con 0x7fcd9012ea70 2026-02-18T21:01:11.777 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd95d6e640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9011ea30 con 0x7fcd90095800 2026-02-18T21:01:11.777 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd95d6e640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd90092950 con 0x7fcd90063090 2026-02-18T21:01:11.777 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd8f7fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd90063090 0x7fcd9008fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.777 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd87fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd90095800 0x7fcd90090340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.777 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd8f7fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd90063090 0x7fcd9008fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60240/0 (socket says 10.20.193.68:60240) 2026-02-18T21:01:11.777 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd8f7fe640 1 -- 10.20.193.68:0/3457574682 learned_addr learned my addr 10.20.193.68:0/3457574682 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:11.777 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd8ffff640 1 --2- 10.20.193.68:0/3457574682 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fcd9012ea70 0x7fcd90090880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.777 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd8f7fe640 1 -- 10.20.193.68:0/3457574682 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd90095800 msgr2=0x7fcd90090340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.777 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd8f7fe640 1 --2- 10.20.193.68:0/3457574682 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd90095800 0x7fcd90090340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.777 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd8f7fe640 1 -- 10.20.193.68:0/3457574682 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fcd9012ea70 msgr2=0x7fcd90090880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.778 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd8f7fe640 1 --2- 10.20.193.68:0/3457574682 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fcd9012ea70 0x7fcd90090880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.778 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd8f7fe640 1 -- 10.20.193.68:0/3457574682 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd78009390 con 0x7fcd90063090 2026-02-18T21:01:11.778 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd87fff640 1 --2- 10.20.193.68:0/3457574682 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd90095800 0x7fcd90090340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:11.778 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd8ffff640 1 --2- 10.20.193.68:0/3457574682 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fcd9012ea70 0x7fcd90090880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:11.778 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd8f7fe640 1 --2- 10.20.193.68:0/3457574682 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd90063090 0x7fcd9008fe00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000ea20 tx=0x7fcd800091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:11.778 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd8cff9640 1 -- 10.20.193.68:0/3457574682 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd800095a0 con 0x7fcd90063090 2026-02-18T21:01:11.778 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd8cff9640 1 -- 10.20.193.68:0/3457574682 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8000ca10 con 0x7fcd90063090 2026-02-18T21:01:11.778 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd95d6e640 1 -- 10.20.193.68:0/3457574682 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd90092100 con 0x7fcd90063090 2026-02-18T21:01:11.778 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd8cff9640 1 -- 10.20.193.68:0/3457574682 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8000cdd0 con 0x7fcd90063090 2026-02-18T21:01:11.778 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd95d6e640 1 -- 10.20.193.68:0/3457574682 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd90090fe0 con 0x7fcd90063090 2026-02-18T21:01:11.778 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd8cff9640 1 -- 10.20.193.68:0/3457574682 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fcd80005970 con 0x7fcd90063090 2026-02-18T21:01:11.778 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.769+0000 7fcd8cff9640 1 -- 10.20.193.68:0/3457574682 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fcd80013df0 con 0x7fcd90063090 2026-02-18T21:01:11.778 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.770+0000 7fcd95d6e640 1 -- 10.20.193.68:0/3457574682 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9005f010 con 0x7fcd90063090 2026-02-18T21:01:11.779 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.771+0000 7fcd8cff9640 1 -- 10.20.193.68:0/3457574682 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7fcd80021060 con 0x7fcd90063090 2026-02-18T21:01:11.803 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.801+0000 7fcd95d6e640 1 -- 10.20.193.68:0/3457574682 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "osd new", "uuid": "765a38cd-f526-4aba-b94e-c57076ca6c72", "id": 3} v 0) v1 -- 0x7fcd9006dfa0 con 0x7fcd90063090 2026-02-18T21:01:11.805 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.803+0000 7fcd8cff9640 1 -- 10.20.193.68:0/3457574682 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "765a38cd-f526-4aba-b94e-c57076ca6c72", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcd80029020 con 0x7fcd90063090 2026-02-18T21:01:11.805 INFO:teuthology.orchestra.run.trial068.stdout:3 2026-02-18T21:01:11.806 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.803+0000 7fcd95d6e640 1 -- 10.20.193.68:0/3457574682 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd90063090 msgr2=0x7fcd9008fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.806 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.803+0000 7fcd95d6e640 1 --2- 10.20.193.68:0/3457574682 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd90063090 0x7fcd9008fe00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000ea20 tx=0x7fcd800091d0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.806 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.804+0000 7fcd95d6e640 1 -- 10.20.193.68:0/3457574682 shutdown_connections 2026-02-18T21:01:11.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.804+0000 7fcd95d6e640 1 --2- 10.20.193.68:0/3457574682 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fcd9012ea70 0x7fcd90090880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.804+0000 7fcd95d6e640 1 --2- 10.20.193.68:0/3457574682 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcd90095800 0x7fcd90090340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.804+0000 7fcd95d6e640 1 --2- 10.20.193.68:0/3457574682 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcd90063090 0x7fcd9008fe00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.804+0000 7fcd95d6e640 1 -- 10.20.193.68:0/3457574682 >> 10.20.193.68:0/3457574682 conn(0x7fcd900963b0 msgr2=0x7fcd9012dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:11.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.804+0000 7fcd95d6e640 1 -- 10.20.193.68:0/3457574682 shutdown_connections 2026-02-18T21:01:11.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.804+0000 7fcd95d6e640 1 -- 10.20.193.68:0/3457574682 wait complete. 2026-02-18T21:01:11.812 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-18T21:01:11.812 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-18T21:01:11.815 INFO:tasks.ceph.osd.0:Started 2026-02-18T21:01:11.815 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-18T21:01:11.815 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-18T21:01:11.817 INFO:tasks.ceph.osd.1:Started 2026-02-18T21:01:11.817 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-18T21:01:11.817 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-18T21:01:11.819 INFO:tasks.ceph.osd.2:Started 2026-02-18T21:01:11.820 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-18T21:01:11.820 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-18T21:01:11.822 INFO:tasks.ceph.osd.3:Started 2026-02-18T21:01:11.823 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-18T21:01:11.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.891+0000 7fbee1c31640 1 Processor -- start 2026-02-18T21:01:11.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.891+0000 7fbee1c31640 1 -- start start 2026-02-18T21:01:11.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.891+0000 7fbee1c31640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbedc096a50 0x7fbedc096e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.891+0000 7fbee1c31640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbedc129540 0x7fbedc132480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.891+0000 7fbee1c31640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbedc098380 con 0x7fbedc097360 2026-02-18T21:01:11.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.891+0000 7fbee1c31640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc099300 con 0x7fbedc129540 2026-02-18T21:01:11.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.891+0000 7fbee1c31640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc069000 con 0x7fbedc096a50 2026-02-18T21:01:11.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.891+0000 7fbedb7fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbedc096a50 0x7fbedc096e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.891+0000 7fbedbfff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbedc129540 0x7fbedc132480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.891+0000 7fbedbfff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbedc129540 0x7fbedc132480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:55750/0 (socket says 10.20.193.68:55750) 2026-02-18T21:01:11.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.891+0000 7fbedb7fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbedc096a50 0x7fbedc096e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60310/0 (socket says 10.20.193.68:60310) 2026-02-18T21:01:11.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.891+0000 7fbed3fff640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fbedc097360 0x7fbedc128e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:44670/0 (socket says 10.20.193.68:44670) 2026-02-18T21:01:11.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.891+0000 7fbedbfff640 1 -- 10.20.193.68:0/3256451639 learned_addr learned my addr 10.20.193.68:0/3256451639 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:11.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.891+0000 7fbedb7fe640 1 -- 10.20.193.68:0/3256451639 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbedc129540 msgr2=0x7fbedc132480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:11.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.891+0000 7fbedb7fe640 1 --2- 10.20.193.68:0/3256451639 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbedc129540 0x7fbedc132480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.891+0000 7fbedb7fe640 1 -- 10.20.193.68:0/3256451639 >> v1:10.20.193.68:6789/0 conn(0x7fbedc097360 legacy=0x7fbedc128e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.891+0000 7fbedb7fe640 1 -- 10.20.193.68:0/3256451639 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc098f30 con 0x7fbedc096a50 2026-02-18T21:01:11.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.892+0000 7fbedb7fe640 1 --2- 10.20.193.68:0/3256451639 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbedc096a50 0x7fbedc096e20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009880 tx=0x7fbecc02eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a97073d785df3cc server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:11.899 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.892+0000 7fbedaffd640 1 -- 10.20.193.68:0/3256451639 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc02f9c0 con 0x7fbedc096a50 2026-02-18T21:01:11.899 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.892+0000 7fbedaffd640 1 -- 10.20.193.68:0/3256451639 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc02fb20 con 0x7fbedc096a50 2026-02-18T21:01:11.899 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.892+0000 7fbedaffd640 1 -- 10.20.193.68:0/3256451639 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc037440 con 0x7fbedc096a50 2026-02-18T21:01:11.899 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.892+0000 7fbee1c31640 1 -- 10.20.193.68:0/3256451639 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbedc096a50 msgr2=0x7fbedc096e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.899 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.892+0000 7fbee1c31640 1 --2- 10.20.193.68:0/3256451639 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbedc096a50 0x7fbedc096e20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009880 tx=0x7fbecc02eeb0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.899 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.892+0000 7fbee1c31640 1 -- 10.20.193.68:0/3256451639 shutdown_connections 2026-02-18T21:01:11.899 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.892+0000 7fbee1c31640 1 --2- 10.20.193.68:0/3256451639 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbedc129540 0x7fbedc132480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.899 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.892+0000 7fbee1c31640 1 --2- 10.20.193.68:0/3256451639 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbedc096a50 0x7fbedc096e20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.899 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.892+0000 7fbee1c31640 1 -- 10.20.193.68:0/3256451639 >> 10.20.193.68:0/3256451639 conn(0x7fbedc09da20 msgr2=0x7fbedc09de20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:11.899 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.892+0000 7fbee1c31640 1 -- 10.20.193.68:0/3256451639 shutdown_connections 2026-02-18T21:01:11.899 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.892+0000 7fbee1c31640 1 -- 10.20.193.68:0/3256451639 wait complete. 2026-02-18T21:01:11.899 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.892+0000 7fbee1c31640 1 Processor -- start 2026-02-18T21:01:11.900 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbee1c31640 1 -- start start 2026-02-18T21:01:11.900 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbee1c31640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbedc096a50 0x7fbedc119900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.900 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbee1c31640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbedc097360 0x7fbedc119e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.900 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbee1c31640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbedc129540 0x7fbedc1be450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:11.900 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbee1c31640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc11cb30 con 0x7fbedc097360 2026-02-18T21:01:11.900 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbee1c31640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc11cf00 con 0x7fbedc096a50 2026-02-18T21:01:11.900 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbee1c31640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc11b200 con 0x7fbedc129540 2026-02-18T21:01:11.900 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbedb7fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbedc096a50 0x7fbedc119900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.900 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbed3fff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbedc097360 0x7fbedc119e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.900 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbedb7fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbedc096a50 0x7fbedc119900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:55756/0 (socket says 10.20.193.68:55756) 2026-02-18T21:01:11.900 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbedb7fe640 1 -- 10.20.193.68:0/3085194143 learned_addr learned my addr 10.20.193.68:0/3085194143 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:11.901 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbedbfff640 1 --2- 10.20.193.68:0/3085194143 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbedc129540 0x7fbedc1be450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:11.901 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbedb7fe640 1 -- 10.20.193.68:0/3085194143 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbedc129540 msgr2=0x7fbedc1be450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.901 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbedb7fe640 1 --2- 10.20.193.68:0/3085194143 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbedc129540 0x7fbedc1be450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.901 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbedb7fe640 1 -- 10.20.193.68:0/3085194143 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbedc097360 msgr2=0x7fbedc119e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.901 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbedb7fe640 1 --2- 10.20.193.68:0/3085194143 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbedc097360 0x7fbedc119e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.901 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbedb7fe640 1 -- 10.20.193.68:0/3085194143 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc009390 con 0x7fbedc096a50 2026-02-18T21:01:11.901 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbedb7fe640 1 --2- 10.20.193.68:0/3085194143 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbedc096a50 0x7fbedc119900 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009360 tx=0x7fbecc037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:11.901 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbed8ff9640 1 -- 10.20.193.68:0/3085194143 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc042720 con 0x7fbedc096a50 2026-02-18T21:01:11.901 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbed8ff9640 1 -- 10.20.193.68:0/3085194143 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc042880 con 0x7fbedc096a50 2026-02-18T21:01:11.901 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbee1c31640 1 -- 10.20.193.68:0/3085194143 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbedc11c350 con 0x7fbedc096a50 2026-02-18T21:01:11.901 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbed8ff9640 1 -- 10.20.193.68:0/3085194143 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc042c40 con 0x7fbedc096a50 2026-02-18T21:01:11.901 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbee1c31640 1 -- 10.20.193.68:0/3085194143 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbedc11a520 con 0x7fbedc096a50 2026-02-18T21:01:11.902 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbed8ff9640 1 -- 10.20.193.68:0/3085194143 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fbecc03e040 con 0x7fbedc096a50 2026-02-18T21:01:11.902 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.893+0000 7fbed8ff9640 1 -- 10.20.193.68:0/3085194143 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fbecc04b3f0 con 0x7fbedc096a50 2026-02-18T21:01:11.902 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.894+0000 7fbee1c31640 1 -- 10.20.193.68:0/3085194143 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbedc11a6b0 con 0x7fbedc096a50 2026-02-18T21:01:11.902 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.896+0000 7fbed8ff9640 1 -- 10.20.193.68:0/3085194143 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7fbecc050060 con 0x7fbedc096a50 2026-02-18T21:01:11.924 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.922+0000 7fbee1c31640 1 -- 10.20.193.68:0/3085194143 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbedc05f010 con 0x7fbedc096a50 2026-02-18T21:01:11.924 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.922+0000 7fbed8ff9640 1 -- 10.20.193.68:0/3085194143 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4108 (secure 0 0 0) 0x7fbecc047070 con 0x7fbedc096a50 2026-02-18T21:01:11.925 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:01:11.925 INFO:teuthology.orchestra.run.trial068.stdout:{"epoch":6,"fsid":"73558818-cfd1-494a-84aa-56d128598ef4","created":"2026-02-18T21:01:11.071818+0000","modified":"2026-02-18T21:01:11.803245+0000","last_up_change":"0.000000","last_in_change":"2026-02-18T21:01:11.803245+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"bb5f8e54-3a43-41d6-b266-aa412a7f170e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e26d8762-250e-42e7-8768-23caa22edb04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"568ee96d-39ac-4d79-92bb-d1f3f12601b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"765a38cd-f526-4aba-b94e-c57076ca6c72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T21:01:11.926 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.923+0000 7fbee1c31640 1 -- 10.20.193.68:0/3085194143 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbedc096a50 msgr2=0x7fbedc119900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:11.926 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.923+0000 7fbee1c31640 1 --2- 10.20.193.68:0/3085194143 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbedc096a50 0x7fbedc119900 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009360 tx=0x7fbecc037000 comp rx=0 tx=0).stop 2026-02-18T21:01:11.926 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.923+0000 7fbee1c31640 1 -- 10.20.193.68:0/3085194143 shutdown_connections 2026-02-18T21:01:11.926 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.923+0000 7fbee1c31640 1 --2- 10.20.193.68:0/3085194143 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbedc129540 0x7fbedc1be450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.926 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.923+0000 7fbee1c31640 1 --2- 10.20.193.68:0/3085194143 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbedc097360 0x7fbedc119e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.927 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.923+0000 7fbee1c31640 1 --2- 10.20.193.68:0/3085194143 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbedc096a50 0x7fbedc119900 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:11.927 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.923+0000 7fbee1c31640 1 -- 10.20.193.68:0/3085194143 >> 10.20.193.68:0/3085194143 conn(0x7fbedc09da20 msgr2=0x7fbedc1aebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:11.927 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.923+0000 7fbee1c31640 1 -- 10.20.193.68:0/3085194143 shutdown_connections 2026-02-18T21:01:11.927 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:11.923+0000 7fbee1c31640 1 -- 10.20.193.68:0/3085194143 wait complete. 2026-02-18T21:01:11.932 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-18T21:01:11.932 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-18T21:01:11.965 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:11.963+0000 7feb5e3bdec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-18T21:01:11.965 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:11.963+0000 7f5444dc7ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-18T21:01:12.074 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.072+0000 7feb5e3bdec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-18T21:01:12.074 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.072+0000 7f5444dc7ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-18T21:01:12.100 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.098+0000 7feb5e3bdec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-18T21:01:12.102 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.100+0000 7f5444dc7ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-18T21:01:12.133 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.131+0000 7feb5e3bdec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-18T21:01:12.134 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.132+0000 7f5444dc7ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-18T21:01:12.155 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.153+0000 7feb5e3bdec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-18T21:01:12.156 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.154+0000 7f5444dc7ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-18T21:01:12.182 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.180+0000 7feb5e3bdec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-18T21:01:12.182 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.180+0000 7f5444dc7ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-18T21:01:12.247 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.245+0000 7f5444dc7ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-18T21:01:12.247 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.245+0000 7feb5e3bdec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-18T21:01:12.272 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.270+0000 7f5444dc7ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-18T21:01:12.272 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.270+0000 7feb5e3bdec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-18T21:01:12.321 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.319+0000 7f5444dc7ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-18T21:01:12.322 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.319+0000 7feb5e3bdec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-18T21:01:12.334 DEBUG:teuthology.orchestra.run.trial068:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-18T21:01:12.362 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.360+0000 7feb5e3bdec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-18T21:01:12.363 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.360+0000 7f5444dc7ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-18T21:01:12.388 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.386+0000 7feb5e3bdec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-18T21:01:12.389 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.386+0000 7f5444dc7ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-18T21:01:12.397 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.390+0000 7f56a371b640 1 Processor -- start 2026-02-18T21:01:12.397 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.390+0000 7f56a371b640 1 -- start start 2026-02-18T21:01:12.397 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.390+0000 7f56a371b640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f569c068450 0x7f569c068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:12.397 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.390+0000 7f56a371b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f569c12fae0 0x7f569c131ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:12.397 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.390+0000 7f56a371b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f569c08c520 con 0x7f569c068d60 2026-02-18T21:01:12.397 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.390+0000 7f56a371b640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f569c095740 con 0x7f569c068450 2026-02-18T21:01:12.397 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.390+0000 7f56a371b640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f569c098c40 con 0x7f569c12fae0 2026-02-18T21:01:12.397 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.390+0000 7f56a0cb6640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f569c068d60 0x7f569c12e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:44672/0 (socket says 10.20.193.68:44672) 2026-02-18T21:01:12.398 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.390+0000 7f56a1cb8640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f569c12fae0 0x7f569c131ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:12.398 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.390+0000 7f56a0cb6640 1 -- 10.20.193.68:0/2948665343 learned_addr learned my addr 10.20.193.68:0/2948665343 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:01:12.398 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.390+0000 7f56a14b7640 1 --2- 10.20.193.68:0/2948665343 >> v2:10.20.193.68:3300/0 conn(0x7f569c068450 0x7f569c068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:12.398 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.390+0000 7f56a1cb8640 1 -- 10.20.193.68:0/2948665343 >> v2:10.20.193.68:3300/0 conn(0x7f569c068450 msgr2=0x7f569c068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:12.398 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.390+0000 7f56a1cb8640 1 --2- 10.20.193.68:0/2948665343 >> v2:10.20.193.68:3300/0 conn(0x7f569c068450 0x7f569c068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:12.398 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.390+0000 7f56a1cb8640 1 -- 10.20.193.68:0/2948665343 >> v1:10.20.193.68:6789/0 conn(0x7f569c068d60 legacy=0x7f569c12e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:12.398 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.390+0000 7f56a1cb8640 1 -- 10.20.193.68:0/2948665343 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c097410 con 0x7f569c12fae0 2026-02-18T21:01:12.398 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.390+0000 7f5693fff640 1 -- 10.20.193.68:0/2948665343 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648404153 0 0) 0x7f569c08c520 con 0x7f569c068d60 2026-02-18T21:01:12.398 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.391+0000 7f56a1cb8640 1 --2- 10.20.193.68:0/2948665343 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f569c12fae0 0x7f569c131ec0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5694009e90 tx=0x7f569402f2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f902a0e2d31a7c2d server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:12.398 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.391+0000 7f5693fff640 1 -- 10.20.193.68:0/2948665343 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569402fdd0 con 0x7f569c12fae0 2026-02-18T21:01:12.398 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.391+0000 7f5693fff640 1 -- 10.20.193.68:0/2948665343 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5694037440 con 0x7f569c12fae0 2026-02-18T21:01:12.398 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.391+0000 7f5693fff640 1 -- 10.20.193.68:0/2948665343 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56940377e0 con 0x7f569c12fae0 2026-02-18T21:01:12.399 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.391+0000 7f56a371b640 1 -- 10.20.193.68:0/2948665343 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f569c12fae0 msgr2=0x7f569c131ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:12.399 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.391+0000 7f56a371b640 1 --2- 10.20.193.68:0/2948665343 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f569c12fae0 0x7f569c131ec0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5694009e90 tx=0x7f569402f2b0 comp rx=0 tx=0).stop 2026-02-18T21:01:12.399 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.391+0000 7f56a371b640 1 -- 10.20.193.68:0/2948665343 shutdown_connections 2026-02-18T21:01:12.399 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.391+0000 7f56a371b640 1 --2- 10.20.193.68:0/2948665343 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f569c12fae0 0x7f569c131ec0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:12.399 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.391+0000 7f56a371b640 1 --2- 10.20.193.68:0/2948665343 >> v2:10.20.193.68:3300/0 conn(0x7f569c068450 0x7f569c068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:12.399 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.391+0000 7f56a371b640 1 -- 10.20.193.68:0/2948665343 >> 10.20.193.68:0/2948665343 conn(0x7f569c0980c0 msgr2=0x7f569c0984c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:12.399 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.391+0000 7f56a371b640 1 -- 10.20.193.68:0/2948665343 shutdown_connections 2026-02-18T21:01:12.399 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.391+0000 7f56a371b640 1 -- 10.20.193.68:0/2948665343 wait complete. 2026-02-18T21:01:12.399 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a371b640 1 Processor -- start 2026-02-18T21:01:12.399 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a371b640 1 -- start start 2026-02-18T21:01:12.399 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a371b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f569c068450 0x7f569c12f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:12.399 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a371b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f569c068d60 0x7f569c120300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:12.399 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a371b640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f569c12fae0 0x7f569c120840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:12.400 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a371b640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c12f940 con 0x7f569c12fae0 2026-02-18T21:01:12.400 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a371b640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569c1227a0 con 0x7f569c068450 2026-02-18T21:01:12.400 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a371b640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f569c121bf0 con 0x7f569c068d60 2026-02-18T21:01:12.400 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a0cb6640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f569c068d60 0x7f569c120300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:12.400 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a1cb8640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f569c12fae0 0x7f569c120840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:12.400 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a0cb6640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f569c068d60 0x7f569c120300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60338/0 (socket says 10.20.193.68:60338) 2026-02-18T21:01:12.400 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a14b7640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f569c068450 0x7f569c12f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:12.400 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a0cb6640 1 -- 10.20.193.68:0/2643948843 learned_addr learned my addr 10.20.193.68:0/2643948843 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:12.400 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a0cb6640 1 -- 10.20.193.68:0/2643948843 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f569c068450 msgr2=0x7f569c12f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:12.400 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a0cb6640 1 --2- 10.20.193.68:0/2643948843 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f569c068450 0x7f569c12f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:12.400 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a0cb6640 1 -- 10.20.193.68:0/2643948843 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f569c12fae0 msgr2=0x7f569c120840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:12.401 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a0cb6640 1 --2- 10.20.193.68:0/2643948843 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f569c12fae0 0x7f569c120840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:12.401 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a0cb6640 1 -- 10.20.193.68:0/2643948843 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5694009a20 con 0x7f569c068d60 2026-02-18T21:01:12.401 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a1cb8640 1 --2- 10.20.193.68:0/2643948843 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f569c12fae0 0x7f569c120840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:12.401 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a0cb6640 1 --2- 10.20.193.68:0/2643948843 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f569c068d60 0x7f569c120300 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f568c00c590 tx=0x7f568c007cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:12.401 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f5691ffb640 1 -- 10.20.193.68:0/2643948843 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c005aa0 con 0x7f569c068d60 2026-02-18T21:01:12.401 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f5691ffb640 1 -- 10.20.193.68:0/2643948843 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568c005c20 con 0x7f569c068d60 2026-02-18T21:01:12.401 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a371b640 1 -- 10.20.193.68:0/2643948843 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569c1223d0 con 0x7f569c068d60 2026-02-18T21:01:12.401 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f5691ffb640 1 -- 10.20.193.68:0/2643948843 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c007340 con 0x7f569c068d60 2026-02-18T21:01:12.401 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.392+0000 7f56a371b640 1 -- 10.20.193.68:0/2643948843 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c120d80 con 0x7f569c068d60 2026-02-18T21:01:12.401 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.393+0000 7f5691ffb640 1 -- 10.20.193.68:0/2643948843 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f568c01b400 con 0x7f569c068d60 2026-02-18T21:01:12.401 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.393+0000 7f5691ffb640 1 -- 10.20.193.68:0/2643948843 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f568c005e10 con 0x7f569c068d60 2026-02-18T21:01:12.401 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.393+0000 7f56a371b640 1 -- 10.20.193.68:0/2643948843 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569c071220 con 0x7f569c068d60 2026-02-18T21:01:12.401 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.394+0000 7f5691ffb640 1 -- 10.20.193.68:0/2643948843 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72049 (secure 0 0 0) 0x7f568c01b6b0 con 0x7f569c068d60 2026-02-18T21:01:12.409 INFO:tasks.ceph.osd.2.trial068.stderr:2026-02-18T21:01:12.407+0000 7f705c275440 -1 Falling back to public interface 2026-02-18T21:01:12.410 INFO:tasks.ceph.osd.3.trial068.stderr:2026-02-18T21:01:12.408+0000 7fb30ec1e440 -1 Falling back to public interface 2026-02-18T21:01:12.411 INFO:tasks.ceph.osd.1.trial068.stderr:2026-02-18T21:01:12.409+0000 7fbbd640a440 -1 Falling back to public interface 2026-02-18T21:01:12.411 INFO:tasks.ceph.osd.0.trial068.stderr:2026-02-18T21:01:12.409+0000 7f8a559e2440 -1 Falling back to public interface 2026-02-18T21:01:12.413 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.411+0000 7f5444dc7ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-18T21:01:12.413 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.411+0000 7feb5e3bdec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-18T21:01:12.425 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.422+0000 7f56a371b640 1 -- 10.20.193.68:0/2643948843 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f569c08c990 con 0x7f569c068d60 2026-02-18T21:01:12.425 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.422+0000 7f5691ffb640 1 -- 10.20.193.68:0/2643948843 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4108 (secure 0 0 0) 0x7f568c02a090 con 0x7f569c068d60 2026-02-18T21:01:12.425 INFO:teuthology.misc.health.trial068.stdout: 2026-02-18T21:01:12.426 INFO:teuthology.misc.health.trial068.stdout:{"epoch":6,"fsid":"73558818-cfd1-494a-84aa-56d128598ef4","created":"2026-02-18T21:01:11.071818+0000","modified":"2026-02-18T21:01:11.803245+0000","last_up_change":"0.000000","last_in_change":"2026-02-18T21:01:11.803245+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"bb5f8e54-3a43-41d6-b266-aa412a7f170e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e26d8762-250e-42e7-8768-23caa22edb04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"568ee96d-39ac-4d79-92bb-d1f3f12601b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"765a38cd-f526-4aba-b94e-c57076ca6c72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T21:01:12.427 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.422+0000 7f56a371b640 1 -- 10.20.193.68:0/2643948843 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f569c068d60 msgr2=0x7f569c120300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:12.428 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.422+0000 7f56a371b640 1 --2- 10.20.193.68:0/2643948843 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f569c068d60 0x7f569c120300 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f568c00c590 tx=0x7f568c007cc0 comp rx=0 tx=0).stop 2026-02-18T21:01:12.428 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.423+0000 7f56a371b640 1 -- 10.20.193.68:0/2643948843 shutdown_connections 2026-02-18T21:01:12.428 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.423+0000 7f56a371b640 1 --2- 10.20.193.68:0/2643948843 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f569c12fae0 0x7f569c120840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:12.428 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.423+0000 7f56a371b640 1 --2- 10.20.193.68:0/2643948843 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f569c068d60 0x7f569c120300 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:12.428 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.423+0000 7f56a371b640 1 --2- 10.20.193.68:0/2643948843 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f569c068450 0x7f569c12f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:12.428 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.423+0000 7f56a371b640 1 -- 10.20.193.68:0/2643948843 >> 10.20.193.68:0/2643948843 conn(0x7f569c0980c0 msgr2=0x7f569c094720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:12.428 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.423+0000 7f56a371b640 1 -- 10.20.193.68:0/2643948843 shutdown_connections 2026-02-18T21:01:12.429 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:12.423+0000 7f56a371b640 1 -- 10.20.193.68:0/2643948843 wait complete. 2026-02-18T21:01:12.431 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-18T21:01:12.439 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.437+0000 7feb5e3bdec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-18T21:01:12.439 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.437+0000 7f5444dc7ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-18T21:01:12.461 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.459+0000 7f5444dc7ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-18T21:01:12.462 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.459+0000 7feb5e3bdec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-18T21:01:12.506 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.504+0000 7f5444dc7ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-18T21:01:12.506 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.504+0000 7feb5e3bdec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-18T21:01:12.528 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.526+0000 7feb5e3bdec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-18T21:01:12.528 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.526+0000 7f5444dc7ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-18T21:01:12.550 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.548+0000 7feb5e3bdec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-18T21:01:12.551 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.548+0000 7f5444dc7ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-18T21:01:12.589 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.587+0000 7f5444dc7ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-18T21:01:12.589 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.587+0000 7feb5e3bdec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-18T21:01:12.609 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.607+0000 7feb5e3bdec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-18T21:01:12.609 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.607+0000 7f5444dc7ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-18T21:01:12.646 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.644+0000 7feb5e3bdec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-18T21:01:12.646 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.644+0000 7f5444dc7ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-18T21:01:12.706 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.704+0000 7f5444dc7ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-18T21:01:12.706 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.704+0000 7feb5e3bdec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-18T21:01:12.728 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.726+0000 7f5444dc7ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-18T21:01:12.728 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.726+0000 7feb5e3bdec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-18T21:01:12.883 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:12.881+0000 7feb5e3bdec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-18T21:01:12.883 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:01:12.881+0000 7f5444dc7ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-18T21:01:13.890 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:13.888+0000 7feb47185640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-18T21:01:13.891 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:01:13.889+0000 7feb47185640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-18T21:01:15.891 INFO:tasks.ceph.osd.2.trial068.stderr:2026-02-18T21:01:15.889+0000 7f705c275440 -1 osd.2 0 log_to_monitors true 2026-02-18T21:01:15.895 INFO:tasks.ceph.osd.0.trial068.stderr:2026-02-18T21:01:15.893+0000 7f8a559e2440 -1 osd.0 0 log_to_monitors true 2026-02-18T21:01:15.916 INFO:tasks.ceph.osd.1.trial068.stderr:2026-02-18T21:01:15.914+0000 7fbbd640a440 -1 osd.1 0 log_to_monitors true 2026-02-18T21:01:15.928 INFO:tasks.ceph.osd.3.trial068.stderr:2026-02-18T21:01:15.926+0000 7fb30ec1e440 -1 osd.3 0 log_to_monitors true 2026-02-18T21:01:18.436 INFO:tasks.ceph.osd.3.trial068.stderr:2026-02-18T21:01:18.435+0000 7fb3093f6640 -1 osd.3 0 waiting for initial osdmap 2026-02-18T21:01:18.438 INFO:tasks.ceph.osd.3.trial068.stderr:2026-02-18T21:01:18.437+0000 7fb3023e8640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-18T21:01:18.452 INFO:tasks.ceph.osd.0.trial068.stderr:2026-02-18T21:01:18.450+0000 7f8a503f6640 -1 osd.0 0 waiting for initial osdmap 2026-02-18T21:01:18.454 INFO:tasks.ceph.osd.0.trial068.stderr:2026-02-18T21:01:18.453+0000 7f8a493e8640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-18T21:01:18.460 INFO:tasks.ceph.osd.1.trial068.stderr:2026-02-18T21:01:18.459+0000 7fbbd0bf6640 -1 osd.1 0 waiting for initial osdmap 2026-02-18T21:01:18.462 INFO:tasks.ceph.osd.1.trial068.stderr:2026-02-18T21:01:18.461+0000 7fbbc9be8640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-18T21:01:18.496 INFO:tasks.ceph.osd.2.trial068.stderr:2026-02-18T21:01:18.495+0000 7f70573f6640 -1 osd.2 0 waiting for initial osdmap 2026-02-18T21:01:18.498 INFO:tasks.ceph.osd.2.trial068.stderr:2026-02-18T21:01:18.497+0000 7f7050285640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-18T21:01:18.834 DEBUG:teuthology.orchestra.run.trial068:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-18T21:01:18.896 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.891+0000 7fc9d48db640 1 Processor -- start 2026-02-18T21:01:18.897 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.891+0000 7fc9d48db640 1 -- start start 2026-02-18T21:01:18.897 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.891+0000 7fc9d48db640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc9cc087f90 0x7fc9cc088360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:18.897 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.891+0000 7fc9d48db640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc9cc0888a0 0x7fc9cc088c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:18.897 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.891+0000 7fc9d48db640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fc9cc12e6e0 0x7fc9cc130ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:18.897 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.891+0000 7fc9d48db640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9cc08ffd0 con 0x7fc9cc12e6e0 2026-02-18T21:01:18.897 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.891+0000 7fc9d48db640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc08af50 con 0x7fc9cc0888a0 2026-02-18T21:01:18.897 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.891+0000 7fc9d48db640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc08b1a0 con 0x7fc9cc087f90 2026-02-18T21:01:18.897 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.891+0000 7fc9d2e78640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fc9cc12e6e0 0x7fc9cc130ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:18.898 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.891+0000 7fc9d1e76640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc9cc0888a0 0x7fc9cc088c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:18.898 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.891+0000 7fc9d2677640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc9cc087f90 0x7fc9cc088360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:18.898 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.891+0000 7fc9d2e78640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fc9cc12e6e0 0x7fc9cc130ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:37188/0 (socket says 10.20.193.68:37188) 2026-02-18T21:01:18.898 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.891+0000 7fc9d2e78640 1 -- 10.20.193.68:0/656830116 learned_addr learned my addr 10.20.193.68:0/656830116 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:18.898 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.891+0000 7fc9d1e76640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc9cc0888a0 0x7fc9cc088c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:55822/0 (socket says 10.20.193.68:55822) 2026-02-18T21:01:18.898 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.892+0000 7fc9d2e78640 1 -- 10.20.193.68:0/656830116 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc9cc087f90 msgr2=0x7fc9cc088360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:18.898 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.892+0000 7fc9d2e78640 1 --2- 10.20.193.68:0/656830116 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc9cc087f90 0x7fc9cc088360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:18.898 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.892+0000 7fc9d2e78640 1 -- 10.20.193.68:0/656830116 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc9cc0888a0 msgr2=0x7fc9cc088c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:18.898 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.892+0000 7fc9d2e78640 1 --2- 10.20.193.68:0/656830116 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc9cc0888a0 0x7fc9cc088c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:18.898 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.892+0000 7fc9d2e78640 1 -- 10.20.193.68:0/656830116 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc0891b0 con 0x7fc9cc12e6e0 2026-02-18T21:01:18.898 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.892+0000 7fc9d2e78640 1 --2- 10.20.193.68:0/656830116 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc9cc12e6e0 0x7fc9cc130ac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8009f20 tx=0x7fc9c802f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74646e3e89739933 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:18.898 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.892+0000 7fc9d1675640 1 -- 10.20.193.68:0/656830116 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c802fc90 con 0x7fc9cc12e6e0 2026-02-18T21:01:18.899 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.892+0000 7fc9d1675640 1 -- 10.20.193.68:0/656830116 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c802fdf0 con 0x7fc9cc12e6e0 2026-02-18T21:01:18.899 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.892+0000 7fc9d1675640 1 -- 10.20.193.68:0/656830116 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c8007630 con 0x7fc9cc12e6e0 2026-02-18T21:01:18.899 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.892+0000 7fc9d48db640 1 -- 10.20.193.68:0/656830116 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc9cc12e6e0 msgr2=0x7fc9cc130ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:18.899 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.892+0000 7fc9d48db640 1 --2- 10.20.193.68:0/656830116 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc9cc12e6e0 0x7fc9cc130ac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8009f20 tx=0x7fc9c802f3d0 comp rx=0 tx=0).stop 2026-02-18T21:01:18.899 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.892+0000 7fc9d48db640 1 -- 10.20.193.68:0/656830116 shutdown_connections 2026-02-18T21:01:18.899 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.892+0000 7fc9d48db640 1 --2- 10.20.193.68:0/656830116 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc9cc0888a0 0x7fc9cc088c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:18.899 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.892+0000 7fc9d48db640 1 --2- 10.20.193.68:0/656830116 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc9cc12e6e0 0x7fc9cc130ac0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:18.899 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.892+0000 7fc9d48db640 1 --2- 10.20.193.68:0/656830116 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc9cc087f90 0x7fc9cc088360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:18.899 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.892+0000 7fc9d48db640 1 -- 10.20.193.68:0/656830116 >> 10.20.193.68:0/656830116 conn(0x7fc9cc09e190 msgr2=0x7fc9cc0684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:18.899 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.892+0000 7fc9d48db640 1 -- 10.20.193.68:0/656830116 shutdown_connections 2026-02-18T21:01:18.899 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.892+0000 7fc9d48db640 1 -- 10.20.193.68:0/656830116 wait complete. 2026-02-18T21:01:18.900 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9d48db640 1 Processor -- start 2026-02-18T21:01:18.900 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9d48db640 1 -- start start 2026-02-18T21:01:18.900 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9d48db640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc9cc087f90 0x7fc9cc122640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:18.900 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9d48db640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc9cc0888a0 0x7fc9cc122b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:18.900 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9d48db640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc9cc12e6e0 0x7fc9cc1230c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:18.900 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9d48db640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc1252d0 con 0x7fc9cc0888a0 2026-02-18T21:01:18.900 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9d48db640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc123e00 con 0x7fc9cc087f90 2026-02-18T21:01:18.900 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9d48db640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc124950 con 0x7fc9cc12e6e0 2026-02-18T21:01:18.900 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9d2677640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc9cc087f90 0x7fc9cc122640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:18.900 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9d1e76640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc9cc0888a0 0x7fc9cc122b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:18.900 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9d2e78640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc9cc12e6e0 0x7fc9cc1230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:18.901 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9d2677640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc9cc087f90 0x7fc9cc122640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:55824/0 (socket says 10.20.193.68:55824) 2026-02-18T21:01:18.901 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9d2677640 1 -- 10.20.193.68:0/1823442417 learned_addr learned my addr 10.20.193.68:0/1823442417 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:18.901 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9d2677640 1 -- 10.20.193.68:0/1823442417 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc9cc12e6e0 msgr2=0x7fc9cc1230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:18.901 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9d2677640 1 --2- 10.20.193.68:0/1823442417 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc9cc12e6e0 0x7fc9cc1230c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:18.901 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9d2677640 1 -- 10.20.193.68:0/1823442417 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc9cc0888a0 msgr2=0x7fc9cc122b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:18.901 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9d2677640 1 --2- 10.20.193.68:0/1823442417 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc9cc0888a0 0x7fc9cc122b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:18.901 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9d2677640 1 -- 10.20.193.68:0/1823442417 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c8009ae0 con 0x7fc9cc087f90 2026-02-18T21:01:18.901 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9d1e76640 1 --2- 10.20.193.68:0/1823442417 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc9cc0888a0 0x7fc9cc122b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:18.901 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9d2677640 1 --2- 10.20.193.68:0/1823442417 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc9cc087f90 0x7fc9cc122640 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000ea20 tx=0x7fc9c00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:18.901 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.893+0000 7fc9beffd640 1 -- 10.20.193.68:0/1823442417 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000ca70 con 0x7fc9cc087f90 2026-02-18T21:01:18.901 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.894+0000 7fc9beffd640 1 -- 10.20.193.68:0/1823442417 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c000cbd0 con 0x7fc9cc087f90 2026-02-18T21:01:18.901 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.894+0000 7fc9d48db640 1 -- 10.20.193.68:0/1823442417 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9cc125500 con 0x7fc9cc087f90 2026-02-18T21:01:18.902 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.894+0000 7fc9beffd640 1 -- 10.20.193.68:0/1823442417 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0013470 con 0x7fc9cc087f90 2026-02-18T21:01:18.902 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.894+0000 7fc9d48db640 1 -- 10.20.193.68:0/1823442417 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9cc12a0b0 con 0x7fc9cc087f90 2026-02-18T21:01:18.902 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.894+0000 7fc9d48db640 1 -- 10.20.193.68:0/1823442417 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9cc12a360 con 0x7fc9cc087f90 2026-02-18T21:01:18.902 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.894+0000 7fc9beffd640 1 -- 10.20.193.68:0/1823442417 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 4) v1 ==== 59153+0+0 (secure 0 0 0) 0x7fc9c0013860 con 0x7fc9cc087f90 2026-02-18T21:01:18.902 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.894+0000 7fc9beffd640 1 -- 10.20.193.68:0/1823442417 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1507+0+0 (secure 0 0 0) 0x7fc9c00636d0 con 0x7fc9cc087f90 2026-02-18T21:01:18.902 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.897+0000 7fc9beffd640 1 -- 10.20.193.68:0/1823442417 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7fc9c003eb10 con 0x7fc9cc087f90 2026-02-18T21:01:18.960 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.958+0000 7fc9d48db640 1 -- 10.20.193.68:0/1823442417 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9cc071220 con 0x7fc9cc087f90 2026-02-18T21:01:18.960 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.959+0000 7fc9beffd640 1 -- 10.20.193.68:0/1823442417 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) v1 ==== 74+0+4108 (secure 0 0 0) 0x7fc9c0042320 con 0x7fc9cc087f90 2026-02-18T21:01:18.961 INFO:teuthology.misc.health.trial068.stdout: 2026-02-18T21:01:18.961 INFO:teuthology.misc.health.trial068.stdout:{"epoch":8,"fsid":"73558818-cfd1-494a-84aa-56d128598ef4","created":"2026-02-18T21:01:11.071818+0000","modified":"2026-02-18T21:01:17.892603+0000","last_up_change":"0.000000","last_in_change":"2026-02-18T21:01:11.803245+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"bb5f8e54-3a43-41d6-b266-aa412a7f170e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e26d8762-250e-42e7-8768-23caa22edb04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"568ee96d-39ac-4d79-92bb-d1f3f12601b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"765a38cd-f526-4aba-b94e-c57076ca6c72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T21:01:18.962 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.959+0000 7fc9d48db640 1 -- 10.20.193.68:0/1823442417 >> v1:10.20.193.68:6816/24610 conn(0x7fc9b004d040 legacy=0x7fc9b004f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:18.962 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.959+0000 7fc9d48db640 1 -- 10.20.193.68:0/1823442417 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc9cc087f90 msgr2=0x7fc9cc122640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:18.962 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.959+0000 7fc9d48db640 1 --2- 10.20.193.68:0/1823442417 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc9cc087f90 0x7fc9cc122640 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc9c000ea20 tx=0x7fc9c00090f0 comp rx=0 tx=0).stop 2026-02-18T21:01:18.962 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.959+0000 7fc9d48db640 1 -- 10.20.193.68:0/1823442417 shutdown_connections 2026-02-18T21:01:18.962 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.959+0000 7fc9d48db640 1 --2- 10.20.193.68:0/1823442417 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc9cc12e6e0 0x7fc9cc1230c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:18.963 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.959+0000 7fc9d48db640 1 --2- 10.20.193.68:0/1823442417 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc9cc0888a0 0x7fc9cc122b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:18.963 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.959+0000 7fc9d48db640 1 --2- 10.20.193.68:0/1823442417 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc9cc087f90 0x7fc9cc122640 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:18.963 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.959+0000 7fc9d48db640 1 -- 10.20.193.68:0/1823442417 >> 10.20.193.68:0/1823442417 conn(0x7fc9cc09e190 msgr2=0x7fc9cc12dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:18.963 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.959+0000 7fc9d48db640 1 -- 10.20.193.68:0/1823442417 shutdown_connections 2026-02-18T21:01:18.963 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:18.959+0000 7fc9d48db640 1 -- 10.20.193.68:0/1823442417 wait complete. 2026-02-18T21:01:18.967 DEBUG:teuthology.misc:0 of 4 OSDs are up 2026-02-18T21:01:25.371 DEBUG:teuthology.orchestra.run.trial068:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-18T21:01:25.432 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.425+0000 7fb499fb7640 1 Processor -- start 2026-02-18T21:01:25.432 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.426+0000 7fb499fb7640 1 -- start start 2026-02-18T21:01:25.432 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.426+0000 7fb499fb7640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb4940931f0 0x7fb49412d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:25.432 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.426+0000 7fb499fb7640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fb49412d8f0 0x7fb49412fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:25.432 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.426+0000 7fb499fb7640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4940947b0 con 0x7fb494092710 2026-02-18T21:01:25.432 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.426+0000 7fb499fb7640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb494093f50 con 0x7fb49412d8f0 2026-02-18T21:01:25.433 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.426+0000 7fb499fb7640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb494094370 con 0x7fb4940931f0 2026-02-18T21:01:25.433 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.426+0000 7fb48bfff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb4940931f0 0x7fb49412d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:25.433 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.426+0000 7fb493fff640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fb49412d8f0 0x7fb49412fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:25.433 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.426+0000 7fb48bfff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb4940931f0 0x7fb49412d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:44412/0 (socket says 10.20.193.68:44412) 2026-02-18T21:01:25.433 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.426+0000 7fb48bfff640 1 -- 10.20.193.68:0/2516918537 learned_addr learned my addr 10.20.193.68:0/2516918537 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:25.433 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.426+0000 7fb4937fe640 1 --1- 10.20.193.68:0/2516918537 >> v1:10.20.193.68:6789/0 conn(0x7fb494092710 0x7fb494092ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:43714/0 (socket says 10.20.193.68:43714) 2026-02-18T21:01:25.433 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.426+0000 7fb48bfff640 1 -- 10.20.193.68:0/2516918537 >> v2:10.20.193.68:3300/0 conn(0x7fb49412d8f0 msgr2=0x7fb49412fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:25.433 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.426+0000 7fb48bfff640 1 --2- 10.20.193.68:0/2516918537 >> v2:10.20.193.68:3300/0 conn(0x7fb49412d8f0 0x7fb49412fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:25.433 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.426+0000 7fb48bfff640 1 -- 10.20.193.68:0/2516918537 >> v1:10.20.193.68:6789/0 conn(0x7fb494092710 legacy=0x7fb494092ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:25.433 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.426+0000 7fb48bfff640 1 -- 10.20.193.68:0/2516918537 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb494097490 con 0x7fb4940931f0 2026-02-18T21:01:25.433 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.427+0000 7fb48bfff640 1 --2- 10.20.193.68:0/2516918537 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb4940931f0 0x7fb49412d3b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009910 tx=0x7fb47c02ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f156010bc5693b28 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:25.434 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.427+0000 7fb492ffd640 1 -- 10.20.193.68:0/2516918537 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c02f970 con 0x7fb4940931f0 2026-02-18T21:01:25.434 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.427+0000 7fb492ffd640 1 -- 10.20.193.68:0/2516918537 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47c02fad0 con 0x7fb4940931f0 2026-02-18T21:01:25.434 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.427+0000 7fb492ffd640 1 -- 10.20.193.68:0/2516918537 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c037440 con 0x7fb4940931f0 2026-02-18T21:01:25.434 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.427+0000 7fb499fb7640 1 -- 10.20.193.68:0/2516918537 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb4940931f0 msgr2=0x7fb49412d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:25.434 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.427+0000 7fb499fb7640 1 --2- 10.20.193.68:0/2516918537 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb4940931f0 0x7fb49412d3b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009910 tx=0x7fb47c02ee10 comp rx=0 tx=0).stop 2026-02-18T21:01:25.434 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.427+0000 7fb499fb7640 1 -- 10.20.193.68:0/2516918537 shutdown_connections 2026-02-18T21:01:25.434 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.427+0000 7fb499fb7640 1 --2- 10.20.193.68:0/2516918537 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb4940931f0 0x7fb49412d3b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:25.434 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.427+0000 7fb499fb7640 1 --2- 10.20.193.68:0/2516918537 >> v2:10.20.193.68:3300/0 conn(0x7fb49412d8f0 0x7fb49412fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:25.434 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.427+0000 7fb499fb7640 1 -- 10.20.193.68:0/2516918537 >> 10.20.193.68:0/2516918537 conn(0x7fb4940980c0 msgr2=0x7fb4940984c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:25.434 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.427+0000 7fb499fb7640 1 -- 10.20.193.68:0/2516918537 shutdown_connections 2026-02-18T21:01:25.434 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.427+0000 7fb499fb7640 1 -- 10.20.193.68:0/2516918537 wait complete. 2026-02-18T21:01:25.434 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb499fb7640 1 Processor -- start 2026-02-18T21:01:25.435 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb499fb7640 1 -- start start 2026-02-18T21:01:25.435 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb499fb7640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fb494092710 0x7fb494068680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:25.435 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb499fb7640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fb4940931f0 0x7fb494068bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:25.435 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb499fb7640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb49412d8f0 0x7fb49408da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:25.435 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb499fb7640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49406a480 con 0x7fb494092710 2026-02-18T21:01:25.435 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb499fb7640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49408d770 con 0x7fb49412d8f0 2026-02-18T21:01:25.435 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb499fb7640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb494069f20 con 0x7fb4940931f0 2026-02-18T21:01:25.435 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb4937fe640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fb494092710 0x7fb494068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:25.435 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb493fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb49412d8f0 0x7fb49408da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:25.435 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb493fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb49412d8f0 0x7fb49408da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:44422/0 (socket says 10.20.193.68:44422) 2026-02-18T21:01:25.435 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb48bfff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fb4940931f0 0x7fb494068bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:25.435 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb4937fe640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fb494092710 0x7fb494068680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:37720/0 (socket says 10.20.193.68:37720) 2026-02-18T21:01:25.436 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb493fff640 1 -- 10.20.193.68:0/1764631763 learned_addr learned my addr 10.20.193.68:0/1764631763 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:25.436 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb493fff640 1 -- 10.20.193.68:0/1764631763 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fb4940931f0 msgr2=0x7fb494068bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:25.436 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb493fff640 1 --2- 10.20.193.68:0/1764631763 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fb4940931f0 0x7fb494068bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:25.436 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb493fff640 1 -- 10.20.193.68:0/1764631763 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fb494092710 msgr2=0x7fb494068680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:25.436 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb493fff640 1 --2- 10.20.193.68:0/1764631763 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fb494092710 0x7fb494068680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:25.436 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb493fff640 1 -- 10.20.193.68:0/1764631763 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c009450 con 0x7fb49412d8f0 2026-02-18T21:01:25.436 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb493fff640 1 --2- 10.20.193.68:0/1764631763 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb49412d8f0 0x7fb49408da00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb48c009ec0 tx=0x7fb48c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:25.436 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb490ff9640 1 -- 10.20.193.68:0/1764631763 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c00ce80 con 0x7fb49412d8f0 2026-02-18T21:01:25.436 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb490ff9640 1 -- 10.20.193.68:0/1764631763 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48c00f040 con 0x7fb49412d8f0 2026-02-18T21:01:25.436 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb490ff9640 1 -- 10.20.193.68:0/1764631763 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c0146b0 con 0x7fb49412d8f0 2026-02-18T21:01:25.436 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb499fb7640 1 -- 10.20.193.68:0/1764631763 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb49408d3c0 con 0x7fb49412d8f0 2026-02-18T21:01:25.436 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.428+0000 7fb499fb7640 1 -- 10.20.193.68:0/1764631763 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb494069100 con 0x7fb49412d8f0 2026-02-18T21:01:25.437 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.429+0000 7fb499fb7640 1 -- 10.20.193.68:0/1764631763 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49408ce50 con 0x7fb49412d8f0 2026-02-18T21:01:25.437 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.429+0000 7fb490ff9640 1 -- 10.20.193.68:0/1764631763 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7fb48c014a20 con 0x7fb49412d8f0 2026-02-18T21:01:25.437 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.429+0000 7fb490ff9640 1 -- 10.20.193.68:0/1764631763 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2453+0+0 (secure 0 0 0) 0x7fb48c0645a0 con 0x7fb49412d8f0 2026-02-18T21:01:25.437 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.431+0000 7fb490ff9640 1 -- 10.20.193.68:0/1764631763 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7fb48c03f5c0 con 0x7fb49412d8f0 2026-02-18T21:01:25.495 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.492+0000 7fb499fb7640 1 -- 10.20.193.68:0/1764631763 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb494071220 con 0x7fb49412d8f0 2026-02-18T21:01:25.495 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.492+0000 7fb490ff9640 1 -- 10.20.193.68:0/1764631763 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+6451 (secure 0 0 0) 0x7fb48c018070 con 0x7fb49412d8f0 2026-02-18T21:01:25.495 INFO:teuthology.misc.health.trial068.stdout: 2026-02-18T21:01:25.495 INFO:teuthology.misc.health.trial068.stdout:{"epoch":12,"fsid":"73558818-cfd1-494a-84aa-56d128598ef4","created":"2026-02-18T21:01:11.071818+0000","modified":"2026-02-18T21:01:22.965553+0000","last_up_change":"2026-02-18T21:01:19.437203+0000","last_in_change":"2026-02-18T21:01:11.803245+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-18T21:01:20.913845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"bb5f8e54-3a43-41d6-b266-aa412a7f170e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6809","nonce":25183}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6811","nonce":25183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6814","nonce":25183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6812","nonce":25183}]},"public_addr":"10.20.193.68:6809/25183","cluster_addr":"10.20.193.68:6811/25183","heartbeat_back_addr":"10.20.193.68:6814/25183","heartbeat_front_addr":"10.20.193.68:6812/25183","state":["exists","up"]},{"osd":1,"uuid":"e26d8762-250e-42e7-8768-23caa22edb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6808","nonce":25184}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6810","nonce":25184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6815","nonce":25184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6813","nonce":25184}]},"public_addr":"10.20.193.68:6808/25184","cluster_addr":"10.20.193.68:6810/25184","heartbeat_back_addr":"10.20.193.68:6815/25184","heartbeat_front_addr":"10.20.193.68:6813/25184","state":["exists","up"]},{"osd":2,"uuid":"568ee96d-39ac-4d79-92bb-d1f3f12601b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6800","nonce":25185}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6801","nonce":25185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6803","nonce":25185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6802","nonce":25185}]},"public_addr":"10.20.193.68:6800/25185","cluster_addr":"10.20.193.68:6801/25185","heartbeat_back_addr":"10.20.193.68:6803/25185","heartbeat_front_addr":"10.20.193.68:6802/25185","state":["exists","up"]},{"osd":3,"uuid":"765a38cd-f526-4aba-b94e-c57076ca6c72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6804","nonce":25186}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6805","nonce":25186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6807","nonce":25186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6806","nonce":25186}]},"public_addr":"10.20.193.68:6804/25186","cluster_addr":"10.20.193.68:6805/25186","heartbeat_back_addr":"10.20.193.68:6807/25186","heartbeat_front_addr":"10.20.193.68:6806/25186","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T21:01:25.496 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.493+0000 7fb499fb7640 1 -- 10.20.193.68:0/1764631763 >> v1:10.20.193.68:6816/24610 conn(0x7fb47404d100 legacy=0x7fb47404f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:25.496 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.493+0000 7fb499fb7640 1 -- 10.20.193.68:0/1764631763 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb49412d8f0 msgr2=0x7fb49408da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:25.497 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.493+0000 7fb499fb7640 1 --2- 10.20.193.68:0/1764631763 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb49412d8f0 0x7fb49408da00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb48c009ec0 tx=0x7fb48c00b040 comp rx=0 tx=0).stop 2026-02-18T21:01:25.497 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.493+0000 7fb499fb7640 1 -- 10.20.193.68:0/1764631763 shutdown_connections 2026-02-18T21:01:25.497 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.493+0000 7fb499fb7640 1 --2- 10.20.193.68:0/1764631763 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb49412d8f0 0x7fb49408da00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:25.497 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.493+0000 7fb499fb7640 1 --2- 10.20.193.68:0/1764631763 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fb4940931f0 0x7fb494068bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:25.497 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.493+0000 7fb499fb7640 1 --2- 10.20.193.68:0/1764631763 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fb494092710 0x7fb494068680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:25.497 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.493+0000 7fb499fb7640 1 -- 10.20.193.68:0/1764631763 >> 10.20.193.68:0/1764631763 conn(0x7fb4940980c0 msgr2=0x7fb4940994f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:25.497 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.493+0000 7fb499fb7640 1 -- 10.20.193.68:0/1764631763 shutdown_connections 2026-02-18T21:01:25.497 INFO:teuthology.misc.health.trial068.stderr:2026-02-18T21:01:25.493+0000 7fb499fb7640 1 -- 10.20.193.68:0/1764631763 wait complete. 2026-02-18T21:01:25.501 DEBUG:teuthology.misc:4 of 4 OSDs are up 2026-02-18T21:01:25.501 INFO:tasks.ceph:Creating RBD pool 2026-02-18T21:01:25.502 DEBUG:teuthology.orchestra.run.trial068:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-18T21:01:25.569 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.562+0000 7f5ff051b640 1 Processor -- start 2026-02-18T21:01:25.569 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.562+0000 7f5ff051b640 1 -- start start 2026-02-18T21:01:25.569 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.562+0000 7f5ff051b640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f5fe8096a50 0x7f5fe8096e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:25.569 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.562+0000 7f5ff051b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5fe8097360 0x7f5fe8129e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:25.569 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.562+0000 7f5ff051b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe809a320 con 0x7f5fe812a380 2026-02-18T21:01:25.570 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.562+0000 7f5ff051b640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe8098bb0 con 0x7f5fe8096a50 2026-02-18T21:01:25.570 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.562+0000 7f5ff051b640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe809a570 con 0x7f5fe8097360 2026-02-18T21:01:25.570 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.563+0000 7f5fee2b7640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f5fe8096a50 0x7f5fe8096e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:25.570 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.563+0000 7f5fedab6640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5fe8097360 0x7f5fe8129e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:25.570 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.563+0000 7f5fee2b7640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f5fe8096a50 0x7f5fe8096e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:37724/0 (socket says 10.20.193.68:37724) 2026-02-18T21:01:25.570 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.563+0000 7f5fee2b7640 1 -- 10.20.193.68:0/3154624456 learned_addr learned my addr 10.20.193.68:0/3154624456 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:25.570 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.563+0000 7f5feeab8640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f5fe812a380 0x7f5fe812a7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:43722/0 (socket says 10.20.193.68:43722) 2026-02-18T21:01:25.570 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.563+0000 7f5fee2b7640 1 -- 10.20.193.68:0/3154624456 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5fe8097360 msgr2=0x7f5fe8129e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:25.570 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.563+0000 7f5fee2b7640 1 --2- 10.20.193.68:0/3154624456 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5fe8097360 0x7f5fe8129e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:25.570 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.563+0000 7f5fee2b7640 1 -- 10.20.193.68:0/3154624456 >> v1:10.20.193.68:6789/0 conn(0x7f5fe812a380 legacy=0x7f5fe812a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:25.570 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.563+0000 7f5fee2b7640 1 -- 10.20.193.68:0/3154624456 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe80992c0 con 0x7f5fe8096a50 2026-02-18T21:01:25.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.563+0000 7f5fee2b7640 1 --2- 10.20.193.68:0/3154624456 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5fe8096a50 0x7f5fe8096e20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4009910 tx=0x7f5fe402ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d51733fa785703a server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:25.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.563+0000 7f5fed2b5640 1 -- 10.20.193.68:0/3154624456 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe402f970 con 0x7f5fe8096a50 2026-02-18T21:01:25.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.563+0000 7f5fed2b5640 1 -- 10.20.193.68:0/3154624456 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe402fad0 con 0x7f5fe8096a50 2026-02-18T21:01:25.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.563+0000 7f5fed2b5640 1 -- 10.20.193.68:0/3154624456 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4037440 con 0x7f5fe8096a50 2026-02-18T21:01:25.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5ff051b640 1 -- 10.20.193.68:0/3154624456 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5fe8096a50 msgr2=0x7f5fe8096e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:25.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5ff051b640 1 --2- 10.20.193.68:0/3154624456 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5fe8096a50 0x7f5fe8096e20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4009910 tx=0x7f5fe402ee10 comp rx=0 tx=0).stop 2026-02-18T21:01:25.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5ff051b640 1 -- 10.20.193.68:0/3154624456 shutdown_connections 2026-02-18T21:01:25.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5ff051b640 1 --2- 10.20.193.68:0/3154624456 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5fe8097360 0x7f5fe8129e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:25.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5ff051b640 1 --2- 10.20.193.68:0/3154624456 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5fe8096a50 0x7f5fe8096e20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:25.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5ff051b640 1 -- 10.20.193.68:0/3154624456 >> 10.20.193.68:0/3154624456 conn(0x7f5fe809d9b0 msgr2=0x7f5fe809ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:25.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5ff051b640 1 -- 10.20.193.68:0/3154624456 shutdown_connections 2026-02-18T21:01:25.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5ff051b640 1 -- 10.20.193.68:0/3154624456 wait complete. 2026-02-18T21:01:25.572 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5ff051b640 1 Processor -- start 2026-02-18T21:01:25.572 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5ff051b640 1 -- start start 2026-02-18T21:01:25.572 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5ff051b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5fe8096a50 0x7f5fe81be3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:25.572 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5ff051b640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5fe8097360 0x7f5fe81be8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:25.572 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5ff051b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5fe812a380 0x7f5fe81bee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:25.572 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5ff051b640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe8130a10 con 0x7f5fe8097360 2026-02-18T21:01:25.572 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5ff051b640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe8130de0 con 0x7f5fe8096a50 2026-02-18T21:01:25.572 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5ff051b640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe8130230 con 0x7f5fe812a380 2026-02-18T21:01:25.572 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5fedab6640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5fe8097360 0x7f5fe81be8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:25.572 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5fee2b7640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5fe8096a50 0x7f5fe81be3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:25.572 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5fedab6640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5fe8097360 0x7f5fe81be8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:37728/0 (socket says 10.20.193.68:37728) 2026-02-18T21:01:25.572 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5fedab6640 1 -- 10.20.193.68:0/1364828006 learned_addr learned my addr 10.20.193.68:0/1364828006 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:25.573 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.564+0000 7f5feeab8640 1 --2- 10.20.193.68:0/1364828006 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5fe812a380 0x7f5fe81bee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:25.573 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.565+0000 7f5fedab6640 1 -- 10.20.193.68:0/1364828006 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5fe812a380 msgr2=0x7f5fe81bee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:25.573 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.565+0000 7f5fedab6640 1 --2- 10.20.193.68:0/1364828006 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5fe812a380 0x7f5fe81bee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:25.573 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.565+0000 7f5fedab6640 1 -- 10.20.193.68:0/1364828006 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5fe8096a50 msgr2=0x7f5fe81be3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:25.573 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.565+0000 7f5fedab6640 1 --2- 10.20.193.68:0/1364828006 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5fe8096a50 0x7f5fe81be3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:25.573 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.565+0000 7f5fedab6640 1 -- 10.20.193.68:0/1364828006 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe4009450 con 0x7f5fe8097360 2026-02-18T21:01:25.573 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.565+0000 7f5fee2b7640 1 --2- 10.20.193.68:0/1364828006 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5fe8096a50 0x7f5fe81be3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:25.573 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.565+0000 7f5fedab6640 1 --2- 10.20.193.68:0/1364828006 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5fe8097360 0x7f5fe81be8f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800ea20 tx=0x7f5fd80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:25.573 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.565+0000 7f5fdeffd640 1 -- 10.20.193.68:0/1364828006 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd800ca70 con 0x7f5fe8097360 2026-02-18T21:01:25.573 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.565+0000 7f5fdeffd640 1 -- 10.20.193.68:0/1364828006 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd800cbd0 con 0x7f5fe8097360 2026-02-18T21:01:25.573 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.565+0000 7f5ff051b640 1 -- 10.20.193.68:0/1364828006 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe812f0e0 con 0x7f5fe8097360 2026-02-18T21:01:25.573 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.565+0000 7f5fdeffd640 1 -- 10.20.193.68:0/1364828006 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8013470 con 0x7f5fe8097360 2026-02-18T21:01:25.574 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.565+0000 7f5ff051b640 1 -- 10.20.193.68:0/1364828006 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe812d7f0 con 0x7f5fe8097360 2026-02-18T21:01:25.574 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.565+0000 7f5ff051b640 1 -- 10.20.193.68:0/1364828006 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe805f010 con 0x7f5fe8097360 2026-02-18T21:01:25.574 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.566+0000 7f5fdeffd640 1 -- 10.20.193.68:0/1364828006 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f5fd8013860 con 0x7f5fe8097360 2026-02-18T21:01:25.574 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.566+0000 7f5fdeffd640 1 -- 10.20.193.68:0/1364828006 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2453+0+0 (secure 0 0 0) 0x7f5fd80641d0 con 0x7f5fe8097360 2026-02-18T21:01:25.574 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.568+0000 7f5fdeffd640 1 -- 10.20.193.68:0/1364828006 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f5fd803f270 con 0x7f5fe8097360 2026-02-18T21:01:25.631 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.629+0000 7f5ff051b640 1 -- 10.20.193.68:0/1364828006 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f5fe8063380 con 0x7f5fe8097360 2026-02-18T21:01:25.974 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.971+0000 7f5fdeffd640 1 -- 10.20.193.68:0/1364828006 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) v1 ==== 109+0+0 (secure 0 0 0) 0x7f5fd8021030 con 0x7f5fe8097360 2026-02-18T21:01:25.974 INFO:teuthology.orchestra.run.trial068.stderr:pool 'rbd' created 2026-02-18T21:01:25.976 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.973+0000 7f5ff051b640 1 -- 10.20.193.68:0/1364828006 >> v1:10.20.193.68:6816/24610 conn(0x7f5fcc04d0d0 legacy=0x7f5fcc04f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:25.976 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.973+0000 7f5ff051b640 1 -- 10.20.193.68:0/1364828006 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5fe8097360 msgr2=0x7f5fe81be8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:25.976 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.973+0000 7f5ff051b640 1 --2- 10.20.193.68:0/1364828006 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5fe8097360 0x7f5fe81be8f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800ea20 tx=0x7f5fd80090f0 comp rx=0 tx=0).stop 2026-02-18T21:01:25.976 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.973+0000 7f5ff051b640 1 -- 10.20.193.68:0/1364828006 shutdown_connections 2026-02-18T21:01:25.976 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.973+0000 7f5ff051b640 1 --2- 10.20.193.68:0/1364828006 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5fe812a380 0x7f5fe81bee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:25.976 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.973+0000 7f5ff051b640 1 --2- 10.20.193.68:0/1364828006 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5fe8097360 0x7f5fe81be8f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:25.976 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.973+0000 7f5ff051b640 1 --2- 10.20.193.68:0/1364828006 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5fe8096a50 0x7f5fe81be3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:25.976 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.973+0000 7f5ff051b640 1 -- 10.20.193.68:0/1364828006 >> 10.20.193.68:0/1364828006 conn(0x7f5fe809d9b0 msgr2=0x7f5fe809c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:25.976 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.973+0000 7f5ff051b640 1 -- 10.20.193.68:0/1364828006 shutdown_connections 2026-02-18T21:01:25.976 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:25.973+0000 7f5ff051b640 1 -- 10.20.193.68:0/1364828006 wait complete. 2026-02-18T21:01:25.983 DEBUG:teuthology.orchestra.run.trial068:> rbd --cluster ceph pool init rbd 2026-02-18T21:01:26.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.008+0000 7fea548d0b80 1 Processor -- start 2026-02-18T21:01:26.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.008+0000 7fea548d0b80 1 -- start start 2026-02-18T21:01:26.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.008+0000 7fea548d0b80 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x55775b139960 0x55775b139d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:26.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.008+0000 7fea548d0b80 1 --2- >> v2:10.20.193.68:3300/0 conn(0x55775b13a270 0x55775b08d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:26.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.008+0000 7fea548d0b80 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x55775b08de40 0x55775b08e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:26.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.008+0000 7fea548d0b80 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x55775af84b30 con 0x55775b13a270 2026-02-18T21:01:26.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.008+0000 7fea548d0b80 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x55775af82100 con 0x55775b08de40 2026-02-18T21:01:26.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.008+0000 7fea548d0b80 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x55775af7dde0 con 0x55775b139960 2026-02-18T21:01:26.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.008+0000 7fea51da0640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x55775b139960 0x55775b139d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:26.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.008+0000 7fea5159f640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x55775b13a270 0x55775b08d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:26.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.008+0000 7fea53002640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x55775b08de40 0x55775b08e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:26.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.008+0000 7fea5159f640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x55775b13a270 0x55775b08d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:37736/0 (socket says 10.20.193.68:37736) 2026-02-18T21:01:26.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.008+0000 7fea51da0640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x55775b139960 0x55775b139d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:34550/0 (socket says 10.20.193.68:34550) 2026-02-18T21:01:26.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.008+0000 7fea5159f640 1 -- 10.20.193.68:0/528328868 learned_addr learned my addr 10.20.193.68:0/528328868 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:26.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.009+0000 7fea5159f640 1 -- 10.20.193.68:0/528328868 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x55775b139960 msgr2=0x55775b139d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:26.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.009+0000 7fea5159f640 1 --2- 10.20.193.68:0/528328868 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x55775b139960 0x55775b139d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:26.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.009+0000 7fea5159f640 1 -- 10.20.193.68:0/528328868 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x55775b08de40 msgr2=0x55775b08e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:26.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.009+0000 7fea5159f640 1 --2- 10.20.193.68:0/528328868 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x55775b08de40 0x55775b08e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:26.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.009+0000 7fea5159f640 1 -- 10.20.193.68:0/528328868 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55775af494d0 con 0x55775b13a270 2026-02-18T21:01:26.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.010+0000 7fea5159f640 1 --2- 10.20.193.68:0/528328868 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x55775b13a270 0x55775b08d900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fea4800a6d0 tx=0x7fea48058950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7912f025b45f1b server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:26.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.010+0000 7fea50d9e640 1 -- 10.20.193.68:0/528328868 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea48068440 con 0x55775b13a270 2026-02-18T21:01:26.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.010+0000 7fea50d9e640 1 -- 10.20.193.68:0/528328868 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea480685a0 con 0x55775b13a270 2026-02-18T21:01:26.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.010+0000 7fea50d9e640 1 -- 10.20.193.68:0/528328868 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea48068730 con 0x55775b13a270 2026-02-18T21:01:26.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.010+0000 7fea548d0b80 1 -- 10.20.193.68:0/528328868 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x55775b13a270 msgr2=0x55775b08d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:26.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.010+0000 7fea548d0b80 1 --2- 10.20.193.68:0/528328868 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x55775b13a270 0x55775b08d900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fea4800a6d0 tx=0x7fea48058950 comp rx=0 tx=0).stop 2026-02-18T21:01:26.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.010+0000 7fea548d0b80 1 -- 10.20.193.68:0/528328868 shutdown_connections 2026-02-18T21:01:26.018 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.010+0000 7fea548d0b80 1 --2- 10.20.193.68:0/528328868 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x55775b08de40 0x55775b08e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:26.018 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.010+0000 7fea548d0b80 1 --2- 10.20.193.68:0/528328868 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x55775b13a270 0x55775b08d900 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:26.018 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.010+0000 7fea548d0b80 1 --2- 10.20.193.68:0/528328868 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x55775b139960 0x55775b139d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:26.018 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.010+0000 7fea548d0b80 1 -- 10.20.193.68:0/528328868 >> 10.20.193.68:0/528328868 conn(0x55775b0ac7f0 msgr2=0x55775b0acbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:26.018 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.010+0000 7fea548d0b80 1 -- 10.20.193.68:0/528328868 shutdown_connections 2026-02-18T21:01:26.018 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.010+0000 7fea548d0b80 1 -- 10.20.193.68:0/528328868 wait complete. 2026-02-18T21:01:26.018 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.010+0000 7fea548d0b80 1 Processor -- start 2026-02-18T21:01:26.018 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea548d0b80 1 -- start start 2026-02-18T21:01:26.018 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea548d0b80 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x55775b08de40 0x55775b138070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:26.018 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea548d0b80 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x55775b139960 0x55775b1385b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:26.018 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea548d0b80 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x55775b13a270 0x55775b138af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:26.018 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea548d0b80 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775af23120 con 0x55775b139960 2026-02-18T21:01:26.019 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea548d0b80 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x55775af22dc0 con 0x55775b08de40 2026-02-18T21:01:26.019 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea548d0b80 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x55775af03110 con 0x55775b13a270 2026-02-18T21:01:26.019 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea51da0640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x55775b08de40 0x55775b138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:26.019 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea5159f640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x55775b139960 0x55775b1385b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:26.019 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea51da0640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x55775b08de40 0x55775b138070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:44458/0 (socket says 10.20.193.68:44458) 2026-02-18T21:01:26.019 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea51da0640 1 -- 10.20.193.68:0/261533964 learned_addr learned my addr 10.20.193.68:0/261533964 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:26.019 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea53002640 1 --2- 10.20.193.68:0/261533964 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x55775b13a270 0x55775b138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:26.019 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea51da0640 1 -- 10.20.193.68:0/261533964 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x55775b13a270 msgr2=0x55775b138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:26.019 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea51da0640 1 --2- 10.20.193.68:0/261533964 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x55775b13a270 0x55775b138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:26.019 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea51da0640 1 -- 10.20.193.68:0/261533964 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x55775b139960 msgr2=0x55775b1385b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:26.019 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea51da0640 1 --2- 10.20.193.68:0/261533964 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x55775b139960 0x55775b1385b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:26.019 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea51da0640 1 -- 10.20.193.68:0/261533964 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea48005db0 con 0x55775b08de40 2026-02-18T21:01:26.020 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea51da0640 1 --2- 10.20.193.68:0/261533964 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x55775b08de40 0x55775b138070 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fea44008af0 tx=0x7fea4400c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:26.020 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea41ffb640 1 -- 10.20.193.68:0/261533964 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4400f040 con 0x55775b08de40 2026-02-18T21:01:26.020 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea41ffb640 1 -- 10.20.193.68:0/261533964 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4400d960 con 0x55775b08de40 2026-02-18T21:01:26.020 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea548d0b80 1 -- 10.20.193.68:0/261533964 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55775af21c50 con 0x55775b08de40 2026-02-18T21:01:26.020 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea41ffb640 1 -- 10.20.193.68:0/261533964 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4400dce0 con 0x55775b08de40 2026-02-18T21:01:26.020 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.011+0000 7fea548d0b80 1 -- 10.20.193.68:0/261533964 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55775af2eaf0 con 0x55775b08de40 2026-02-18T21:01:26.020 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.012+0000 7fea41ffb640 1 -- 10.20.193.68:0/261533964 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7fea44013610 con 0x55775b08de40 2026-02-18T21:01:26.020 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.012+0000 7fea41ffb640 1 -- 10.20.193.68:0/261533964 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2795+0+0 (secure 0 0 0) 0x7fea44062eb0 con 0x55775b08de40 2026-02-18T21:01:26.020 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.012+0000 7fea548d0b80 1 -- 10.20.193.68:0/261533964 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) v1 -- 0x55775af21fe0 con 0x55775b08de40 2026-02-18T21:01:26.977 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.974+0000 7fea41ffb640 1 -- 10.20.193.68:0/261533964 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v14) v1 ==== 141+0+0 (secure 0 0 0) 0x7fea4403dd80 con 0x55775b08de40 2026-02-18T21:01:26.978 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.974+0000 7fea548d0b80 1 -- 10.20.193.68:0/261533964 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x55775af509c0 con 0x55775b08de40 2026-02-18T21:01:26.978 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.974+0000 7fea41ffb640 1 -- 10.20.193.68:0/261533964 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea4403dd80 con 0x55775b08de40 2026-02-18T21:01:26.978 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.974+0000 7fea43fff640 1 -- 10.20.193.68:0/261533964 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=14}) v3 -- 0x7fea30002990 con 0x55775b08de40 2026-02-18T21:01:26.978 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.974+0000 7fea41ffb640 1 -- 10.20.193.68:0/261533964 <== mon.1 v2:10.20.193.68:3301/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 642+0+0 (secure 0 0 0) 0x7fea4403e4b0 con 0x55775b08de40 2026-02-18T21:01:26.978 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.974+0000 7fea548d0b80 1 -- 10.20.193.68:0/261533964 --> v1:10.20.193.68:6804/25186 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e14) v8 -- 0x55775b152dc0 con 0x55775b14f2c0 2026-02-18T21:01:26.979 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.976+0000 7fea53002640 1 -- 10.20.193.68:0/261533964 <== osd.3 v1:10.20.193.68:6804/25186 1 ==== osd_op_reply(1 rbd_trash [create] v14'1 uv1 ondisk = 0) v8 ==== 153+0+0 (unknown 1742540995 0 0) 0x7fea4c0025e0 con 0x55775b14f2c0 2026-02-18T21:01:26.980 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.977+0000 7fea548d0b80 1 -- 10.20.193.68:0/261533964 --> v1:10.20.193.68:6804/25186 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e14) v8 -- 0x55775b1a06b0 con 0x55775b14f2c0 2026-02-18T21:01:26.980 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.978+0000 7fea53002640 1 -- 10.20.193.68:0/261533964 <== osd.3 v1:10.20.193.68:6804/25186 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (unknown 173568156 0 0) 0x7fea4c0025e0 con 0x55775b14f2c0 2026-02-18T21:01:26.981 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.978+0000 7fea548d0b80 1 -- 10.20.193.68:0/261533964 --> v1:10.20.193.68:6804/25186 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e14) v8 -- 0x55775b19f7a0 con 0x55775b14f2c0 2026-02-18T21:01:26.981 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.978+0000 7fea53002640 1 -- 10.20.193.68:0/261533964 <== osd.3 v1:10.20.193.68:6804/25186 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (unknown 185109136 0 0) 0x7fea4c0025e0 con 0x55775b14f2c0 2026-02-18T21:01:26.981 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:26.978+0000 7fea43fff640 1 -- 10.20.193.68:0/261533964 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) v4 -- 0x7fea30003d30 con 0x55775b08de40 2026-02-18T21:01:27.979 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:27.976+0000 7fea41ffb640 1 -- 10.20.193.68:0/261533964 <== mon.1 v2:10.20.193.68:3301/0 9 ==== pool_op_reply(tid 4 (0) Success v15) v1 ==== 55+0+0 (secure 0 0 0) 0x7fea44041590 con 0x55775b08de40 2026-02-18T21:01:27.979 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:27.976+0000 7fea41ffb640 1 -- 10.20.193.68:0/261533964 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=15}) v3 -- 0x7fea340524d0 con 0x55775b08de40 2026-02-18T21:01:27.979 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:27.976+0000 7fea41ffb640 1 -- 10.20.193.68:0/261533964 <== mon.1 v2:10.20.193.68:3301/0 10 ==== osd_map(15..15 src has 1..15) v4 ==== 618+0+0 (secure 0 0 0) 0x7fea4400de40 con 0x55775b08de40 2026-02-18T21:01:27.979 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:27.976+0000 7fea43fff640 1 -- 10.20.193.68:0/261533964 --> v1:10.20.193.68:6804/25186 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15) v8 -- 0x7fea300056d0 con 0x55775b14f2c0 2026-02-18T21:01:27.980 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:27.977+0000 7fea53002640 1 -- 10.20.193.68:0/261533964 <== osd.3 v1:10.20.193.68:6804/25186 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v15'1 uv1 ondisk = 0) v8 ==== 194+0+0 (unknown 913822303 0 0) 0x7fea4c0025e0 con 0x55775b14f2c0 2026-02-18T21:01:27.980 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:27.977+0000 7fea43fff640 1 -- 10.20.193.68:0/261533964 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v15) v4 -- 0x7fea30005190 con 0x55775b08de40 2026-02-18T21:01:28.981 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:28.978+0000 7fea41ffb640 1 -- 10.20.193.68:0/261533964 <== mon.1 v2:10.20.193.68:3301/0 11 ==== pool_op_reply(tid 6 (0) Success v16) v1 ==== 43+0+0 (secure 0 0 0) 0x7fea44041770 con 0x55775b08de40 2026-02-18T21:01:28.981 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:28.978+0000 7fea41ffb640 1 -- 10.20.193.68:0/261533964 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=16}) v3 -- 0x7fea34052660 con 0x55775b08de40 2026-02-18T21:01:28.981 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:28.978+0000 7fea41ffb640 1 -- 10.20.193.68:0/261533964 <== mon.1 v2:10.20.193.68:3301/0 12 ==== osd_map(16..16 src has 1..16) v4 ==== 646+0+0 (secure 0 0 0) 0x7fea44062040 con 0x55775b08de40 2026-02-18T21:01:28.981 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:28.978+0000 7fea43fff640 1 -- 10.20.193.68:0/261533964 --> v1:10.20.193.68:6804/25186 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) v8 -- 0x7fea30005f70 con 0x55775b14f2c0 2026-02-18T21:01:28.982 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:28.979+0000 7fea53002640 1 -- 10.20.193.68:0/261533964 <== osd.3 v1:10.20.193.68:6804/25186 5 ==== osd_op_reply(7 rbd_info [write 0~19] v16'2 uv2 ondisk = 0) v8 ==== 152+0+0 (unknown 2130366450 0 0) 0x7fea4c0025e0 con 0x55775b14f2c0 2026-02-18T21:01:28.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:28.980+0000 7fea548d0b80 1 -- 10.20.193.68:0/261533964 >> v1:10.20.193.68:6804/25186 conn(0x55775b14f2c0 legacy=0x55775b1516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:28.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:28.980+0000 7fea548d0b80 1 -- 10.20.193.68:0/261533964 >> v1:10.20.193.68:6816/24610 conn(0x7fea3404ba00 legacy=0x7fea3404deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:28.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:28.980+0000 7fea548d0b80 1 -- 10.20.193.68:0/261533964 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x55775b08de40 msgr2=0x55775b138070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:28.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:28.980+0000 7fea548d0b80 1 --2- 10.20.193.68:0/261533964 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x55775b08de40 0x55775b138070 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fea44008af0 tx=0x7fea4400c040 comp rx=0 tx=0).stop 2026-02-18T21:01:28.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:28.980+0000 7fea53002640 1 -- 10.20.193.68:0/261533964 reap_dead start 2026-02-18T21:01:28.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:28.980+0000 7fea548d0b80 1 -- 10.20.193.68:0/261533964 shutdown_connections 2026-02-18T21:01:28.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:28.980+0000 7fea548d0b80 1 -- 10.20.193.68:0/261533964 >> 10.20.193.68:0/261533964 conn(0x55775b0ac7f0 msgr2=0x55775b1318e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:28.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:28.980+0000 7fea548d0b80 1 -- 10.20.193.68:0/261533964 shutdown_connections 2026-02-18T21:01:28.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:28.980+0000 7fea548d0b80 1 -- 10.20.193.68:0/261533964 wait complete. 2026-02-18T21:01:28.986 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-18T21:01:28.986 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-18T21:01:28.986 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-18T21:01:28.987 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-18T21:01:28.987 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-18T21:01:29.094 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.088+0000 7f2debbd4640 1 Processor -- start 2026-02-18T21:01:29.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.088+0000 7f2debbd4640 1 -- start start 2026-02-18T21:01:29.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.088+0000 7f2debbd4640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f2de4095c10 0x7f2de4095fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.088+0000 7f2debbd4640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2de412fad0 0x7f2de4131eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.088+0000 7f2debbd4640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de406f7a0 con 0x7f2de4096520 2026-02-18T21:01:29.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.088+0000 7f2debbd4640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de4067cd0 con 0x7f2de4095c10 2026-02-18T21:01:29.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.088+0000 7f2debbd4640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4068220 con 0x7f2de412fad0 2026-02-18T21:01:29.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.088+0000 7f2de9970640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f2de4095c10 0x7f2de4095fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.088+0000 7f2de916f640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f2de4096520 0x7f2de412e3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:43726/0 (socket says 10.20.193.68:43726) 2026-02-18T21:01:29.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.088+0000 7f2dea171640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2de412fad0 0x7f2de4131eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.088+0000 7f2de916f640 1 -- 10.20.193.68:0/157868406 learned_addr learned my addr 10.20.193.68:0/157868406 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:01:29.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.088+0000 7f2de896e640 1 -- 10.20.193.68:0/157868406 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79341018 0 0) 0x7f2de406f7a0 con 0x7f2de4096520 2026-02-18T21:01:29.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.088+0000 7f2de896e640 1 -- 10.20.193.68:0/157868406 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd00034e0 con 0x7f2de4096520 2026-02-18T21:01:29.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.088+0000 7f2de9970640 1 -- 10.20.193.68:0/157868406 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2de412fad0 msgr2=0x7f2de4131eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:29.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.088+0000 7f2de9970640 1 --2- 10.20.193.68:0/157868406 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2de412fad0 0x7f2de4131eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.088+0000 7f2de9970640 1 -- 10.20.193.68:0/157868406 >> v1:10.20.193.68:6789/0 conn(0x7f2de4096520 legacy=0x7f2de412e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.088+0000 7f2de9970640 1 -- 10.20.193.68:0/157868406 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de406ef70 con 0x7f2de4095c10 2026-02-18T21:01:29.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.088+0000 7f2dea171640 1 --2- 10.20.193.68:0/157868406 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2de412fad0 0x7f2de4131eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:29.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.089+0000 7f2de9970640 1 --2- 10.20.193.68:0/157868406 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2de4095c10 0x7f2de4095fe0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009850 tx=0x7f2de002ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6deb6c0a3e5811e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.089+0000 7f2de896e640 1 -- 10.20.193.68:0/157868406 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de002f8b0 con 0x7f2de4095c10 2026-02-18T21:01:29.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.089+0000 7f2de896e640 1 -- 10.20.193.68:0/157868406 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de002fa10 con 0x7f2de4095c10 2026-02-18T21:01:29.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.089+0000 7f2de896e640 1 -- 10.20.193.68:0/157868406 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de002fdb0 con 0x7f2de4095c10 2026-02-18T21:01:29.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.089+0000 7f2debbd4640 1 -- 10.20.193.68:0/157868406 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2de4095c10 msgr2=0x7f2de4095fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.089+0000 7f2debbd4640 1 --2- 10.20.193.68:0/157868406 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2de4095c10 0x7f2de4095fe0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009850 tx=0x7f2de002ed50 comp rx=0 tx=0).stop 2026-02-18T21:01:29.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.089+0000 7f2debbd4640 1 -- 10.20.193.68:0/157868406 shutdown_connections 2026-02-18T21:01:29.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.089+0000 7f2debbd4640 1 --2- 10.20.193.68:0/157868406 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2de412fad0 0x7f2de4131eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.089+0000 7f2debbd4640 1 --2- 10.20.193.68:0/157868406 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2de4095c10 0x7f2de4095fe0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.089+0000 7f2debbd4640 1 -- 10.20.193.68:0/157868406 >> 10.20.193.68:0/157868406 conn(0x7f2de4096d00 msgr2=0x7f2de4097100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.089+0000 7f2debbd4640 1 -- 10.20.193.68:0/157868406 shutdown_connections 2026-02-18T21:01:29.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.089+0000 7f2debbd4640 1 -- 10.20.193.68:0/157868406 wait complete. 2026-02-18T21:01:29.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2debbd4640 1 Processor -- start 2026-02-18T21:01:29.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2debbd4640 1 -- start start 2026-02-18T21:01:29.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2debbd4640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2de4095c10 0x7f2de411f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2debbd4640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2de4096520 0x7f2de411f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2debbd4640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2de412fad0 0x7f2de411fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2debbd4640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4120620 con 0x7f2de4096520 2026-02-18T21:01:29.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2debbd4640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de41202a0 con 0x7f2de412fad0 2026-02-18T21:01:29.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2debbd4640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2de4122950 con 0x7f2de4095c10 2026-02-18T21:01:29.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2de9970640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2de4095c10 0x7f2de411f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2de916f640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2de4096520 0x7f2de411f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2de9970640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2de4095c10 0x7f2de411f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:34592/0 (socket says 10.20.193.68:34592) 2026-02-18T21:01:29.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2de9970640 1 -- 10.20.193.68:0/481021518 learned_addr learned my addr 10.20.193.68:0/481021518 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:29.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2dea171640 1 --2- 10.20.193.68:0/481021518 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2de412fad0 0x7f2de411fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2de9970640 1 -- 10.20.193.68:0/481021518 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2de412fad0 msgr2=0x7f2de411fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2de9970640 1 --2- 10.20.193.68:0/481021518 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2de412fad0 0x7f2de411fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2de9970640 1 -- 10.20.193.68:0/481021518 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2de4096520 msgr2=0x7f2de411f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2de9970640 1 --2- 10.20.193.68:0/481021518 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2de4096520 0x7f2de411f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2de9970640 1 -- 10.20.193.68:0/481021518 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc009a20 con 0x7f2de4095c10 2026-02-18T21:01:29.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2de9970640 1 --2- 10.20.193.68:0/481021518 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2de4095c10 0x7f2de411f2e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009360 tx=0x7f2de0037000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2dda7fc640 1 -- 10.20.193.68:0/481021518 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0037d90 con 0x7f2de4095c10 2026-02-18T21:01:29.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2dda7fc640 1 -- 10.20.193.68:0/481021518 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de0042440 con 0x7f2de4095c10 2026-02-18T21:01:29.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2debbd4640 1 -- 10.20.193.68:0/481021518 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de0009390 con 0x7f2de4095c10 2026-02-18T21:01:29.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2dda7fc640 1 -- 10.20.193.68:0/481021518 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de00427e0 con 0x7f2de4095c10 2026-02-18T21:01:29.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.090+0000 7f2debbd4640 1 -- 10.20.193.68:0/481021518 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de412f640 con 0x7f2de4095c10 2026-02-18T21:01:29.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.091+0000 7f2debbd4640 1 -- 10.20.193.68:0/481021518 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de4121d00 con 0x7f2de4095c10 2026-02-18T21:01:29.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.091+0000 7f2dda7fc640 1 -- 10.20.193.68:0/481021518 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f2de003e040 con 0x7f2de4095c10 2026-02-18T21:01:29.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.091+0000 7f2dda7fc640 1 -- 10.20.193.68:0/481021518 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f2de0087d80 con 0x7f2de4095c10 2026-02-18T21:01:29.100 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.093+0000 7f2dda7fc640 1 -- 10.20.193.68:0/481021518 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f2de0062d40 con 0x7f2de4095c10 2026-02-18T21:01:29.170 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.167+0000 7f2debbd4640 1 -- 10.20.193.68:0/481021518 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f2de405f010 con 0x7f2de4095c10 2026-02-18T21:01:29.171 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.169+0000 7f2dda7fc640 1 -- 10.20.193.68:0/481021518 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+117055 (secure 0 0 0) 0x7f2de0047020 con 0x7f2de4095c10 2026-02-18T21:01:29.173 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:01:29.174 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.170+0000 7f2debbd4640 1 -- 10.20.193.68:0/481021518 >> v1:10.20.193.68:6816/24610 conn(0x7f2dc804d0d0 legacy=0x7f2dc804f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.174 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.170+0000 7f2debbd4640 1 -- 10.20.193.68:0/481021518 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2de4095c10 msgr2=0x7f2de411f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.174 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.170+0000 7f2debbd4640 1 --2- 10.20.193.68:0/481021518 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2de4095c10 0x7f2de411f2e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009360 tx=0x7f2de0037000 comp rx=0 tx=0).stop 2026-02-18T21:01:29.175 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.170+0000 7f2debbd4640 1 -- 10.20.193.68:0/481021518 shutdown_connections 2026-02-18T21:01:29.175 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.170+0000 7f2debbd4640 1 --2- 10.20.193.68:0/481021518 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2de412fad0 0x7f2de411fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.175 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.170+0000 7f2debbd4640 1 --2- 10.20.193.68:0/481021518 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2de4096520 0x7f2de411f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.175 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.170+0000 7f2debbd4640 1 --2- 10.20.193.68:0/481021518 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2de4095c10 0x7f2de411f2e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.175 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.170+0000 7f2debbd4640 1 -- 10.20.193.68:0/481021518 >> 10.20.193.68:0/481021518 conn(0x7f2de4096d00 msgr2=0x7f2de4089ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.175 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.170+0000 7f2debbd4640 1 -- 10.20.193.68:0/481021518 shutdown_connections 2026-02-18T21:01:29.175 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.170+0000 7f2debbd4640 1 -- 10.20.193.68:0/481021518 wait complete. 2026-02-18T21:01:29.180 INFO:teuthology.orchestra.run.trial068.stdout:{"epoch":5,"flags":0,"active_gid":4137,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6816","nonce":24610}]},"active_addr":"10.20.193.68:6816/24610","active_change":"2026-02-18T21:01:12.883175+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4133,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.68:0","nonce":991885778}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.68:0","nonce":3536457986}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.68:0","nonce":4112610678}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.68:0","nonce":4267957295}]}]} 2026-02-18T21:01:29.184 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-18T21:01:29.185 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-18T21:01:29.185 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-18T21:01:29.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.247+0000 7f1d04cdb640 1 Processor -- start 2026-02-18T21:01:29.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.247+0000 7f1d04cdb640 1 -- start start 2026-02-18T21:01:29.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.247+0000 7f1d04cdb640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f1d0008e9f0 0x7f1d0008edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.247+0000 7f1d04cdb640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1d0008f300 0x7f1d00094b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.247+0000 7f1d04cdb640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1d00095070 0x7f1d000954c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.247+0000 7f1d04cdb640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d00095a00 con 0x7f1d0008e9f0 2026-02-18T21:01:29.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.247+0000 7f1d04cdb640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0008c990 con 0x7f1d0008f300 2026-02-18T21:01:29.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.247+0000 7f1d04cdb640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d00096ad0 con 0x7f1d00095070 2026-02-18T21:01:29.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.247+0000 7f1cfe59c640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f1d0008e9f0 0x7f1d0008edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.247+0000 7f1cfdd9b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1d0008f300 0x7f1d00094b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.247+0000 7f1cfed9d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1d00095070 0x7f1d000954c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.256 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.248+0000 7f1cfdd9b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1d0008f300 0x7f1d00094b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:44474/0 (socket says 10.20.193.68:44474) 2026-02-18T21:01:29.256 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.248+0000 7f1cfe59c640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f1d0008e9f0 0x7f1d0008edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:37770/0 (socket says 10.20.193.68:37770) 2026-02-18T21:01:29.256 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.248+0000 7f1cfe59c640 1 -- 10.20.193.68:0/1983534530 learned_addr learned my addr 10.20.193.68:0/1983534530 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:29.256 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.248+0000 7f1cfe59c640 1 -- 10.20.193.68:0/1983534530 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1d00095070 msgr2=0x7f1d000954c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:29.256 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.248+0000 7f1cfe59c640 1 --2- 10.20.193.68:0/1983534530 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1d00095070 0x7f1d000954c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.256 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.248+0000 7f1cfe59c640 1 -- 10.20.193.68:0/1983534530 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1d0008f300 msgr2=0x7f1d00094b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:29.256 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.248+0000 7f1cfe59c640 1 --2- 10.20.193.68:0/1983534530 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1d0008f300 0x7f1d00094b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.256 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.248+0000 7f1cfe59c640 1 -- 10.20.193.68:0/1983534530 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0008e5c0 con 0x7f1d0008e9f0 2026-02-18T21:01:29.256 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.248+0000 7f1cfdd9b640 1 --2- 10.20.193.68:0/1983534530 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1d0008f300 0x7f1d00094b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:29.257 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.248+0000 7f1cfe59c640 1 --2- 10.20.193.68:0/1983534530 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1d0008e9f0 0x7f1d0008edc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0009940 tx=0x7f1cf002eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f041823478944941 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.257 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.248+0000 7f1cfd59a640 1 -- 10.20.193.68:0/1983534530 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf002f9a0 con 0x7f1d0008e9f0 2026-02-18T21:01:29.257 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.248+0000 7f1cfd59a640 1 -- 10.20.193.68:0/1983534530 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf002fb00 con 0x7f1d0008e9f0 2026-02-18T21:01:29.257 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.248+0000 7f1cfd59a640 1 -- 10.20.193.68:0/1983534530 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0037440 con 0x7f1d0008e9f0 2026-02-18T21:01:29.257 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.249+0000 7f1d04cdb640 1 -- 10.20.193.68:0/1983534530 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1d0008e9f0 msgr2=0x7f1d0008edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.257 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.249+0000 7f1d04cdb640 1 --2- 10.20.193.68:0/1983534530 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1d0008e9f0 0x7f1d0008edc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0009940 tx=0x7f1cf002eed0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.257 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.249+0000 7f1d04cdb640 1 -- 10.20.193.68:0/1983534530 shutdown_connections 2026-02-18T21:01:29.257 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.249+0000 7f1d04cdb640 1 --2- 10.20.193.68:0/1983534530 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1d0008f300 0x7f1d00094b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.257 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.249+0000 7f1d04cdb640 1 --2- 10.20.193.68:0/1983534530 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1d00095070 0x7f1d000954c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.257 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.249+0000 7f1d04cdb640 1 --2- 10.20.193.68:0/1983534530 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1d0008e9f0 0x7f1d0008edc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.257 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.249+0000 7f1d04cdb640 1 -- 10.20.193.68:0/1983534530 >> 10.20.193.68:0/1983534530 conn(0x7f1d00095c20 msgr2=0x7f1d00096020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.258 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.249+0000 7f1d04cdb640 1 -- 10.20.193.68:0/1983534530 shutdown_connections 2026-02-18T21:01:29.258 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.249+0000 7f1d04cdb640 1 -- 10.20.193.68:0/1983534530 wait complete. 2026-02-18T21:01:29.258 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.249+0000 7f1d04cdb640 1 Processor -- start 2026-02-18T21:01:29.258 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.249+0000 7f1d04cdb640 1 -- start start 2026-02-18T21:01:29.258 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.249+0000 7f1d04cdb640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1d0008e9f0 0x7f1d001be3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.258 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.249+0000 7f1d04cdb640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1d0008f300 0x7f1d001be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.258 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.249+0000 7f1d04cdb640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1d00095070 0x7f1d001bee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.258 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.249+0000 7f1d04cdb640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0012e1a0 con 0x7f1d00095070 2026-02-18T21:01:29.258 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.249+0000 7f1d04cdb640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0011fbd0 con 0x7f1d0008e9f0 2026-02-18T21:01:29.258 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.249+0000 7f1d04cdb640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0006eb00 con 0x7f1d0008f300 2026-02-18T21:01:29.258 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.250+0000 7f1cfdd9b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1d0008f300 0x7f1d001be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.259 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.250+0000 7f1cfe59c640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1d0008e9f0 0x7f1d001be3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.259 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.250+0000 7f1cfdd9b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1d0008f300 0x7f1d001be8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:34606/0 (socket says 10.20.193.68:34606) 2026-02-18T21:01:29.259 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.250+0000 7f1cfed9d640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1d00095070 0x7f1d001bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.259 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.250+0000 7f1cfdd9b640 1 -- 10.20.193.68:0/2345034680 learned_addr learned my addr 10.20.193.68:0/2345034680 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:29.259 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.250+0000 7f1cfdd9b640 1 -- 10.20.193.68:0/2345034680 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1d0008e9f0 msgr2=0x7f1d001be3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.259 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.250+0000 7f1cfdd9b640 1 --2- 10.20.193.68:0/2345034680 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1d0008e9f0 0x7f1d001be3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.259 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.250+0000 7f1cfdd9b640 1 -- 10.20.193.68:0/2345034680 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1d00095070 msgr2=0x7f1d001bee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.259 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.250+0000 7f1cfdd9b640 1 --2- 10.20.193.68:0/2345034680 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1d00095070 0x7f1d001bee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.259 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.250+0000 7f1cfdd9b640 1 -- 10.20.193.68:0/2345034680 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf4009390 con 0x7f1d0008f300 2026-02-18T21:01:29.259 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.250+0000 7f1cfdd9b640 1 --2- 10.20.193.68:0/2345034680 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1d0008f300 0x7f1d001be8e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400ec80 tx=0x7f1cf40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.259 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.250+0000 7f1ceeffd640 1 -- 10.20.193.68:0/2345034680 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf400cbd0 con 0x7f1d0008f300 2026-02-18T21:01:29.260 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.250+0000 7f1ceeffd640 1 -- 10.20.193.68:0/2345034680 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf400cd30 con 0x7f1d0008f300 2026-02-18T21:01:29.260 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.250+0000 7f1d04cdb640 1 -- 10.20.193.68:0/2345034680 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf0009450 con 0x7f1d0008f300 2026-02-18T21:01:29.260 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.250+0000 7f1ceeffd640 1 -- 10.20.193.68:0/2345034680 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40136a0 con 0x7f1d0008f300 2026-02-18T21:01:29.260 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.250+0000 7f1d04cdb640 1 -- 10.20.193.68:0/2345034680 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0006d970 con 0x7f1d0008f300 2026-02-18T21:01:29.260 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.250+0000 7f1d04cdb640 1 -- 10.20.193.68:0/2345034680 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d0005f010 con 0x7f1d0008f300 2026-02-18T21:01:29.260 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.251+0000 7f1ceeffd640 1 -- 10.20.193.68:0/2345034680 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f1cf4013a10 con 0x7f1d0008f300 2026-02-18T21:01:29.260 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.251+0000 7f1ceeffd640 1 -- 10.20.193.68:0/2345034680 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f1cf4063da0 con 0x7f1d0008f300 2026-02-18T21:01:29.261 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.253+0000 7f1ceeffd640 1 -- 10.20.193.68:0/2345034680 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f1cf403eb90 con 0x7f1d0008f300 2026-02-18T21:01:29.318 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.316+0000 7f1d04cdb640 1 -- 10.20.193.68:0/2345034680 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d0006f730 con 0x7f1d0008f300 2026-02-18T21:01:29.319 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.316+0000 7f1ceeffd640 1 -- 10.20.193.68:0/2345034680 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8077 (secure 0 0 0) 0x7f1cf400cea0 con 0x7f1d0008f300 2026-02-18T21:01:29.319 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:01:29.319 INFO:teuthology.orchestra.run.trial068.stdout:{"epoch":16,"fsid":"73558818-cfd1-494a-84aa-56d128598ef4","created":"2026-02-18T21:01:11.071818+0000","modified":"2026-02-18T21:01:28.976515+0000","last_up_change":"2026-02-18T21:01:19.437203+0000","last_in_change":"2026-02-18T21:01:11.803245+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-18T21:01:20.913845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-18T21:01:25.650381+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"bb5f8e54-3a43-41d6-b266-aa412a7f170e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6809","nonce":25183}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6811","nonce":25183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6814","nonce":25183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6812","nonce":25183}]},"public_addr":"10.20.193.68:6809/25183","cluster_addr":"10.20.193.68:6811/25183","heartbeat_back_addr":"10.20.193.68:6814/25183","heartbeat_front_addr":"10.20.193.68:6812/25183","state":["exists","up"]},{"osd":1,"uuid":"e26d8762-250e-42e7-8768-23caa22edb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6808","nonce":25184}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6810","nonce":25184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6815","nonce":25184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6813","nonce":25184}]},"public_addr":"10.20.193.68:6808/25184","cluster_addr":"10.20.193.68:6810/25184","heartbeat_back_addr":"10.20.193.68:6815/25184","heartbeat_front_addr":"10.20.193.68:6813/25184","state":["exists","up"]},{"osd":2,"uuid":"568ee96d-39ac-4d79-92bb-d1f3f12601b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6800","nonce":25185}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6801","nonce":25185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6803","nonce":25185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6802","nonce":25185}]},"public_addr":"10.20.193.68:6800/25185","cluster_addr":"10.20.193.68:6801/25185","heartbeat_back_addr":"10.20.193.68:6803/25185","heartbeat_front_addr":"10.20.193.68:6802/25185","state":["exists","up"]},{"osd":3,"uuid":"765a38cd-f526-4aba-b94e-c57076ca6c72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6804","nonce":25186}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6805","nonce":25186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6807","nonce":25186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6806","nonce":25186}]},"public_addr":"10.20.193.68:6804/25186","cluster_addr":"10.20.193.68:6805/25186","heartbeat_back_addr":"10.20.193.68:6807/25186","heartbeat_front_addr":"10.20.193.68:6806/25186","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T21:01:29.320 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.317+0000 7f1d04cdb640 1 -- 10.20.193.68:0/2345034680 >> v1:10.20.193.68:6816/24610 conn(0x7f1ce004d0d0 legacy=0x7f1ce004f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.320 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.317+0000 7f1d04cdb640 1 -- 10.20.193.68:0/2345034680 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1d0008f300 msgr2=0x7f1d001be8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.320 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.317+0000 7f1d04cdb640 1 --2- 10.20.193.68:0/2345034680 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1d0008f300 0x7f1d001be8e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400ec80 tx=0x7f1cf40090f0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.320 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.317+0000 7f1d04cdb640 1 -- 10.20.193.68:0/2345034680 shutdown_connections 2026-02-18T21:01:29.320 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.317+0000 7f1d04cdb640 1 --2- 10.20.193.68:0/2345034680 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1d00095070 0x7f1d001bee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.321 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.317+0000 7f1d04cdb640 1 --2- 10.20.193.68:0/2345034680 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1d0008f300 0x7f1d001be8e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.321 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.317+0000 7f1d04cdb640 1 --2- 10.20.193.68:0/2345034680 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1d0008e9f0 0x7f1d001be3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.321 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.317+0000 7f1d04cdb640 1 -- 10.20.193.68:0/2345034680 >> 10.20.193.68:0/2345034680 conn(0x7f1d00095c20 msgr2=0x7f1d0012e510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.321 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.317+0000 7f1d04cdb640 1 -- 10.20.193.68:0/2345034680 shutdown_connections 2026-02-18T21:01:29.321 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.317+0000 7f1d04cdb640 1 -- 10.20.193.68:0/2345034680 wait complete. 2026-02-18T21:01:29.327 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-18T21:01:29.327 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-18T21:01:29.396 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.389+0000 7fea3f6be640 1 Processor -- start 2026-02-18T21:01:29.396 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.389+0000 7fea3f6be640 1 -- start start 2026-02-18T21:01:29.396 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.389+0000 7fea3f6be640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea38096a50 0x7fea38096e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.396 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.389+0000 7fea3f6be640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fea38097360 0x7fea38128e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.396 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.389+0000 7fea3f6be640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea38129370 0x7fea381297f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.396 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.389+0000 7fea3f6be640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea38098380 con 0x7fea38097360 2026-02-18T21:01:29.396 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.389+0000 7fea3f6be640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea38099300 con 0x7fea38096a50 2026-02-18T21:01:29.397 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.389+0000 7fea3f6be640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea38069000 con 0x7fea38129370 2026-02-18T21:01:29.397 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.389+0000 7fea3d45a640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea38096a50 0x7fea38096e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.397 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.389+0000 7fea3dc5b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea38129370 0x7fea381297f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.397 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.389+0000 7fea3cc59640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fea38097360 0x7fea38128e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.397 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.389+0000 7fea3d45a640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea38096a50 0x7fea38096e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:44498/0 (socket says 10.20.193.68:44498) 2026-02-18T21:01:29.397 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.389+0000 7fea3d45a640 1 -- 10.20.193.68:0/1870636241 learned_addr learned my addr 10.20.193.68:0/1870636241 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:29.397 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.390+0000 7fea3cc59640 1 -- 10.20.193.68:0/1870636241 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea38129370 msgr2=0x7fea381297f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:29.397 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.390+0000 7fea3cc59640 1 --2- 10.20.193.68:0/1870636241 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea38129370 0x7fea381297f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.397 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.390+0000 7fea3cc59640 1 -- 10.20.193.68:0/1870636241 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea38096a50 msgr2=0x7fea38096e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:29.397 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.390+0000 7fea3cc59640 1 --2- 10.20.193.68:0/1870636241 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea38096a50 0x7fea38096e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.397 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.390+0000 7fea3cc59640 1 -- 10.20.193.68:0/1870636241 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea38098f30 con 0x7fea38097360 2026-02-18T21:01:29.397 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.390+0000 7fea3cc59640 1 --2- 10.20.193.68:0/1870636241 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fea38097360 0x7fea38128e30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fea28009850 tx=0x7fea2802ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e945e331b179c239 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.398 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.390+0000 7fea2ffff640 1 -- 10.20.193.68:0/1870636241 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2802f980 con 0x7fea38097360 2026-02-18T21:01:29.398 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.390+0000 7fea2ffff640 1 -- 10.20.193.68:0/1870636241 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2802fae0 con 0x7fea38097360 2026-02-18T21:01:29.398 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.390+0000 7fea2ffff640 1 -- 10.20.193.68:0/1870636241 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea28037440 con 0x7fea38097360 2026-02-18T21:01:29.398 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.390+0000 7fea3f6be640 1 -- 10.20.193.68:0/1870636241 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fea38097360 msgr2=0x7fea38128e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.398 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.390+0000 7fea3f6be640 1 --2- 10.20.193.68:0/1870636241 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fea38097360 0x7fea38128e30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fea28009850 tx=0x7fea2802ee70 comp rx=0 tx=0).stop 2026-02-18T21:01:29.398 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.390+0000 7fea3f6be640 1 -- 10.20.193.68:0/1870636241 shutdown_connections 2026-02-18T21:01:29.398 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.390+0000 7fea3f6be640 1 --2- 10.20.193.68:0/1870636241 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea38129370 0x7fea381297f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.398 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.390+0000 7fea3f6be640 1 --2- 10.20.193.68:0/1870636241 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fea38097360 0x7fea38128e30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.398 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.390+0000 7fea3f6be640 1 --2- 10.20.193.68:0/1870636241 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea38096a50 0x7fea38096e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.398 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.390+0000 7fea3f6be640 1 -- 10.20.193.68:0/1870636241 >> 10.20.193.68:0/1870636241 conn(0x7fea3809da20 msgr2=0x7fea3809de20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.398 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.390+0000 7fea3f6be640 1 -- 10.20.193.68:0/1870636241 shutdown_connections 2026-02-18T21:01:29.398 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.390+0000 7fea3f6be640 1 -- 10.20.193.68:0/1870636241 wait complete. 2026-02-18T21:01:29.399 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.391+0000 7fea3f6be640 1 Processor -- start 2026-02-18T21:01:29.399 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.391+0000 7fea3f6be640 1 -- start start 2026-02-18T21:01:29.399 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.391+0000 7fea3f6be640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea38096a50 0x7fea3811a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.399 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.391+0000 7fea3f6be640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea38097360 0x7fea3811a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.399 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.391+0000 7fea3f6be640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fea38129370 0x7fea3811ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.399 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.391+0000 7fea3f6be640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3811d9b0 con 0x7fea38129370 2026-02-18T21:01:29.399 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.391+0000 7fea3f6be640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3811bd40 con 0x7fea38096a50 2026-02-18T21:01:29.399 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.391+0000 7fea3f6be640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea3811b290 con 0x7fea38097360 2026-02-18T21:01:29.399 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.391+0000 7fea3d45a640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea38096a50 0x7fea3811a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.399 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.391+0000 7fea3cc59640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea38097360 0x7fea3811a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.399 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.391+0000 7fea3dc5b640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fea38129370 0x7fea3811ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.399 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.391+0000 7fea3d45a640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea38096a50 0x7fea3811a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:44510/0 (socket says 10.20.193.68:44510) 2026-02-18T21:01:29.400 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.391+0000 7fea3d45a640 1 -- 10.20.193.68:0/1850945094 learned_addr learned my addr 10.20.193.68:0/1850945094 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:29.400 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.391+0000 7fea3cc59640 1 -- 10.20.193.68:0/1850945094 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea38096a50 msgr2=0x7fea3811a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.400 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.391+0000 7fea3cc59640 1 --2- 10.20.193.68:0/1850945094 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea38096a50 0x7fea3811a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.400 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.391+0000 7fea3cc59640 1 -- 10.20.193.68:0/1850945094 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fea38129370 msgr2=0x7fea3811ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.400 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.391+0000 7fea3cc59640 1 --2- 10.20.193.68:0/1850945094 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fea38129370 0x7fea3811ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.400 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.391+0000 7fea3cc59640 1 -- 10.20.193.68:0/1850945094 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea28009390 con 0x7fea38097360 2026-02-18T21:01:29.400 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.391+0000 7fea3d45a640 1 --2- 10.20.193.68:0/1850945094 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea38096a50 0x7fea3811a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:29.400 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.391+0000 7fea3dc5b640 1 --2- 10.20.193.68:0/1850945094 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fea38129370 0x7fea3811ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:29.400 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.392+0000 7fea3cc59640 1 --2- 10.20.193.68:0/1850945094 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea38097360 0x7fea3811a720 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fea28036000 tx=0x7fea28037000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.400 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.392+0000 7fea2dffb640 1 -- 10.20.193.68:0/1850945094 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea28042720 con 0x7fea38097360 2026-02-18T21:01:29.400 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.392+0000 7fea2dffb640 1 -- 10.20.193.68:0/1850945094 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea28042880 con 0x7fea38097360 2026-02-18T21:01:29.400 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.392+0000 7fea3f6be640 1 -- 10.20.193.68:0/1850945094 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea3811d5d0 con 0x7fea38097360 2026-02-18T21:01:29.401 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.392+0000 7fea2dffb640 1 -- 10.20.193.68:0/1850945094 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea28042c20 con 0x7fea38097360 2026-02-18T21:01:29.401 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.392+0000 7fea3f6be640 1 -- 10.20.193.68:0/1850945094 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea381be330 con 0x7fea38097360 2026-02-18T21:01:29.401 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.392+0000 7fea3f6be640 1 -- 10.20.193.68:0/1850945094 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3811d0c0 con 0x7fea38097360 2026-02-18T21:01:29.401 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.392+0000 7fea2dffb640 1 -- 10.20.193.68:0/1850945094 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7fea2803e040 con 0x7fea38097360 2026-02-18T21:01:29.401 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.393+0000 7fea2dffb640 1 -- 10.20.193.68:0/1850945094 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7fea280884d0 con 0x7fea38097360 2026-02-18T21:01:29.401 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.394+0000 7fea2dffb640 1 -- 10.20.193.68:0/1850945094 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7fea280633d0 con 0x7fea38097360 2026-02-18T21:01:29.460 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.458+0000 7fea3f6be640 1 -- 10.20.193.68:0/1850945094 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea3805f010 con 0x7fea38097360 2026-02-18T21:01:29.461 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.458+0000 7fea2dffb640 1 -- 10.20.193.68:0/1850945094 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+8077 (secure 0 0 0) 0x7fea28047090 con 0x7fea38097360 2026-02-18T21:01:29.461 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:01:29.461 INFO:teuthology.orchestra.run.trial068.stdout:{"epoch":16,"fsid":"73558818-cfd1-494a-84aa-56d128598ef4","created":"2026-02-18T21:01:11.071818+0000","modified":"2026-02-18T21:01:28.976515+0000","last_up_change":"2026-02-18T21:01:19.437203+0000","last_in_change":"2026-02-18T21:01:11.803245+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-18T21:01:20.913845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-18T21:01:25.650381+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"bb5f8e54-3a43-41d6-b266-aa412a7f170e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6809","nonce":25183}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6811","nonce":25183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6814","nonce":25183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6812","nonce":25183}]},"public_addr":"10.20.193.68:6809/25183","cluster_addr":"10.20.193.68:6811/25183","heartbeat_back_addr":"10.20.193.68:6814/25183","heartbeat_front_addr":"10.20.193.68:6812/25183","state":["exists","up"]},{"osd":1,"uuid":"e26d8762-250e-42e7-8768-23caa22edb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6808","nonce":25184}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6810","nonce":25184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6815","nonce":25184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6813","nonce":25184}]},"public_addr":"10.20.193.68:6808/25184","cluster_addr":"10.20.193.68:6810/25184","heartbeat_back_addr":"10.20.193.68:6815/25184","heartbeat_front_addr":"10.20.193.68:6813/25184","state":["exists","up"]},{"osd":2,"uuid":"568ee96d-39ac-4d79-92bb-d1f3f12601b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6800","nonce":25185}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6801","nonce":25185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6803","nonce":25185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6802","nonce":25185}]},"public_addr":"10.20.193.68:6800/25185","cluster_addr":"10.20.193.68:6801/25185","heartbeat_back_addr":"10.20.193.68:6803/25185","heartbeat_front_addr":"10.20.193.68:6802/25185","state":["exists","up"]},{"osd":3,"uuid":"765a38cd-f526-4aba-b94e-c57076ca6c72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6804","nonce":25186}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6805","nonce":25186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6807","nonce":25186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6806","nonce":25186}]},"public_addr":"10.20.193.68:6804/25186","cluster_addr":"10.20.193.68:6805/25186","heartbeat_back_addr":"10.20.193.68:6807/25186","heartbeat_front_addr":"10.20.193.68:6806/25186","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T21:01:29.462 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.459+0000 7fea3f6be640 1 -- 10.20.193.68:0/1850945094 >> v1:10.20.193.68:6816/24610 conn(0x7fea1c04d0d0 legacy=0x7fea1c04f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.462 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.459+0000 7fea3f6be640 1 -- 10.20.193.68:0/1850945094 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea38097360 msgr2=0x7fea3811a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.462 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.459+0000 7fea3f6be640 1 --2- 10.20.193.68:0/1850945094 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea38097360 0x7fea3811a720 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fea28036000 tx=0x7fea28037000 comp rx=0 tx=0).stop 2026-02-18T21:01:29.463 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.459+0000 7fea3f6be640 1 -- 10.20.193.68:0/1850945094 shutdown_connections 2026-02-18T21:01:29.463 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.459+0000 7fea3f6be640 1 --2- 10.20.193.68:0/1850945094 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fea38129370 0x7fea3811ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.463 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.459+0000 7fea3f6be640 1 --2- 10.20.193.68:0/1850945094 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea38097360 0x7fea3811a720 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.463 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.459+0000 7fea3f6be640 1 --2- 10.20.193.68:0/1850945094 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea38096a50 0x7fea3811a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.463 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.459+0000 7fea3f6be640 1 -- 10.20.193.68:0/1850945094 >> 10.20.193.68:0/1850945094 conn(0x7fea3809da20 msgr2=0x7fea381b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.463 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.459+0000 7fea3f6be640 1 -- 10.20.193.68:0/1850945094 shutdown_connections 2026-02-18T21:01:29.463 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.459+0000 7fea3f6be640 1 -- 10.20.193.68:0/1850945094 wait complete. 2026-02-18T21:01:29.469 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-18T21:01:29.470 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-18T21:01:29.470 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-18T21:01:29.471 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-18T21:01:29.538 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7fcfa6e39640 1 Processor -- start 2026-02-18T21:01:29.538 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7fcfa6e39640 1 -- start start 2026-02-18T21:01:29.538 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7fcfa6e39640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fcfa0096a50 0x7fcfa0096e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.538 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7f089dedb640 1 Processor -- start 2026-02-18T21:01:29.539 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7fcfa6e39640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcfa0097360 0x7fcfa0129d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.539 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7fcfa6e39640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcfa0097770 0x7fcfa012a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.539 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7fcfa6e39640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa0099380 con 0x7fcfa0096a50 2026-02-18T21:01:29.539 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7fcfa6e39640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa0098880 con 0x7fcfa0097360 2026-02-18T21:01:29.539 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7fcfa6e39640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa00996e0 con 0x7fcfa0097770 2026-02-18T21:01:29.540 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7f089dedb640 1 -- start start 2026-02-18T21:01:29.540 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7fcfa5636640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcfa0097360 0x7fcfa0129d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.540 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7fcfa6638640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcfa0097770 0x7fcfa012a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.540 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7fcfa5e37640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fcfa0096a50 0x7fcfa0096e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.541 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7fcfa6638640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcfa0097770 0x7fcfa012a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:34626/0 (socket says 10.20.193.68:34626) 2026-02-18T21:01:29.541 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7fcfa5636640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcfa0097360 0x7fcfa0129d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:44516/0 (socket says 10.20.193.68:44516) 2026-02-18T21:01:29.541 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7fcfa6638640 1 -- 10.20.193.68:0/2214363586 learned_addr learned my addr 10.20.193.68:0/2214363586 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:29.541 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7f50c3ec7640 1 Processor -- start 2026-02-18T21:01:29.541 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7f50c3ec7640 1 -- start start 2026-02-18T21:01:29.542 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7fcfa6638640 1 -- 10.20.193.68:0/2214363586 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcfa0097360 msgr2=0x7fcfa0129d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:29.542 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7fcfa6638640 1 --2- 10.20.193.68:0/2214363586 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcfa0097360 0x7fcfa0129d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.542 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7fcfa6638640 1 -- 10.20.193.68:0/2214363586 >> v2:10.20.193.68:3300/0 conn(0x7fcfa0096a50 msgr2=0x7fcfa0096e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:29.542 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7fcfa6638640 1 --2- 10.20.193.68:0/2214363586 >> v2:10.20.193.68:3300/0 conn(0x7fcfa0096a50 0x7fcfa0096e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.542 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7fcfa6638640 1 -- 10.20.193.68:0/2214363586 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa009a550 con 0x7fcfa0097770 2026-02-18T21:01:29.542 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7fcfa5e37640 1 --2- 10.20.193.68:0/2214363586 >> v2:10.20.193.68:3300/0 conn(0x7fcfa0096a50 0x7fcfa0096e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:29.543 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.535+0000 7f089dedb640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f0898096a50 0x7f0898096e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.543 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f089dedb640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0898097730 0x7f089812a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.543 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f089dedb640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0898098250 con 0x7f0898097360 2026-02-18T21:01:29.543 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f089dedb640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08980991d0 con 0x7f0898096a50 2026-02-18T21:01:29.543 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f089dedb640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08980690d0 con 0x7f0898097730 2026-02-18T21:01:29.543 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f08977fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f0898096a50 0x7f0898096e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.543 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f0896ffd640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f0898097360 0x7f0898129eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:43738/0 (socket says 10.20.193.68:43738) 2026-02-18T21:01:29.544 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f0896ffd640 1 -- 10.20.193.68:0/2576860919 learned_addr learned my addr 10.20.193.68:0/2576860919 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:01:29.544 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f0897fff640 1 --2- 10.20.193.68:0/2576860919 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0898097730 0x7f089812a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.544 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f50c3ec7640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f50bc08f360 0x7f50bc08f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.544 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f0897fff640 1 -- 10.20.193.68:0/2576860919 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f0898096a50 msgr2=0x7f0898096e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:29.544 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f08967fc640 1 -- 10.20.193.68:0/2576860919 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568735747 0 0) 0x7f0898098250 con 0x7f0898097360 2026-02-18T21:01:29.544 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f0897fff640 1 --2- 10.20.193.68:0/2576860919 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f0898096a50 0x7f0898096e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.545 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f0897fff640 1 -- 10.20.193.68:0/2576860919 >> v1:10.20.193.68:6789/0 conn(0x7f0898097360 legacy=0x7f0898129eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.545 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f50c3ec7640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f50bc12dbb0 0x7f50bc12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.545 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f0897fff640 1 -- 10.20.193.68:0/2576860919 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0898098e00 con 0x7f0898097730 2026-02-18T21:01:29.546 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f50c3ec7640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50bc0918b0 con 0x7f50bc08fc70 2026-02-18T21:01:29.546 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f50c3ec7640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc090f20 con 0x7f50bc08f360 2026-02-18T21:01:29.546 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f08977fe640 1 --2- 10.20.193.68:0/2576860919 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f0898096a50 0x7f0898096e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:29.547 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f50c3ec7640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc0979a0 con 0x7f50bc12dbb0 2026-02-18T21:01:29.547 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f50c1c63640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f50bc08f360 0x7f50bc08f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.547 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7efc8ec28640 1 Processor -- start 2026-02-18T21:01:29.547 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f50c1462640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f50bc08fc70 0x7f50bc12c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:43750/0 (socket says 10.20.193.68:43750) 2026-02-18T21:01:29.548 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f50c1c63640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f50bc08f360 0x7f50bc08f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:44534/0 (socket says 10.20.193.68:44534) 2026-02-18T21:01:29.548 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f50c1462640 1 -- 10.20.193.68:0/3285682806 learned_addr learned my addr 10.20.193.68:0/3285682806 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:01:29.548 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f50c2464640 1 --2- 10.20.193.68:0/3285682806 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f50bc12dbb0 0x7f50bc12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.548 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7fcfa6638640 1 --2- 10.20.193.68:0/2214363586 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcfa0097770 0x7fcfa012a2a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009f20 tx=0x7fcf9802f310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c98509815476fb2 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.548 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7efc8ec28640 1 -- start start 2026-02-18T21:01:29.549 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7fcfa4e35640 1 -- 10.20.193.68:0/2214363586 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9802fc10 con 0x7fcfa0097770 2026-02-18T21:01:29.549 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f50c1c63640 1 -- 10.20.193.68:0/3285682806 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f50bc12dbb0 msgr2=0x7f50bc12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:29.549 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f50c1c63640 1 --2- 10.20.193.68:0/3285682806 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f50bc12dbb0 0x7f50bc12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.549 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f50c1c63640 1 -- 10.20.193.68:0/3285682806 >> v1:10.20.193.68:6789/0 conn(0x7f50bc08fc70 legacy=0x7f50bc12c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.550 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f50c1c63640 1 -- 10.20.193.68:0/3285682806 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc0908f0 con 0x7f50bc08f360 2026-02-18T21:01:29.550 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f50c0c61640 1 -- 10.20.193.68:0/3285682806 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716527265 0 0) 0x7f50bc0918b0 con 0x7f50bc08fc70 2026-02-18T21:01:29.550 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7fcfa4e35640 1 -- 10.20.193.68:0/2214363586 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9802fd70 con 0x7fcfa0097770 2026-02-18T21:01:29.550 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7fcfa4e35640 1 -- 10.20.193.68:0/2214363586 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98007630 con 0x7fcfa0097770 2026-02-18T21:01:29.550 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f0897fff640 1 --2- 10.20.193.68:0/2576860919 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0898097730 0x7f089812a5c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0890009e90 tx=0x7f089002f340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42018077592d51b3 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.551 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7efc8ec28640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7efc8806a180 0x7efc8806a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.551 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7efc8ec28640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7efc8806aa90 0x7efc88093090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.551 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7fcfa6e39640 1 -- 10.20.193.68:0/2214363586 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcfa0097770 msgr2=0x7fcfa012a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.551 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7fcfa6e39640 1 --2- 10.20.193.68:0/2214363586 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcfa0097770 0x7fcfa012a2a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009f20 tx=0x7fcf9802f310 comp rx=0 tx=0).stop 2026-02-18T21:01:29.552 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7efc8ec28640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8806de40 con 0x7efc8806ae60 2026-02-18T21:01:29.552 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7efc8ec28640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc88069a70 con 0x7efc8806a180 2026-02-18T21:01:29.552 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7efc8ec28640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc880693b0 con 0x7efc8806aa90 2026-02-18T21:01:29.552 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f08967fc640 1 -- 10.20.193.68:0/2576860919 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089002fe10 con 0x7f0898097730 2026-02-18T21:01:29.553 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7fcfa6e39640 1 -- 10.20.193.68:0/2214363586 shutdown_connections 2026-02-18T21:01:29.553 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7fcfa6e39640 1 --2- 10.20.193.68:0/2214363586 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcfa0097360 0x7fcfa0129d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.553 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7fcfa6e39640 1 --2- 10.20.193.68:0/2214363586 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcfa0097770 0x7fcfa012a2a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.553 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f08967fc640 1 -- 10.20.193.68:0/2576860919 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0890037440 con 0x7f0898097730 2026-02-18T21:01:29.553 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7fcfa6e39640 1 --2- 10.20.193.68:0/2214363586 >> v2:10.20.193.68:3300/0 conn(0x7fcfa0096a50 0x7fcfa0096e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.554 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7fcfa6e39640 1 -- 10.20.193.68:0/2214363586 >> 10.20.193.68:0/2214363586 conn(0x7fcfa009d8d0 msgr2=0x7fcfa009dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.554 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f08967fc640 1 -- 10.20.193.68:0/2576860919 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08900377e0 con 0x7f0898097730 2026-02-18T21:01:29.554 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7fcfa6e39640 1 -- 10.20.193.68:0/2214363586 shutdown_connections 2026-02-18T21:01:29.555 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7efc8c9c4640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7efc8806a180 0x7efc8806a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.555 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7fcfa6e39640 1 -- 10.20.193.68:0/2214363586 wait complete. 2026-02-18T21:01:29.555 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7efc87fff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7efc8806aa90 0x7efc88093090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.555 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7efc8d1c5640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7efc8806ae60 0x7efc880935d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:43760/0 (socket says 10.20.193.68:43760) 2026-02-18T21:01:29.556 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7efc8d1c5640 1 -- 10.20.193.68:0/3561346628 learned_addr learned my addr 10.20.193.68:0/3561346628 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:01:29.556 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7efc8c9c4640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7efc8806a180 0x7efc8806a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:44536/0 (socket says 10.20.193.68:44536) 2026-02-18T21:01:29.556 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.536+0000 7f50c1c63640 1 --2- 10.20.193.68:0/3285682806 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f50bc08f360 0x7f50bc08f730 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f50b00098b0 tx=0x7f50b002ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=292ca0eb3d3f7276 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.556 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7efc877fe640 1 -- 10.20.193.68:0/3561346628 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040395563 0 0) 0x7efc8806de40 con 0x7efc8806ae60 2026-02-18T21:01:29.556 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7efc877fe640 1 -- 10.20.193.68:0/3561346628 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc780034e0 con 0x7efc8806ae60 2026-02-18T21:01:29.557 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f50c0c61640 1 -- 10.20.193.68:0/3285682806 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b002f880 con 0x7f50bc08f360 2026-02-18T21:01:29.557 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f089dedb640 1 -- 10.20.193.68:0/2576860919 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0898097730 msgr2=0x7f089812a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.557 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f089dedb640 1 --2- 10.20.193.68:0/2576860919 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0898097730 0x7f089812a5c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0890009e90 tx=0x7f089002f340 comp rx=0 tx=0).stop 2026-02-18T21:01:29.558 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7efc8c9c4640 1 -- 10.20.193.68:0/3561346628 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7efc8806aa90 msgr2=0x7efc88093090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:29.558 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7efc8c9c4640 1 --2- 10.20.193.68:0/3561346628 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7efc8806aa90 0x7efc88093090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.558 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7efc8c9c4640 1 -- 10.20.193.68:0/3561346628 >> v1:10.20.193.68:6789/0 conn(0x7efc8806ae60 legacy=0x7efc880935d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.558 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f50c0c61640 1 -- 10.20.193.68:0/3285682806 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b002f9e0 con 0x7f50bc08f360 2026-02-18T21:01:29.558 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f50c0c61640 1 -- 10.20.193.68:0/3285682806 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b002fd80 con 0x7f50bc08f360 2026-02-18T21:01:29.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7efc8c9c4640 1 -- 10.20.193.68:0/3561346628 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc88063330 con 0x7efc8806a180 2026-02-18T21:01:29.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7efc87fff640 1 --2- 10.20.193.68:0/3561346628 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7efc8806aa90 0x7efc88093090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:29.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f089dedb640 1 -- 10.20.193.68:0/2576860919 shutdown_connections 2026-02-18T21:01:29.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f089dedb640 1 --2- 10.20.193.68:0/2576860919 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0898097730 0x7f089812a5c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f089dedb640 1 --2- 10.20.193.68:0/2576860919 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f0898096a50 0x7f0898096e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f089dedb640 1 -- 10.20.193.68:0/2576860919 >> 10.20.193.68:0/2576860919 conn(0x7f089809dc60 msgr2=0x7f089809e060 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f089dedb640 1 -- 10.20.193.68:0/2576860919 shutdown_connections 2026-02-18T21:01:29.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f089dedb640 1 -- 10.20.193.68:0/2576860919 wait complete. 2026-02-18T21:01:29.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f50c3ec7640 1 -- 10.20.193.68:0/3285682806 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f50bc08f360 msgr2=0x7f50bc08f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f50c3ec7640 1 --2- 10.20.193.68:0/3285682806 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f50bc08f360 0x7f50bc08f730 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f50b00098b0 tx=0x7f50b002ed60 comp rx=0 tx=0).stop 2026-02-18T21:01:29.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f50c3ec7640 1 -- 10.20.193.68:0/3285682806 shutdown_connections 2026-02-18T21:01:29.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f50c3ec7640 1 --2- 10.20.193.68:0/3285682806 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f50bc12dbb0 0x7f50bc12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f50c3ec7640 1 --2- 10.20.193.68:0/3285682806 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f50bc08f360 0x7f50bc08f730 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7fcfa6e39640 1 Processor -- start 2026-02-18T21:01:29.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f50c3ec7640 1 -- 10.20.193.68:0/3285682806 >> 10.20.193.68:0/3285682806 conn(0x7f50bc09bf60 msgr2=0x7f50bc097e10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f50c3ec7640 1 -- 10.20.193.68:0/3285682806 shutdown_connections 2026-02-18T21:01:29.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f50c3ec7640 1 -- 10.20.193.68:0/3285682806 wait complete. 2026-02-18T21:01:29.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7efc8c9c4640 1 --2- 10.20.193.68:0/3561346628 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7efc8806a180 0x7efc8806a550 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009880 tx=0x7efc7c02ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ccf29d3564c416 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.563 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7fcfa6e39640 1 -- start start 2026-02-18T21:01:29.563 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7efc877fe640 1 -- 10.20.193.68:0/3561346628 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c02f890 con 0x7efc8806a180 2026-02-18T21:01:29.563 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7efc877fe640 1 -- 10.20.193.68:0/3561346628 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c02f9f0 con 0x7efc8806a180 2026-02-18T21:01:29.563 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7efc877fe640 1 -- 10.20.193.68:0/3561346628 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c02fd90 con 0x7efc8806a180 2026-02-18T21:01:29.564 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7fcfa6e39640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fcfa0096a50 0x7fcfa01be1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.564 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7fcfa6e39640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcfa0097360 0x7fcfa01be700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.564 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7fcfa6e39640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcfa0097770 0x7fcfa011b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.564 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7fcfa6e39640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa011ebd0 con 0x7fcfa0096a50 2026-02-18T21:01:29.564 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7fcfa6e39640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa011df40 con 0x7fcfa0097770 2026-02-18T21:01:29.565 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f089dedb640 1 Processor -- start 2026-02-18T21:01:29.565 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7fcfa6e39640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa011e720 con 0x7fcfa0097360 2026-02-18T21:01:29.565 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7fcfa5e37640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fcfa0096a50 0x7fcfa01be1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.566 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7fcfa6638640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcfa0097770 0x7fcfa011b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.566 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7f089dedb640 1 -- start start 2026-02-18T21:01:29.566 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7fcfa5e37640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fcfa0096a50 0x7fcfa01be1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:37804/0 (socket says 10.20.193.68:37804) 2026-02-18T21:01:29.566 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7fcfa5e37640 1 -- 10.20.193.68:0/645159808 learned_addr learned my addr 10.20.193.68:0/645159808 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:29.567 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7fcfa5636640 1 --2- 10.20.193.68:0/645159808 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcfa0097360 0x7fcfa01be700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.567 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7efc8ec28640 1 -- 10.20.193.68:0/3561346628 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7efc8806a180 msgr2=0x7efc8806a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.567 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.537+0000 7efc8ec28640 1 --2- 10.20.193.68:0/3561346628 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7efc8806a180 0x7efc8806a550 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009880 tx=0x7efc7c02ed80 comp rx=0 tx=0).stop 2026-02-18T21:01:29.567 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7efc8ec28640 1 -- 10.20.193.68:0/3561346628 shutdown_connections 2026-02-18T21:01:29.567 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7efc8ec28640 1 --2- 10.20.193.68:0/3561346628 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7efc8806aa90 0x7efc88093090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.567 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7efc8ec28640 1 --2- 10.20.193.68:0/3561346628 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7efc8806a180 0x7efc8806a550 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.568 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7efc8ec28640 1 -- 10.20.193.68:0/3561346628 >> 10.20.193.68:0/3561346628 conn(0x7efc880967b0 msgr2=0x7efc88096bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.568 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7fcfa5e37640 1 -- 10.20.193.68:0/645159808 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcfa0097360 msgr2=0x7fcfa01be700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.568 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7fcfa5e37640 1 --2- 10.20.193.68:0/645159808 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fcfa0097360 0x7fcfa01be700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.568 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7fcfa5e37640 1 -- 10.20.193.68:0/645159808 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcfa0097770 msgr2=0x7fcfa011b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.568 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7fcfa5e37640 1 --2- 10.20.193.68:0/645159808 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fcfa0097770 0x7fcfa011b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.568 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7fcfa5e37640 1 -- 10.20.193.68:0/645159808 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c009390 con 0x7fcfa0096a50 2026-02-18T21:01:29.569 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c3ec7640 1 Processor -- start 2026-02-18T21:01:29.569 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7efc8ec28640 1 -- 10.20.193.68:0/3561346628 shutdown_connections 2026-02-18T21:01:29.569 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7efc8ec28640 1 -- 10.20.193.68:0/3561346628 wait complete. 2026-02-18T21:01:29.570 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7fcfa5e37640 1 --2- 10.20.193.68:0/645159808 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fcfa0096a50 0x7fcfa01be1c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00ea70 tx=0x7fcf9c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.570 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c3ec7640 1 -- start start 2026-02-18T21:01:29.570 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f089dedb640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0898096a50 0x7f089811e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.570 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f089dedb640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f0898097360 0x7f089811ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f089dedb640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f0898097730 0x7f089811f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f089dedb640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0898121620 con 0x7f0898097360 2026-02-18T21:01:29.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f089dedb640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08981204d0 con 0x7f0898097730 2026-02-18T21:01:29.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7fcf967fc640 1 -- 10.20.193.68:0/645159808 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c00cae0 con 0x7fcfa0096a50 2026-02-18T21:01:29.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f089dedb640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0898121ec0 con 0x7f0898096a50 2026-02-18T21:01:29.572 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7fcf967fc640 1 -- 10.20.193.68:0/645159808 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9c00cc40 con 0x7fcfa0096a50 2026-02-18T21:01:29.572 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7fcfa6e39640 1 -- 10.20.193.68:0/645159808 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf98009ae0 con 0x7fcfa0096a50 2026-02-18T21:01:29.572 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7fcf967fc640 1 -- 10.20.193.68:0/645159808 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c013470 con 0x7fcfa0096a50 2026-02-18T21:01:29.572 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f08977fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0898096a50 0x7f089811e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.572 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f0896ffd640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f0898097360 0x7f089811ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.573 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f08977fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0898096a50 0x7f089811e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:34666/0 (socket says 10.20.193.68:34666) 2026-02-18T21:01:29.573 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f0897fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f0898097730 0x7f089811f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.573 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f08977fe640 1 -- 10.20.193.68:0/900123115 learned_addr learned my addr 10.20.193.68:0/900123115 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:29.573 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f0896ffd640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f0898097360 0x7f089811ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:37810/0 (socket says 10.20.193.68:37810) 2026-02-18T21:01:29.573 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7fcfa6e39640 1 -- 10.20.193.68:0/645159808 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa01bec40 con 0x7fcfa0096a50 2026-02-18T21:01:29.573 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f08977fe640 1 -- 10.20.193.68:0/900123115 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f0898097730 msgr2=0x7f089811f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.574 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f08977fe640 1 --2- 10.20.193.68:0/900123115 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f0898097730 0x7f089811f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.574 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f08977fe640 1 -- 10.20.193.68:0/900123115 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f0898097360 msgr2=0x7f089811ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.574 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f08977fe640 1 --2- 10.20.193.68:0/900123115 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f0898097360 0x7f089811ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.574 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f08977fe640 1 -- 10.20.193.68:0/900123115 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0888009390 con 0x7f0898096a50 2026-02-18T21:01:29.574 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c3ec7640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f50bc08f360 0x7f50bc12d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.574 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c3ec7640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f50bc08fc70 0x7f50bc1203f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.575 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c3ec7640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f50bc12dbb0 0x7f50bc120930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.575 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f08977fe640 1 --2- 10.20.193.68:0/900123115 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0898096a50 0x7f089811e9f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f088800ec80 tx=0x7f08880090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.575 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c3ec7640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc094c40 con 0x7f50bc08fc70 2026-02-18T21:01:29.576 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c3ec7640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc122310 con 0x7f50bc08f360 2026-02-18T21:01:29.576 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c3ec7640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc1226e0 con 0x7f50bc12dbb0 2026-02-18T21:01:29.576 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c1462640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f50bc08fc70 0x7f50bc1203f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.576 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c1c63640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f50bc08f360 0x7f50bc12d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.576 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c1462640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f50bc08fc70 0x7f50bc1203f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:37814/0 (socket says 10.20.193.68:37814) 2026-02-18T21:01:29.576 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c1462640 1 -- 10.20.193.68:0/4132254651 learned_addr learned my addr 10.20.193.68:0/4132254651 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:29.576 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c2464640 1 --2- 10.20.193.68:0/4132254651 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f50bc12dbb0 0x7f50bc120930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.577 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f087ffff640 1 -- 10.20.193.68:0/900123115 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088800cbd0 con 0x7f0898096a50 2026-02-18T21:01:29.577 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f087ffff640 1 -- 10.20.193.68:0/900123115 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088800cd30 con 0x7f0898096a50 2026-02-18T21:01:29.577 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f089dedb640 1 -- 10.20.193.68:0/900123115 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0890009a20 con 0x7f0898096a50 2026-02-18T21:01:29.577 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f087ffff640 1 -- 10.20.193.68:0/900123115 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08880136a0 con 0x7f0898096a50 2026-02-18T21:01:29.577 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7fcfa6e39640 1 -- 10.20.193.68:0/645159808 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcfa01bee90 con 0x7fcfa0096a50 2026-02-18T21:01:29.577 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c1462640 1 -- 10.20.193.68:0/4132254651 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f50bc12dbb0 msgr2=0x7f50bc120930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.577 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c1462640 1 --2- 10.20.193.68:0/4132254651 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f50bc12dbb0 0x7f50bc120930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.577 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c1462640 1 -- 10.20.193.68:0/4132254651 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f50bc08f360 msgr2=0x7f50bc12d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.578 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f089dedb640 1 -- 10.20.193.68:0/900123115 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f089812a2c0 con 0x7f0898096a50 2026-02-18T21:01:29.578 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c1462640 1 --2- 10.20.193.68:0/4132254651 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f50bc08f360 0x7f50bc12d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.578 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c1462640 1 -- 10.20.193.68:0/4132254651 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b0009390 con 0x7f50bc08fc70 2026-02-18T21:01:29.578 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c1462640 1 --2- 10.20.193.68:0/4132254651 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f50bc08fc70 0x7f50bc1203f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f50b800c560 tx=0x7f50b8007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.578 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50ae7fc640 1 -- 10.20.193.68:0/4132254651 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b8005aa0 con 0x7f50bc08fc70 2026-02-18T21:01:29.578 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50ae7fc640 1 -- 10.20.193.68:0/4132254651 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b8005c20 con 0x7f50bc08fc70 2026-02-18T21:01:29.579 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50ae7fc640 1 -- 10.20.193.68:0/4132254651 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b8007340 con 0x7f50bc08fc70 2026-02-18T21:01:29.579 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7efc8ec28640 1 Processor -- start 2026-02-18T21:01:29.579 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c3ec7640 1 -- 10.20.193.68:0/4132254651 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50bc06f0a0 con 0x7f50bc08fc70 2026-02-18T21:01:29.579 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7fcf967fc640 1 -- 10.20.193.68:0/645159808 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7fcf9c013820 con 0x7fcfa0096a50 2026-02-18T21:01:29.579 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.538+0000 7f50c3ec7640 1 -- 10.20.193.68:0/4132254651 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50bc06e8c0 con 0x7f50bc08fc70 2026-02-18T21:01:29.580 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc8ec28640 1 -- start start 2026-02-18T21:01:29.580 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7f089dedb640 1 -- 10.20.193.68:0/900123115 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f089805f010 con 0x7f0898096a50 2026-02-18T21:01:29.580 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7fcf967fc640 1 -- 10.20.193.68:0/645159808 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7fcf9c063c60 con 0x7fcfa0096a50 2026-02-18T21:01:29.580 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc8ec28640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7efc8806a180 0x7efc8806b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.580 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc8ec28640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7efc8806aa90 0x7efc8806b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.581 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7f50c3ec7640 1 -- 10.20.193.68:0/4132254651 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f50bc05f010 con 0x7f50bc08fc70 2026-02-18T21:01:29.581 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc8ec28640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7efc8806ae60 0x7efc8806bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.581 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7fcf967fc640 1 -- 10.20.193.68:0/645159808 --> v1:10.20.193.68:6804/25186 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf84057460 con 0x7fcf84053780 2026-02-18T21:01:29.581 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7fcf967fc640 1 -- 10.20.193.68:0/645159808 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf9c068220 con 0x7fcfa0096a50 2026-02-18T21:01:29.582 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc8ec28640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc88090b30 con 0x7efc8806ae60 2026-02-18T21:01:29.582 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc8ec28640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc88090d60 con 0x7efc8806a180 2026-02-18T21:01:29.582 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc8ec28640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc88125810 con 0x7efc8806aa90 2026-02-18T21:01:29.582 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc8c9c4640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7efc8806a180 0x7efc8806b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.582 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc8c9c4640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7efc8806a180 0x7efc8806b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:44590/0 (socket says 10.20.193.68:44590) 2026-02-18T21:01:29.582 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc8c9c4640 1 -- 10.20.193.68:0/2070293021 learned_addr learned my addr 10.20.193.68:0/2070293021 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:29.582 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc87fff640 1 --2- 10.20.193.68:0/2070293021 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7efc8806aa90 0x7efc8806b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.582 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7f50ae7fc640 1 -- 10.20.193.68:0/4132254651 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f50b801b400 con 0x7f50bc08fc70 2026-02-18T21:01:29.582 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc8d1c5640 1 --2- 10.20.193.68:0/2070293021 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7efc8806ae60 0x7efc8806bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.583 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7f087ffff640 1 -- 10.20.193.68:0/900123115 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f0888013a10 con 0x7f0898096a50 2026-02-18T21:01:29.583 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc8c9c4640 1 -- 10.20.193.68:0/2070293021 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7efc8806aa90 msgr2=0x7efc8806b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.583 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc8c9c4640 1 --2- 10.20.193.68:0/2070293021 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7efc8806aa90 0x7efc8806b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.583 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc8c9c4640 1 -- 10.20.193.68:0/2070293021 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7efc8806ae60 msgr2=0x7efc8806bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.583 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc8c9c4640 1 --2- 10.20.193.68:0/2070293021 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7efc8806ae60 0x7efc8806bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.583 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc8c9c4640 1 -- 10.20.193.68:0/2070293021 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc74009390 con 0x7efc8806a180 2026-02-18T21:01:29.584 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc8d1c5640 1 --2- 10.20.193.68:0/2070293021 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7efc8806ae60 0x7efc8806bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-18T21:01:29.584 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc8c9c4640 1 --2- 10.20.193.68:0/2070293021 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7efc8806a180 0x7efc8806b2c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009360 tx=0x7efc7c037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.584 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc857fa640 1 -- 10.20.193.68:0/2070293021 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c037d90 con 0x7efc8806a180 2026-02-18T21:01:29.584 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7f50ae7fc640 1 -- 10.20.193.68:0/4132254651 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f50b80631d0 con 0x7f50bc08fc70 2026-02-18T21:01:29.584 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc857fa640 1 -- 10.20.193.68:0/2070293021 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c042440 con 0x7efc8806a180 2026-02-18T21:01:29.584 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc8ec28640 1 -- 10.20.193.68:0/2070293021 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7c009390 con 0x7efc8806a180 2026-02-18T21:01:29.584 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc857fa640 1 -- 10.20.193.68:0/2070293021 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c0427e0 con 0x7efc8806a180 2026-02-18T21:01:29.585 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7efc8ec28640 1 -- 10.20.193.68:0/2070293021 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc8806c280 con 0x7efc8806a180 2026-02-18T21:01:29.585 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7f50ae7fc640 1 -- 10.20.193.68:0/4132254651 --> v1:10.20.193.68:6808/25184 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50a0057460 con 0x7f50a0053780 2026-02-18T21:01:29.585 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7f50ae7fc640 1 -- 10.20.193.68:0/4132254651 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50b8065810 con 0x7f50bc08fc70 2026-02-18T21:01:29.585 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7f087ffff640 1 -- 10.20.193.68:0/900123115 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f0888064020 con 0x7f0898096a50 2026-02-18T21:01:29.585 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7f087ffff640 1 -- 10.20.193.68:0/900123115 --> v1:10.20.193.68:6800/25185 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0884057430 con 0x7f0884053750 2026-02-18T21:01:29.585 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.539+0000 7f087ffff640 1 -- 10.20.193.68:0/900123115 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08880643f0 con 0x7f0898096a50 2026-02-18T21:01:29.586 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.540+0000 7efc8ec28640 1 -- 10.20.193.68:0/2070293021 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efc8805f010 con 0x7efc8806a180 2026-02-18T21:01:29.586 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.540+0000 7efc857fa640 1 -- 10.20.193.68:0/2070293021 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7efc7c03e040 con 0x7efc8806a180 2026-02-18T21:01:29.586 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.540+0000 7fcf967fc640 1 -- 10.20.193.68:0/645159808 <== osd.3 v1:10.20.193.68:6804/25186 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25011 (unknown 0 0 1028417783) 0x7fcf84057460 con 0x7fcf84053780 2026-02-18T21:01:29.586 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.540+0000 7f50ae7fc640 1 -- 10.20.193.68:0/4132254651 <== osd.1 v1:10.20.193.68:6808/25184 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25011 (unknown 0 0 1028417783) 0x7f50a0057460 con 0x7f50a0053780 2026-02-18T21:01:29.586 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.540+0000 7f087ffff640 1 -- 10.20.193.68:0/900123115 <== osd.2 v1:10.20.193.68:6800/25185 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25011 (unknown 0 0 1028417783) 0x7f0884057430 con 0x7f0884053750 2026-02-18T21:01:29.586 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.540+0000 7efc857fa640 1 -- 10.20.193.68:0/2070293021 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7efc7c087e90 con 0x7efc8806a180 2026-02-18T21:01:29.587 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.540+0000 7efc857fa640 1 -- 10.20.193.68:0/2070293021 --> v1:10.20.193.68:6809/25183 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc6c057460 con 0x7efc6c053780 2026-02-18T21:01:29.587 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.540+0000 7efc857fa640 1 -- 10.20.193.68:0/2070293021 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc7c08a3f0 con 0x7efc8806a180 2026-02-18T21:01:29.587 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.541+0000 7efc857fa640 1 -- 10.20.193.68:0/2070293021 <== osd.0 v1:10.20.193.68:6809/25183 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25011 (unknown 0 0 1028417783) 0x7efc6c057460 con 0x7efc6c053780 2026-02-18T21:01:29.587 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.546+0000 7fcfa6e39640 1 -- 10.20.193.68:0/645159808 --> v1:10.20.193.68:6804/25186 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcfa011bae0 con 0x7fcf84053780 2026-02-18T21:01:29.587 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7fcf967fc640 1 -- 10.20.193.68:0/645159808 <== osd.3 v1:10.20.193.68:6804/25186 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3659784045) 0x7fcfa011bae0 con 0x7fcf84053780 2026-02-18T21:01:29.587 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7fcfa6e39640 1 -- 10.20.193.68:0/645159808 >> v1:10.20.193.68:6804/25186 conn(0x7fcf84053780 legacy=0x7fcf84055bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.588 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7f50c3ec7640 1 -- 10.20.193.68:0/4132254651 --> v1:10.20.193.68:6808/25184 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f50bc121130 con 0x7f50a0053780 2026-02-18T21:01:29.588 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7fcfa6e39640 1 -- 10.20.193.68:0/645159808 >> v1:10.20.193.68:6816/24610 conn(0x7fcf8404d100 legacy=0x7fcf8404f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.588 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7fcfa6e39640 1 -- 10.20.193.68:0/645159808 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fcfa0096a50 msgr2=0x7fcfa01be1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.588 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7fcfa6e39640 1 --2- 10.20.193.68:0/645159808 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fcfa0096a50 0x7fcfa01be1c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00ea70 tx=0x7fcf9c0090f0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.588 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7fcfa6638640 1 -- 10.20.193.68:0/645159808 reap_dead start 2026-02-18T21:01:29.588 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7fcfa6e39640 1 -- 10.20.193.68:0/645159808 shutdown_connections 2026-02-18T21:01:29.588 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7fcfa6e39640 1 -- 10.20.193.68:0/645159808 >> 10.20.193.68:0/645159808 conn(0x7fcfa009d8d0 msgr2=0x7fcfa01142f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.588 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7fcfa6e39640 1 -- 10.20.193.68:0/645159808 shutdown_connections 2026-02-18T21:01:29.589 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7fcfa6e39640 1 -- 10.20.193.68:0/645159808 wait complete. 2026-02-18T21:01:29.589 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7f50ae7fc640 1 -- 10.20.193.68:0/4132254651 <== osd.1 v1:10.20.193.68:6808/25184 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2217796425) 0x7f50bc121130 con 0x7f50a0053780 2026-02-18T21:01:29.589 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7f50c3ec7640 1 -- 10.20.193.68:0/4132254651 >> v1:10.20.193.68:6808/25184 conn(0x7f50a0053780 legacy=0x7f50a0055bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.589 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7f50c3ec7640 1 -- 10.20.193.68:0/4132254651 >> v1:10.20.193.68:6816/24610 conn(0x7f50a004d100 legacy=0x7f50a004f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.590 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7f50c3ec7640 1 -- 10.20.193.68:0/4132254651 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f50bc08fc70 msgr2=0x7f50bc1203f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.590 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7f50c3ec7640 1 --2- 10.20.193.68:0/4132254651 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f50bc08fc70 0x7f50bc1203f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f50b800c560 tx=0x7f50b8007ca0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.590 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7f50c2464640 1 -- 10.20.193.68:0/4132254651 reap_dead start 2026-02-18T21:01:29.590 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7f50c3ec7640 1 -- 10.20.193.68:0/4132254651 shutdown_connections 2026-02-18T21:01:29.590 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7f50c3ec7640 1 -- 10.20.193.68:0/4132254651 >> 10.20.193.68:0/4132254651 conn(0x7f50bc09bf60 msgr2=0x7f50bc095130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.590 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7f50c3ec7640 1 -- 10.20.193.68:0/4132254651 shutdown_connections 2026-02-18T21:01:29.590 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.547+0000 7f50c3ec7640 1 -- 10.20.193.68:0/4132254651 wait complete. 2026-02-18T21:01:29.590 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.548+0000 7f089dedb640 1 -- 10.20.193.68:0/900123115 --> v1:10.20.193.68:6800/25185 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f089811fc70 con 0x7f0884053750 2026-02-18T21:01:29.590 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.548+0000 7f087ffff640 1 -- 10.20.193.68:0/900123115 <== osd.2 v1:10.20.193.68:6800/25185 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3659784045) 0x7f089811fc70 con 0x7f0884053750 2026-02-18T21:01:29.591 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.548+0000 7f089dedb640 1 -- 10.20.193.68:0/900123115 >> v1:10.20.193.68:6800/25185 conn(0x7f0884053750 legacy=0x7f0884055bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.591 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.548+0000 7f089dedb640 1 -- 10.20.193.68:0/900123115 >> v1:10.20.193.68:6816/24610 conn(0x7f088404d0d0 legacy=0x7f088404f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.591 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.548+0000 7f089dedb640 1 -- 10.20.193.68:0/900123115 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0898096a50 msgr2=0x7f089811e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.591 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.548+0000 7f089dedb640 1 --2- 10.20.193.68:0/900123115 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0898096a50 0x7f089811e9f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f088800ec80 tx=0x7f08880090f0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.591 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.548+0000 7f0897fff640 1 -- 10.20.193.68:0/900123115 reap_dead start 2026-02-18T21:01:29.591 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.548+0000 7f089dedb640 1 -- 10.20.193.68:0/900123115 shutdown_connections 2026-02-18T21:01:29.591 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.548+0000 7f089dedb640 1 -- 10.20.193.68:0/900123115 >> 10.20.193.68:0/900123115 conn(0x7f089809dc60 msgr2=0x7f0898117400 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.591 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.548+0000 7f089dedb640 1 -- 10.20.193.68:0/900123115 shutdown_connections 2026-02-18T21:01:29.591 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.548+0000 7f089dedb640 1 -- 10.20.193.68:0/900123115 wait complete. 2026-02-18T21:01:29.591 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.548+0000 7efc8ec28640 1 -- 10.20.193.68:0/2070293021 --> v1:10.20.193.68:6809/25183 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efc88125550 con 0x7efc6c053780 2026-02-18T21:01:29.591 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.549+0000 7efc857fa640 1 -- 10.20.193.68:0/2070293021 <== osd.0 v1:10.20.193.68:6809/25183 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2217796425) 0x7efc88125550 con 0x7efc6c053780 2026-02-18T21:01:29.592 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.549+0000 7efc8ec28640 1 -- 10.20.193.68:0/2070293021 >> v1:10.20.193.68:6809/25183 conn(0x7efc6c053780 legacy=0x7efc6c055bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.592 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.549+0000 7efc8ec28640 1 -- 10.20.193.68:0/2070293021 >> v1:10.20.193.68:6816/24610 conn(0x7efc6c04d100 legacy=0x7efc6c04f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.592 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.549+0000 7efc8ec28640 1 -- 10.20.193.68:0/2070293021 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7efc8806a180 msgr2=0x7efc8806b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.592 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.549+0000 7efc8ec28640 1 --2- 10.20.193.68:0/2070293021 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7efc8806a180 0x7efc8806b2c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efc7c009360 tx=0x7efc7c037000 comp rx=0 tx=0).stop 2026-02-18T21:01:29.592 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.549+0000 7efc8d1c5640 1 -- 10.20.193.68:0/2070293021 reap_dead start 2026-02-18T21:01:29.592 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.549+0000 7efc8ec28640 1 -- 10.20.193.68:0/2070293021 shutdown_connections 2026-02-18T21:01:29.592 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.549+0000 7efc8ec28640 1 -- 10.20.193.68:0/2070293021 >> 10.20.193.68:0/2070293021 conn(0x7efc880967b0 msgr2=0x7efc88121500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.592 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.549+0000 7efc8ec28640 1 -- 10.20.193.68:0/2070293021 shutdown_connections 2026-02-18T21:01:29.592 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.549+0000 7efc8ec28640 1 -- 10.20.193.68:0/2070293021 wait complete. 2026-02-18T21:01:29.593 INFO:teuthology.orchestra.run.trial068.stdout:38654705668 2026-02-18T21:01:29.593 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-18T21:01:29.594 INFO:teuthology.orchestra.run.trial068.stdout:38654705667 2026-02-18T21:01:29.594 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-18T21:01:29.594 INFO:teuthology.orchestra.run.trial068.stdout:38654705668 2026-02-18T21:01:29.595 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-18T21:01:29.595 INFO:teuthology.orchestra.run.trial068.stdout:38654705667 2026-02-18T21:01:29.595 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-18T21:01:29.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.697+0000 7f61a0676640 1 Processor -- start 2026-02-18T21:01:29.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.697+0000 7f61a0676640 1 -- start start 2026-02-18T21:01:29.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f61a0676640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6198096a50 0x7f6198096e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f61a0676640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f6198129540 0x7f6198132480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f61a0676640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6198098380 con 0x7f6198097360 2026-02-18T21:01:29.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f61a0676640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6198099300 con 0x7f6198129540 2026-02-18T21:01:29.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f61a0676640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6198069000 con 0x7f6198096a50 2026-02-18T21:01:29.702 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f619e412640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6198096a50 0x7f6198096e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.702 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f619ec13640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f6198129540 0x7f6198132480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.702 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f619e412640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6198096a50 0x7f6198096e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:44602/0 (socket says 10.20.193.68:44602) 2026-02-18T21:01:29.702 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f619dc11640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f6198097360 0x7f6198128e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:43776/0 (socket says 10.20.193.68:43776) 2026-02-18T21:01:29.702 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f619e412640 1 -- 10.20.193.68:0/2075187332 learned_addr learned my addr 10.20.193.68:0/2075187332 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:29.702 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f4a13edb640 1 Processor -- start 2026-02-18T21:01:29.703 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f4a13edb640 1 -- start start 2026-02-18T21:01:29.703 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f619d410640 1 -- 10.20.193.68:0/2075187332 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790183207 0 0) 0x7f6198098380 con 0x7f6198097360 2026-02-18T21:01:29.703 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f619ec13640 1 -- 10.20.193.68:0/2075187332 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6198096a50 msgr2=0x7f6198096e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:29.703 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f619ec13640 1 --2- 10.20.193.68:0/2075187332 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6198096a50 0x7f6198096e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.703 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f619ec13640 1 -- 10.20.193.68:0/2075187332 >> v1:10.20.193.68:6789/0 conn(0x7f6198097360 legacy=0x7f6198128e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.704 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f619ec13640 1 -- 10.20.193.68:0/2075187332 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6198098f30 con 0x7f6198129540 2026-02-18T21:01:29.705 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f4a13edb640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f4a0c08fa70 0x7f4a0c12d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.705 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f4a13edb640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4a0c08fe80 0x7f4a0c12f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.705 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f4a13edb640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a0c0976c0 con 0x7f4a0c096d20 2026-02-18T21:01:29.705 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f4a13edb640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a0c097ca0 con 0x7f4a0c08fa70 2026-02-18T21:01:29.705 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f4a13edb640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c091700 con 0x7f4a0c08fe80 2026-02-18T21:01:29.705 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f4a11c77640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f4a0c096d20 0x7f4a0c08f360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:43782/0 (socket says 10.20.193.68:43782) 2026-02-18T21:01:29.705 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f4a11c77640 1 -- 10.20.193.68:0/2493676281 learned_addr learned my addr 10.20.193.68:0/2493676281 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:01:29.705 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f4a12478640 1 --2- 10.20.193.68:0/2493676281 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4a0c08fe80 0x7f4a0c12f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.706 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f4a11476640 1 --2- 10.20.193.68:0/2493676281 >> v2:10.20.193.68:3300/0 conn(0x7f4a0c08fa70 0x7f4a0c12d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.706 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f4a12478640 1 -- 10.20.193.68:0/2493676281 >> v2:10.20.193.68:3300/0 conn(0x7f4a0c08fa70 msgr2=0x7f4a0c12d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:29.706 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f4a12478640 1 --2- 10.20.193.68:0/2493676281 >> v2:10.20.193.68:3300/0 conn(0x7f4a0c08fa70 0x7f4a0c12d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.706 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.698+0000 7f4a10c75640 1 -- 10.20.193.68:0/2493676281 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751775785 0 0) 0x7f4a0c0976c0 con 0x7f4a0c096d20 2026-02-18T21:01:29.706 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f4a12478640 1 -- 10.20.193.68:0/2493676281 >> v1:10.20.193.68:6789/0 conn(0x7f4a0c096d20 legacy=0x7f4a0c08f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.706 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f4a12478640 1 -- 10.20.193.68:0/2493676281 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0c0912c0 con 0x7f4a0c08fe80 2026-02-18T21:01:29.707 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f619ec13640 1 --2- 10.20.193.68:0/2075187332 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f6198129540 0x7f6198132480 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6190009e60 tx=0x7f619002f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5623136ed96d78 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.707 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f619d410640 1 -- 10.20.193.68:0/2075187332 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190037440 con 0x7f6198129540 2026-02-18T21:01:29.707 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f619d410640 1 -- 10.20.193.68:0/2075187332 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61900375a0 con 0x7f6198129540 2026-02-18T21:01:29.707 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f619d410640 1 -- 10.20.193.68:0/2075187332 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190037940 con 0x7f6198129540 2026-02-18T21:01:29.707 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f4a12478640 1 --2- 10.20.193.68:0/2493676281 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4a0c08fe80 0x7f4a0c12f9f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4a04009e60 tx=0x7f4a0402f310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4047237cfbe7208 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.708 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f61a0676640 1 -- 10.20.193.68:0/2075187332 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f6198129540 msgr2=0x7f6198132480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.708 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f61a0676640 1 --2- 10.20.193.68:0/2075187332 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f6198129540 0x7f6198132480 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6190009e60 tx=0x7f619002f3a0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.708 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f61a0676640 1 -- 10.20.193.68:0/2075187332 shutdown_connections 2026-02-18T21:01:29.708 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f61a0676640 1 --2- 10.20.193.68:0/2075187332 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f6198129540 0x7f6198132480 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.708 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f61a0676640 1 --2- 10.20.193.68:0/2075187332 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6198096a50 0x7f6198096e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.709 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f61a0676640 1 -- 10.20.193.68:0/2075187332 >> 10.20.193.68:0/2075187332 conn(0x7f619809da20 msgr2=0x7f619809de20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.709 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f61a0676640 1 -- 10.20.193.68:0/2075187332 shutdown_connections 2026-02-18T21:01:29.709 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f4a10c75640 1 -- 10.20.193.68:0/2493676281 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0402fe30 con 0x7f4a0c08fe80 2026-02-18T21:01:29.709 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f61a0676640 1 -- 10.20.193.68:0/2075187332 wait complete. 2026-02-18T21:01:29.710 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f4a10c75640 1 -- 10.20.193.68:0/2493676281 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a04037440 con 0x7f4a0c08fe80 2026-02-18T21:01:29.710 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f4a10c75640 1 -- 10.20.193.68:0/2493676281 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a040377e0 con 0x7f4a0c08fe80 2026-02-18T21:01:29.710 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f4a13edb640 1 -- 10.20.193.68:0/2493676281 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4a0c08fe80 msgr2=0x7f4a0c12f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.711 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f4a13edb640 1 --2- 10.20.193.68:0/2493676281 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4a0c08fe80 0x7f4a0c12f9f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4a04009e60 tx=0x7f4a0402f310 comp rx=0 tx=0).stop 2026-02-18T21:01:29.711 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f4a13edb640 1 -- 10.20.193.68:0/2493676281 shutdown_connections 2026-02-18T21:01:29.711 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f4a13edb640 1 --2- 10.20.193.68:0/2493676281 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4a0c08fe80 0x7f4a0c12f9f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.711 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f4a13edb640 1 --2- 10.20.193.68:0/2493676281 >> v2:10.20.193.68:3300/0 conn(0x7f4a0c08fa70 0x7f4a0c12d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.711 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.699+0000 7f4a13edb640 1 -- 10.20.193.68:0/2493676281 >> 10.20.193.68:0/2493676281 conn(0x7f4a0c097e10 msgr2=0x7f4a0c098210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.711 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f4a13edb640 1 -- 10.20.193.68:0/2493676281 shutdown_connections 2026-02-18T21:01:29.711 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f4a13edb640 1 -- 10.20.193.68:0/2493676281 wait complete. 2026-02-18T21:01:29.711 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f61a0676640 1 Processor -- start 2026-02-18T21:01:29.712 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f61a0676640 1 -- start start 2026-02-18T21:01:29.712 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f38d5bdd640 1 Processor -- start 2026-02-18T21:01:29.712 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f848b29b640 1 Processor -- start 2026-02-18T21:01:29.713 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f38d5bdd640 1 -- start start 2026-02-18T21:01:29.713 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f848b29b640 1 -- start start 2026-02-18T21:01:29.714 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f61a0676640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f6198096a50 0x7f619811d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.714 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f61a0676640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f6198097360 0x7f619811d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.714 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f61a0676640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6198129540 0x7f619811dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.714 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f61a0676640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619811fcb0 con 0x7f6198096a50 2026-02-18T21:01:29.714 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f61a0676640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61981207d0 con 0x7f6198129540 2026-02-18T21:01:29.715 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f61a0676640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f619811ead0 con 0x7f6198097360 2026-02-18T21:01:29.715 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f619e412640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f6198096a50 0x7f619811d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.715 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f619ec13640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6198129540 0x7f619811dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.715 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f619ec13640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6198129540 0x7f619811dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:44626/0 (socket says 10.20.193.68:44626) 2026-02-18T21:01:29.715 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f619e412640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f6198096a50 0x7f619811d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:37846/0 (socket says 10.20.193.68:37846) 2026-02-18T21:01:29.715 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f619dc11640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f6198097360 0x7f619811d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.715 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f619ec13640 1 -- 10.20.193.68:0/642640595 learned_addr learned my addr 10.20.193.68:0/642640595 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:29.715 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f38d5bdd640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f38d0096a50 0x7f38d0096e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.716 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f38d5bdd640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f38d0097360 0x7f38d0128e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.716 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f4a13edb640 1 Processor -- start 2026-02-18T21:01:29.716 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f38d5bdd640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d0098380 con 0x7f38d0129370 2026-02-18T21:01:29.716 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f38d5bdd640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d0099300 con 0x7f38d0096a50 2026-02-18T21:01:29.717 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f38d5bdd640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38d0069000 con 0x7f38d0097360 2026-02-18T21:01:29.717 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f4a13edb640 1 -- start start 2026-02-18T21:01:29.717 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f38cf7fe640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f38d0096a50 0x7f38d0096e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.717 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f38cffff640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f38d0129370 0x7f38d0131470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:43792/0 (socket says 10.20.193.68:43792) 2026-02-18T21:01:29.718 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f38cffff640 1 -- 10.20.193.68:0/1361785672 learned_addr learned my addr 10.20.193.68:0/1361785672 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:01:29.718 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f619ec13640 1 -- 10.20.193.68:0/642640595 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f6198097360 msgr2=0x7f619811d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.718 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f619ec13640 1 --2- 10.20.193.68:0/642640595 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f6198097360 0x7f619811d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.718 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f38c7fff640 1 --2- 10.20.193.68:0/1361785672 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f38d0097360 0x7f38d0128e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.719 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f619ec13640 1 -- 10.20.193.68:0/642640595 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f6198096a50 msgr2=0x7f619811d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.719 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f619ec13640 1 --2- 10.20.193.68:0/642640595 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f6198096a50 0x7f619811d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.719 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f619ec13640 1 -- 10.20.193.68:0/642640595 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6190009a20 con 0x7f6198129540 2026-02-18T21:01:29.720 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f848b29b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f848406b9c0 0x7f848406bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.720 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f848b29b640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f848406c2d0 0x7f8484127c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.720 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f848b29b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848406d010 con 0x7f8484128190 2026-02-18T21:01:29.720 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f848b29b640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848406dcd0 con 0x7f848406c2d0 2026-02-18T21:01:29.720 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f848b29b640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f848406e0a0 con 0x7f848406b9c0 2026-02-18T21:01:29.720 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f619ec13640 1 --2- 10.20.193.68:0/642640595 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6198129540 0x7f619811dab0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6190009e60 tx=0x7f619003a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.721 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f38cf7fe640 1 -- 10.20.193.68:0/1361785672 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f38d0097360 msgr2=0x7f38d0128e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:29.721 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f38cf7fe640 1 --2- 10.20.193.68:0/1361785672 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f38d0097360 0x7f38d0128e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.721 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f38cf7fe640 1 -- 10.20.193.68:0/1361785672 >> v1:10.20.193.68:6789/0 conn(0x7f38d0129370 legacy=0x7f38d0131470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.721 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f4a13edb640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4a0c08fa70 0x7f4a0c08d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.721 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f4a13edb640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4a0c08fe80 0x7f4a0c08da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.722 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f38ceffd640 1 -- 10.20.193.68:0/1361785672 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538291824 0 0) 0x7f38d0098380 con 0x7f38d0129370 2026-02-18T21:01:29.722 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f38cf7fe640 1 -- 10.20.193.68:0/1361785672 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d0098f30 con 0x7f38d0096a50 2026-02-18T21:01:29.722 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f4a13edb640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4a0c096d20 0x7f4a0c08df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.723 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f8488836640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f848406c2d0 0x7f8484127c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.723 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f4a13edb640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c08e580 con 0x7f4a0c08fa70 2026-02-18T21:01:29.723 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f4a13edb640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c08bf50 con 0x7f4a0c08fe80 2026-02-18T21:01:29.723 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f4a13edb640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c08d220 con 0x7f4a0c096d20 2026-02-18T21:01:29.723 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f8488836640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f848406c2d0 0x7f8484127c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:37856/0 (socket says 10.20.193.68:37856) 2026-02-18T21:01:29.724 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f8488836640 1 -- 10.20.193.68:0/762369209 learned_addr learned my addr 10.20.193.68:0/762369209 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:29.724 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f618effd640 1 -- 10.20.193.68:0/642640595 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190036bd0 con 0x7f6198129540 2026-02-18T21:01:29.724 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f618effd640 1 -- 10.20.193.68:0/642640595 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6190036d30 con 0x7f6198129540 2026-02-18T21:01:29.724 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f4a12478640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4a0c096d20 0x7f4a0c08df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.725 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f61a0676640 1 -- 10.20.193.68:0/642640595 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6198120400 con 0x7f6198129540 2026-02-18T21:01:29.725 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f4a11476640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4a0c08fe80 0x7f4a0c08da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.725 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f8489037640 1 --2- 10.20.193.68:0/762369209 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f848406b9c0 0x7f848406bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.726 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f618effd640 1 -- 10.20.193.68:0/642640595 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190036ea0 con 0x7f6198129540 2026-02-18T21:01:29.726 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f4a11476640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4a0c08fe80 0x7f4a0c08da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:44638/0 (socket says 10.20.193.68:44638) 2026-02-18T21:01:29.726 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f4a11476640 1 -- 10.20.193.68:0/904170901 learned_addr learned my addr 10.20.193.68:0/904170901 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:29.726 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f4a12478640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4a0c096d20 0x7f4a0c08df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:34718/0 (socket says 10.20.193.68:34718) 2026-02-18T21:01:29.727 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f61a0676640 1 -- 10.20.193.68:0/642640595 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6198127460 con 0x7f6198129540 2026-02-18T21:01:29.727 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f8488836640 1 -- 10.20.193.68:0/762369209 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f848406b9c0 msgr2=0x7f848406bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:29.727 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f8488836640 1 --2- 10.20.193.68:0/762369209 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f848406b9c0 0x7f848406bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.727 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f8488836640 1 -- 10.20.193.68:0/762369209 >> v1:10.20.193.68:6789/0 conn(0x7f8484128190 legacy=0x7f848412f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.727 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f4a11c77640 1 --2- 10.20.193.68:0/904170901 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4a0c08fa70 0x7f4a0c08d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.728 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.700+0000 7f8488836640 1 -- 10.20.193.68:0/762369209 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848406e360 con 0x7f848406c2d0 2026-02-18T21:01:29.728 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f4a11476640 1 -- 10.20.193.68:0/904170901 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4a0c096d20 msgr2=0x7f4a0c08df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.728 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f4a11476640 1 --2- 10.20.193.68:0/904170901 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4a0c096d20 0x7f4a0c08df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.728 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f4a11476640 1 -- 10.20.193.68:0/904170901 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4a0c08fa70 msgr2=0x7f4a0c08d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.729 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f4a11476640 1 --2- 10.20.193.68:0/904170901 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4a0c08fa70 0x7f4a0c08d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.729 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f4a11476640 1 -- 10.20.193.68:0/904170901 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a04009a20 con 0x7f4a0c08fe80 2026-02-18T21:01:29.729 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f38cf7fe640 1 --2- 10.20.193.68:0/1361785672 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f38d0096a50 0x7f38d0096e20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009850 tx=0x7f38c002eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa36b22c51149d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.729 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f38ceffd640 1 -- 10.20.193.68:0/1361785672 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c002f9d0 con 0x7f38d0096a50 2026-02-18T21:01:29.729 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f4a11476640 1 --2- 10.20.193.68:0/904170901 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4a0c08fe80 0x7f4a0c08da20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00e930 tx=0x7f49fc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.730 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f38ceffd640 1 -- 10.20.193.68:0/1361785672 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c002fb30 con 0x7f38d0096a50 2026-02-18T21:01:29.730 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f38ceffd640 1 -- 10.20.193.68:0/1361785672 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0037440 con 0x7f38d0096a50 2026-02-18T21:01:29.730 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f8488836640 1 --2- 10.20.193.68:0/762369209 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f848406c2d0 0x7f8484127c50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8474009910 tx=0x7f847402eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44c401c22dba239 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.731 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f4a027fc640 1 -- 10.20.193.68:0/904170901 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc00c8e0 con 0x7f4a0c08fe80 2026-02-18T21:01:29.731 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f4a027fc640 1 -- 10.20.193.68:0/904170901 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc00ca40 con 0x7f4a0c08fe80 2026-02-18T21:01:29.731 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f4a13edb640 1 -- 10.20.193.68:0/904170901 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a0c069fc0 con 0x7f4a0c08fe80 2026-02-18T21:01:29.731 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f4a027fc640 1 -- 10.20.193.68:0/904170901 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc00cde0 con 0x7f4a0c08fe80 2026-02-18T21:01:29.731 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f4a13edb640 1 -- 10.20.193.68:0/904170901 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a0c08e920 con 0x7f4a0c08fe80 2026-02-18T21:01:29.732 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f847bfff640 1 -- 10.20.193.68:0/762369209 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847402fa10 con 0x7f848406c2d0 2026-02-18T21:01:29.732 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f847bfff640 1 -- 10.20.193.68:0/762369209 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847402fb70 con 0x7f848406c2d0 2026-02-18T21:01:29.732 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f61a0676640 1 -- 10.20.193.68:0/642640595 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6198127710 con 0x7f6198129540 2026-02-18T21:01:29.733 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f38d5bdd640 1 -- 10.20.193.68:0/1361785672 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f38d0096a50 msgr2=0x7f38d0096e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.733 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f847bfff640 1 -- 10.20.193.68:0/762369209 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8474037440 con 0x7f848406c2d0 2026-02-18T21:01:29.733 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f38d5bdd640 1 --2- 10.20.193.68:0/1361785672 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f38d0096a50 0x7f38d0096e20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009850 tx=0x7f38c002eeb0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.733 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f38d5bdd640 1 -- 10.20.193.68:0/1361785672 shutdown_connections 2026-02-18T21:01:29.733 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f38d5bdd640 1 --2- 10.20.193.68:0/1361785672 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f38d0097360 0x7f38d0128e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.733 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f38d5bdd640 1 --2- 10.20.193.68:0/1361785672 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f38d0096a50 0x7f38d0096e20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.734 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f38d5bdd640 1 -- 10.20.193.68:0/1361785672 >> 10.20.193.68:0/1361785672 conn(0x7f38d009da20 msgr2=0x7f38d009de20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.734 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f618effd640 1 -- 10.20.193.68:0/642640595 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f619003e050 con 0x7f6198129540 2026-02-18T21:01:29.734 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f38d5bdd640 1 -- 10.20.193.68:0/1361785672 shutdown_connections 2026-02-18T21:01:29.734 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f38d5bdd640 1 -- 10.20.193.68:0/1361785672 wait complete. 2026-02-18T21:01:29.735 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.701+0000 7f618effd640 1 -- 10.20.193.68:0/642640595 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f6190089a30 con 0x7f6198129540 2026-02-18T21:01:29.735 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f4a13edb640 1 -- 10.20.193.68:0/904170901 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a0c12fd00 con 0x7f4a0c08fe80 2026-02-18T21:01:29.736 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f848b29b640 1 -- 10.20.193.68:0/762369209 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f848406c2d0 msgr2=0x7f8484127c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.736 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f848b29b640 1 --2- 10.20.193.68:0/762369209 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f848406c2d0 0x7f8484127c50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8474009910 tx=0x7f847402eeb0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.736 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f848b29b640 1 -- 10.20.193.68:0/762369209 shutdown_connections 2026-02-18T21:01:29.736 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f848b29b640 1 --2- 10.20.193.68:0/762369209 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f848406c2d0 0x7f8484127c50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.736 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f848b29b640 1 --2- 10.20.193.68:0/762369209 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f848406b9c0 0x7f848406bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.736 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f848b29b640 1 -- 10.20.193.68:0/762369209 >> 10.20.193.68:0/762369209 conn(0x7f848409b660 msgr2=0x7f848409ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.736 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f848b29b640 1 -- 10.20.193.68:0/762369209 shutdown_connections 2026-02-18T21:01:29.736 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f848b29b640 1 -- 10.20.193.68:0/762369209 wait complete. 2026-02-18T21:01:29.736 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f4a027fc640 1 -- 10.20.193.68:0/904170901 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f49fc013680 con 0x7f4a0c08fe80 2026-02-18T21:01:29.737 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38d5bdd640 1 Processor -- start 2026-02-18T21:01:29.737 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38d5bdd640 1 -- start start 2026-02-18T21:01:29.737 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f4a027fc640 1 -- 10.20.193.68:0/904170901 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f49fc063b20 con 0x7f4a0c08fe80 2026-02-18T21:01:29.738 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38d5bdd640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f38d0096a50 0x7f38d01be810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.738 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38d5bdd640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f38d0097360 0x7f38d01bed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.738 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38d5bdd640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f38d0129370 0x7f38d011e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.738 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38d5bdd640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d0121910 con 0x7f38d0097360 2026-02-18T21:01:29.738 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38d5bdd640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d0121c20 con 0x7f38d0096a50 2026-02-18T21:01:29.738 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38d5bdd640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38d011ff20 con 0x7f38d0129370 2026-02-18T21:01:29.738 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38cffff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f38d0129370 0x7f38d011e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.739 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38c7fff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f38d0097360 0x7f38d01bed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.739 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38cf7fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f38d0096a50 0x7f38d01be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.739 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38c7fff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f38d0097360 0x7f38d01bed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:37868/0 (socket says 10.20.193.68:37868) 2026-02-18T21:01:29.739 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38c7fff640 1 -- 10.20.193.68:0/3546981435 learned_addr learned my addr 10.20.193.68:0/3546981435 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:29.739 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f848b29b640 1 Processor -- start 2026-02-18T21:01:29.739 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f848b29b640 1 -- start start 2026-02-18T21:01:29.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38cf7fe640 1 -- 10.20.193.68:0/3546981435 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f38d0129370 msgr2=0x7f38d011e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38cf7fe640 1 --2- 10.20.193.68:0/3546981435 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f38d0129370 0x7f38d011e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38cf7fe640 1 -- 10.20.193.68:0/3546981435 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f38d0097360 msgr2=0x7f38d01bed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38cf7fe640 1 --2- 10.20.193.68:0/3546981435 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f38d0097360 0x7f38d01bed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38cf7fe640 1 -- 10.20.193.68:0/3546981435 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c0009390 con 0x7f38d0096a50 2026-02-18T21:01:29.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38c7fff640 1 --2- 10.20.193.68:0/3546981435 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f38d0097360 0x7f38d01bed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:29.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38cffff640 1 --2- 10.20.193.68:0/3546981435 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f38d0129370 0x7f38d011e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:29.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f38cf7fe640 1 --2- 10.20.193.68:0/3546981435 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f38d0096a50 0x7f38d01be810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f38c0036000 tx=0x7f38c0037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.742 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f848b29b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f848406b9c0 0x7f84841be660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.742 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f848b29b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f848406c2d0 0x7f84841beba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f848b29b640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8484128190 0x7f8484068610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:29.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f848b29b640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8484121910 con 0x7f8484128190 2026-02-18T21:01:29.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f848b29b640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8484121130 con 0x7f848406b9c0 2026-02-18T21:01:29.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.702+0000 7f848b29b640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8484121ce0 con 0x7f848406c2d0 2026-02-18T21:01:29.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.703+0000 7f8488836640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f848406c2d0 0x7f84841beba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.703+0000 7f8489838640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8484128190 0x7f8484068610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.703+0000 7f8489037640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f848406b9c0 0x7f84841be660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:29.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.703+0000 7f8488836640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f848406c2d0 0x7f84841beba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:34730/0 (socket says 10.20.193.68:34730) 2026-02-18T21:01:29.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.703+0000 7f8488836640 1 -- 10.20.193.68:0/2715247600 learned_addr learned my addr 10.20.193.68:0/2715247600 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:29.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.703+0000 7f8488836640 1 -- 10.20.193.68:0/2715247600 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f848406b9c0 msgr2=0x7f84841be660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.703+0000 7f8488836640 1 --2- 10.20.193.68:0/2715247600 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f848406b9c0 0x7f84841be660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.703+0000 7f8488836640 1 -- 10.20.193.68:0/2715247600 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8484128190 msgr2=0x7f8484068610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.703+0000 7f8488836640 1 --2- 10.20.193.68:0/2715247600 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8484128190 0x7f8484068610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.703+0000 7f8488836640 1 -- 10.20.193.68:0/2715247600 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8474009450 con 0x7f848406c2d0 2026-02-18T21:01:29.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.703+0000 7f8489838640 1 --2- 10.20.193.68:0/2715247600 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8484128190 0x7f8484068610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:29.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.703+0000 7f8488836640 1 --2- 10.20.193.68:0/2715247600 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f848406c2d0 0x7f84841beba0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f847403a040 tx=0x7f8474037000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:29.744 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.703+0000 7f8479ffb640 1 -- 10.20.193.68:0/2715247600 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84740366b0 con 0x7f848406c2d0 2026-02-18T21:01:29.744 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.703+0000 7f8479ffb640 1 -- 10.20.193.68:0/2715247600 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8474036850 con 0x7f848406c2d0 2026-02-18T21:01:29.744 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.703+0000 7f8479ffb640 1 -- 10.20.193.68:0/2715247600 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8474036c10 con 0x7f848406c2d0 2026-02-18T21:01:29.744 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.703+0000 7f848b29b640 1 -- 10.20.193.68:0/2715247600 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848406a0d0 con 0x7f848406c2d0 2026-02-18T21:01:29.744 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.703+0000 7f848b29b640 1 -- 10.20.193.68:0/2715247600 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84841bf280 con 0x7f848406c2d0 2026-02-18T21:01:29.744 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.703+0000 7f618effd640 1 -- 10.20.193.68:0/642640595 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f61900686d0 con 0x7f6198129540 2026-02-18T21:01:29.744 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.703+0000 7f848b29b640 1 -- 10.20.193.68:0/2715247600 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848405f010 con 0x7f848406c2d0 2026-02-18T21:01:29.744 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.703+0000 7f8479ffb640 1 -- 10.20.193.68:0/2715247600 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f847403e040 con 0x7f848406c2d0 2026-02-18T21:01:29.745 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.704+0000 7f8479ffb640 1 -- 10.20.193.68:0/2715247600 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f8474088070 con 0x7f848406c2d0 2026-02-18T21:01:29.745 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.705+0000 7f38ccff9640 1 -- 10.20.193.68:0/3546981435 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0042720 con 0x7f38d0096a50 2026-02-18T21:01:29.745 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.705+0000 7f38ccff9640 1 -- 10.20.193.68:0/3546981435 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c0042880 con 0x7f38d0096a50 2026-02-18T21:01:29.745 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.705+0000 7f38d5bdd640 1 -- 10.20.193.68:0/3546981435 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d0121290 con 0x7f38d0096a50 2026-02-18T21:01:29.745 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.705+0000 7f38ccff9640 1 -- 10.20.193.68:0/3546981435 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0042c20 con 0x7f38d0096a50 2026-02-18T21:01:29.745 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.705+0000 7f38d5bdd640 1 -- 10.20.193.68:0/3546981435 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d01bf430 con 0x7f38d0096a50 2026-02-18T21:01:29.745 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.705+0000 7f4a027fc640 1 -- 10.20.193.68:0/904170901 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f49fc03e9b0 con 0x7f4a0c08fe80 2026-02-18T21:01:29.746 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.706+0000 7f8479ffb640 1 -- 10.20.193.68:0/2715247600 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f84740b1460 con 0x7f848406c2d0 2026-02-18T21:01:29.746 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.706+0000 7f38ccff9640 1 -- 10.20.193.68:0/3546981435 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f38c003e040 con 0x7f38d0096a50 2026-02-18T21:01:29.746 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.706+0000 7f38d5bdd640 1 -- 10.20.193.68:0/3546981435 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d005f010 con 0x7f38d0096a50 2026-02-18T21:01:29.746 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.706+0000 7f38ccff9640 1 -- 10.20.193.68:0/3546981435 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f38c00884e0 con 0x7f38d0096a50 2026-02-18T21:01:29.746 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.707+0000 7f38ccff9640 1 -- 10.20.193.68:0/3546981435 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f38c0063480 con 0x7f38d0096a50 2026-02-18T21:01:29.767 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.765+0000 7f61a0676640 1 -- 10.20.193.68:0/642640595 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f619805f010 con 0x7f6198129540 2026-02-18T21:01:29.768 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.765+0000 7f618effd640 1 -- 10.20.193.68:0/642640595 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6190045030 con 0x7f6198129540 2026-02-18T21:01:29.768 INFO:teuthology.orchestra.run.trial068.stdout:38654705666 2026-02-18T21:01:29.769 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.766+0000 7f61a0676640 1 -- 10.20.193.68:0/642640595 >> v1:10.20.193.68:6816/24610 conn(0x7f617c04d0d0 legacy=0x7f617c04f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.769 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.766+0000 7f61a0676640 1 -- 10.20.193.68:0/642640595 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6198129540 msgr2=0x7f619811dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.769 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.766+0000 7f61a0676640 1 --2- 10.20.193.68:0/642640595 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6198129540 0x7f619811dab0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6190009e60 tx=0x7f619003a000 comp rx=0 tx=0).stop 2026-02-18T21:01:29.769 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.766+0000 7f61a0676640 1 -- 10.20.193.68:0/642640595 shutdown_connections 2026-02-18T21:01:29.769 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.766+0000 7f61a0676640 1 --2- 10.20.193.68:0/642640595 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6198129540 0x7f619811dab0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.769 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.766+0000 7f61a0676640 1 --2- 10.20.193.68:0/642640595 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f6198097360 0x7f619811d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.769 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.766+0000 7f61a0676640 1 --2- 10.20.193.68:0/642640595 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f6198096a50 0x7f619811d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.769 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.766+0000 7f61a0676640 1 -- 10.20.193.68:0/642640595 >> 10.20.193.68:0/642640595 conn(0x7f619809da20 msgr2=0x7f6198127d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.770 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.766+0000 7f61a0676640 1 -- 10.20.193.68:0/642640595 shutdown_connections 2026-02-18T21:01:29.770 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.766+0000 7f61a0676640 1 -- 10.20.193.68:0/642640595 wait complete. 2026-02-18T21:01:29.771 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.768+0000 7f848b29b640 1 -- 10.20.193.68:0/2715247600 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f84840634d0 con 0x7f848406c2d0 2026-02-18T21:01:29.771 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.768+0000 7f4a13edb640 1 -- 10.20.193.68:0/904170901 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4a0c08eba0 con 0x7f4a0c08fe80 2026-02-18T21:01:29.771 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.769+0000 7f8479ffb640 1 -- 10.20.193.68:0/2715247600 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8474047070 con 0x7f848406c2d0 2026-02-18T21:01:29.772 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.769+0000 7f4a027fc640 1 -- 10.20.193.68:0/904170901 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f49fc0421c0 con 0x7f4a0c08fe80 2026-02-18T21:01:29.772 INFO:teuthology.orchestra.run.trial068.stdout:38654705666 2026-02-18T21:01:29.772 INFO:teuthology.orchestra.run.trial068.stdout:38654705667 2026-02-18T21:01:29.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.770+0000 7f848b29b640 1 -- 10.20.193.68:0/2715247600 >> v1:10.20.193.68:6816/24610 conn(0x7f846804d0d0 legacy=0x7f846804f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.770+0000 7f848b29b640 1 -- 10.20.193.68:0/2715247600 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f848406c2d0 msgr2=0x7f84841beba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.770+0000 7f848b29b640 1 --2- 10.20.193.68:0/2715247600 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f848406c2d0 0x7f84841beba0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f847403a040 tx=0x7f8474037000 comp rx=0 tx=0).stop 2026-02-18T21:01:29.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.770+0000 7f848b29b640 1 -- 10.20.193.68:0/2715247600 shutdown_connections 2026-02-18T21:01:29.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.770+0000 7f848b29b640 1 --2- 10.20.193.68:0/2715247600 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8484128190 0x7f8484068610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.770+0000 7f848b29b640 1 --2- 10.20.193.68:0/2715247600 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f848406c2d0 0x7f84841beba0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.770+0000 7f848b29b640 1 --2- 10.20.193.68:0/2715247600 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f848406b9c0 0x7f84841be660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.770+0000 7f848b29b640 1 -- 10.20.193.68:0/2715247600 >> 10.20.193.68:0/2715247600 conn(0x7f848409b660 msgr2=0x7f84841155a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.770+0000 7f848b29b640 1 -- 10.20.193.68:0/2715247600 shutdown_connections 2026-02-18T21:01:29.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.770+0000 7f4a13edb640 1 -- 10.20.193.68:0/904170901 >> v1:10.20.193.68:6816/24610 conn(0x7f49f004d0d0 legacy=0x7f49f004f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.770+0000 7f848b29b640 1 -- 10.20.193.68:0/2715247600 wait complete. 2026-02-18T21:01:29.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.770+0000 7f4a13edb640 1 -- 10.20.193.68:0/904170901 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4a0c08fe80 msgr2=0x7f4a0c08da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.770+0000 7f4a13edb640 1 --2- 10.20.193.68:0/904170901 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4a0c08fe80 0x7f4a0c08da20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00e930 tx=0x7f49fc0090f0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.770+0000 7f4a13edb640 1 -- 10.20.193.68:0/904170901 shutdown_connections 2026-02-18T21:01:29.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.770+0000 7f4a13edb640 1 --2- 10.20.193.68:0/904170901 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4a0c096d20 0x7f4a0c08df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.770+0000 7f4a13edb640 1 --2- 10.20.193.68:0/904170901 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4a0c08fe80 0x7f4a0c08da20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.770+0000 7f4a13edb640 1 --2- 10.20.193.68:0/904170901 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4a0c08fa70 0x7f4a0c08d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.770+0000 7f4a13edb640 1 -- 10.20.193.68:0/904170901 >> 10.20.193.68:0/904170901 conn(0x7f4a0c097e10 msgr2=0x7f4a0c09a970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.770+0000 7f4a13edb640 1 -- 10.20.193.68:0/904170901 shutdown_connections 2026-02-18T21:01:29.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.770+0000 7f4a13edb640 1 -- 10.20.193.68:0/904170901 wait complete. 2026-02-18T21:01:29.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.772+0000 7f38d5bdd640 1 -- 10.20.193.68:0/3546981435 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f38d0128750 con 0x7f38d0096a50 2026-02-18T21:01:29.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.772+0000 7f38ccff9640 1 -- 10.20.193.68:0/3546981435 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f38c0047090 con 0x7f38d0096a50 2026-02-18T21:01:29.776 INFO:teuthology.orchestra.run.trial068.stdout:38654705667 2026-02-18T21:01:29.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.1 2026-02-18T21:01:29.778 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.774+0000 7f38d5bdd640 1 -- 10.20.193.68:0/3546981435 >> v1:10.20.193.68:6816/24610 conn(0x7f38b004d130 legacy=0x7f38b004f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.778 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.774+0000 7f38d5bdd640 1 -- 10.20.193.68:0/3546981435 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f38d0096a50 msgr2=0x7f38d01be810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:29.778 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.774+0000 7f38d5bdd640 1 --2- 10.20.193.68:0/3546981435 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f38d0096a50 0x7f38d01be810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f38c0036000 tx=0x7f38c0037000 comp rx=0 tx=0).stop 2026-02-18T21:01:29.779 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.774+0000 7f38d5bdd640 1 -- 10.20.193.68:0/3546981435 shutdown_connections 2026-02-18T21:01:29.779 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.774+0000 7f38d5bdd640 1 --2- 10.20.193.68:0/3546981435 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f38d0129370 0x7f38d011e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.779 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.774+0000 7f38d5bdd640 1 --2- 10.20.193.68:0/3546981435 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f38d0097360 0x7f38d01bed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.779 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.774+0000 7f38d5bdd640 1 --2- 10.20.193.68:0/3546981435 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f38d0096a50 0x7f38d01be810 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:29.779 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.774+0000 7f38d5bdd640 1 -- 10.20.193.68:0/3546981435 >> 10.20.193.68:0/3546981435 conn(0x7f38d009da20 msgr2=0x7f38d0117630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:29.779 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.774+0000 7f38d5bdd640 1 -- 10.20.193.68:0/3546981435 shutdown_connections 2026-02-18T21:01:29.779 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:29.774+0000 7f38d5bdd640 1 -- 10.20.193.68:0/3546981435 wait complete. 2026-02-18T21:01:29.780 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.0 2026-02-18T21:01:29.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.3 2026-02-18T21:01:29.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.2 2026-02-18T21:01:30.779 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-18T21:01:30.781 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-18T21:01:30.781 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-18T21:01:30.785 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-18T21:01:30.849 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7f37ea0c7640 1 Processor -- start 2026-02-18T21:01:30.850 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feea4b31640 1 Processor -- start 2026-02-18T21:01:30.850 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feb2e0db640 1 Processor -- start 2026-02-18T21:01:30.850 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feea4b31640 1 -- start start 2026-02-18T21:01:30.851 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feb2e0db640 1 -- start start 2026-02-18T21:01:30.851 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7f37ea0c7640 1 -- start start 2026-02-18T21:01:30.851 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feea4b31640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feea0096b10 0x7feea008f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:30.852 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7f37ea0c7640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f37e4095c10 0x7f37e4095fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:30.852 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feea4b31640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7feea008faa0 0x7feea012f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:30.852 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feea4b31640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea0091f50 con 0x7feea008f690 2026-02-18T21:01:30.852 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feea4b31640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea00910e0 con 0x7feea008faa0 2026-02-18T21:01:30.852 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7f37ea0c7640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f37e412eae0 0x7f37e4136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:30.853 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7f37ea0c7640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e40719d0 con 0x7f37e4096520 2026-02-18T21:01:30.853 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7f37ea0c7640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e40677f0 con 0x7f37e4095c10 2026-02-18T21:01:30.853 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feb2e0db640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb28096d20 0x7feb2808f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:30.853 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feea4b31640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feea0090550 con 0x7feea0096b10 2026-02-18T21:01:30.854 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7f37ea0c7640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e4067d80 con 0x7f37e412eae0 2026-02-18T21:01:30.854 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feb2e0db640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7feb2808fcb0 0x7feb2812fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:30.854 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feb2e0db640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb280976c0 con 0x7feb2808f8a0 2026-02-18T21:01:30.854 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feb2e0db640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb28097ca0 con 0x7feb2808fcb0 2026-02-18T21:01:30.854 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feb2e0db640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb28091700 con 0x7feb28096d20 2026-02-18T21:01:30.854 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7f37e3fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f37e412eae0 0x7f37e4136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:30.855 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7f37e37fe640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f37e4095c10 0x7f37e4095fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:30.855 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feb277fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb28096d20 0x7feb2808f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:30.855 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7fee9f7fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feea0096b10 0x7feea008f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:30.856 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7f37e37fe640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f37e4095c10 0x7f37e4095fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:39396/0 (socket says 10.20.193.68:39396) 2026-02-18T21:01:30.856 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7f37e37fe640 1 -- 10.20.193.68:0/1667991524 learned_addr learned my addr 10.20.193.68:0/1667991524 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:30.856 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7f37e3fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f37e412eae0 0x7f37e4136840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:45272/0 (socket says 10.20.193.68:45272) 2026-02-18T21:01:30.856 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feb277fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb28096d20 0x7feb2808f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:45284/0 (socket says 10.20.193.68:45284) 2026-02-18T21:01:30.856 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feb27fff640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7feb2808fcb0 0x7feb2812fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:30.856 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feb277fe640 1 -- 10.20.193.68:0/1236784720 learned_addr learned my addr 10.20.193.68:0/1236784720 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:30.857 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7fee9f7fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feea0096b10 0x7feea008f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:55492/0 (socket says 10.20.193.68:55492) 2026-02-18T21:01:30.857 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7fee9f7fe640 1 -- 10.20.193.68:0/3219428083 learned_addr learned my addr 10.20.193.68:0/3219428083 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:30.857 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7fee9ffff640 1 --2- 10.20.193.68:0/3219428083 >> v2:10.20.193.68:3300/0 conn(0x7feea008faa0 0x7feea012f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:30.857 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feb277fe640 1 -- 10.20.193.68:0/1236784720 >> v2:10.20.193.68:3300/0 conn(0x7feb2808fcb0 msgr2=0x7feb2812fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:30.857 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feb277fe640 1 --2- 10.20.193.68:0/1236784720 >> v2:10.20.193.68:3300/0 conn(0x7feb2808fcb0 0x7feb2812fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.857 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feb277fe640 1 -- 10.20.193.68:0/1236784720 >> v1:10.20.193.68:6789/0 conn(0x7feb2808f8a0 legacy=0x7feb2812c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7f37e37fe640 1 -- 10.20.193.68:0/1667991524 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f37e412eae0 msgr2=0x7f37e4136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:30.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7f37e37fe640 1 --2- 10.20.193.68:0/1667991524 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f37e412eae0 0x7f37e4136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7f37e37fe640 1 -- 10.20.193.68:0/1667991524 >> v1:10.20.193.68:6789/0 conn(0x7f37e4096520 legacy=0x7f37e412e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feb277fe640 1 -- 10.20.193.68:0/1236784720 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb280912c0 con 0x7feb28096d20 2026-02-18T21:01:30.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7f37e37fe640 1 -- 10.20.193.68:0/1667991524 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e4067a30 con 0x7f37e4095c10 2026-02-18T21:01:30.859 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7fee9f7fe640 1 -- 10.20.193.68:0/3219428083 >> v2:10.20.193.68:3300/0 conn(0x7feea008faa0 msgr2=0x7feea012f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:30.859 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7feb27fff640 1 --2- 10.20.193.68:0/1236784720 >> v2:10.20.193.68:3300/0 conn(0x7feb2808fcb0 0x7feb2812fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-18T21:01:30.859 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7fee9f7fe640 1 --2- 10.20.193.68:0/3219428083 >> v2:10.20.193.68:3300/0 conn(0x7feea008faa0 0x7feea012f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.860 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7fee9f7fe640 1 -- 10.20.193.68:0/3219428083 >> v1:10.20.193.68:6789/0 conn(0x7feea008f690 legacy=0x7feea012c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.860 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7fee9f7fe640 1 -- 10.20.193.68:0/3219428083 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea00649d0 con 0x7feea0096b10 2026-02-18T21:01:30.860 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.847+0000 7fee9ffff640 1 --2- 10.20.193.68:0/3219428083 >> v2:10.20.193.68:3300/0 conn(0x7feea008faa0 0x7feea012f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:30.860 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7feb277fe640 1 --2- 10.20.193.68:0/1236784720 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb28096d20 0x7feb2808f360 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feb18009910 tx=0x7feb1802eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e99c016fdbd87c23 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:30.860 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7fee9f7fe640 1 --2- 10.20.193.68:0/3219428083 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feea0096b10 0x7feea008f150 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fee90009910 tx=0x7fee9002ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e47e4220285939c3 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:30.861 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7f37e37fe640 1 --2- 10.20.193.68:0/1667991524 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f37e4095c10 0x7f37e4095fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009940 tx=0x7f37d402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e79162cc55bde1b server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:30.861 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7fee9e7fc640 1 -- 10.20.193.68:0/3219428083 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9002f970 con 0x7feea0096b10 2026-02-18T21:01:30.861 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7feb26ffd640 1 -- 10.20.193.68:0/1236784720 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1802fa10 con 0x7feb28096d20 2026-02-18T21:01:30.861 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7feb26ffd640 1 -- 10.20.193.68:0/1236784720 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1802fb70 con 0x7feb28096d20 2026-02-18T21:01:30.861 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7feb26ffd640 1 -- 10.20.193.68:0/1236784720 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb18037440 con 0x7feb28096d20 2026-02-18T21:01:30.862 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7fee9e7fc640 1 -- 10.20.193.68:0/3219428083 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9002fad0 con 0x7feea0096b10 2026-02-18T21:01:30.862 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7fee9e7fc640 1 -- 10.20.193.68:0/3219428083 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9002fe70 con 0x7feea0096b10 2026-02-18T21:01:30.862 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7f37e27fc640 1 -- 10.20.193.68:0/1667991524 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d402fa40 con 0x7f37e4095c10 2026-02-18T21:01:30.862 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7feea4b31640 1 -- 10.20.193.68:0/3219428083 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feea0096b10 msgr2=0x7feea008f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.862 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7feea4b31640 1 --2- 10.20.193.68:0/3219428083 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feea0096b10 0x7feea008f150 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fee90009910 tx=0x7fee9002ee10 comp rx=0 tx=0).stop 2026-02-18T21:01:30.863 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7feb2e0db640 1 -- 10.20.193.68:0/1236784720 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb28096d20 msgr2=0x7feb2808f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.863 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7feb2e0db640 1 --2- 10.20.193.68:0/1236784720 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb28096d20 0x7feb2808f360 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feb18009910 tx=0x7feb1802eeb0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.863 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7f37e27fc640 1 -- 10.20.193.68:0/1667991524 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d402fba0 con 0x7f37e4095c10 2026-02-18T21:01:30.863 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7f37e27fc640 1 -- 10.20.193.68:0/1667991524 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d4037440 con 0x7f37e4095c10 2026-02-18T21:01:30.863 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7f37ea0c7640 1 -- 10.20.193.68:0/1667991524 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f37e4095c10 msgr2=0x7f37e4095fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.864 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7f37ea0c7640 1 --2- 10.20.193.68:0/1667991524 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f37e4095c10 0x7f37e4095fe0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009940 tx=0x7f37d402ef20 comp rx=0 tx=0).stop 2026-02-18T21:01:30.864 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7feea4b31640 1 -- 10.20.193.68:0/3219428083 shutdown_connections 2026-02-18T21:01:30.864 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7feea4b31640 1 --2- 10.20.193.68:0/3219428083 >> v2:10.20.193.68:3300/0 conn(0x7feea008faa0 0x7feea012f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.864 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7feea4b31640 1 --2- 10.20.193.68:0/3219428083 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feea0096b10 0x7feea008f150 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.864 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7feb2e0db640 1 -- 10.20.193.68:0/1236784720 shutdown_connections 2026-02-18T21:01:30.864 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7feb2e0db640 1 --2- 10.20.193.68:0/1236784720 >> v2:10.20.193.68:3300/0 conn(0x7feb2808fcb0 0x7feb2812fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.864 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7feb2e0db640 1 --2- 10.20.193.68:0/1236784720 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb28096d20 0x7feb2808f360 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.865 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7feea4b31640 1 -- 10.20.193.68:0/3219428083 >> 10.20.193.68:0/3219428083 conn(0x7feea0097c00 msgr2=0x7feea0098000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:30.865 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7feb2e0db640 1 -- 10.20.193.68:0/1236784720 >> 10.20.193.68:0/1236784720 conn(0x7feb28097e10 msgr2=0x7feb28098210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:30.865 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7f37ea0c7640 1 -- 10.20.193.68:0/1667991524 shutdown_connections 2026-02-18T21:01:30.865 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7f37ea0c7640 1 --2- 10.20.193.68:0/1667991524 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f37e412eae0 0x7f37e4136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.866 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7f37ea0c7640 1 --2- 10.20.193.68:0/1667991524 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f37e4095c10 0x7f37e4095fe0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.866 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7f37ea0c7640 1 -- 10.20.193.68:0/1667991524 >> 10.20.193.68:0/1667991524 conn(0x7f37e4096d00 msgr2=0x7f37e4097100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:30.866 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7feb2e0db640 1 -- 10.20.193.68:0/1236784720 shutdown_connections 2026-02-18T21:01:30.866 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7feb2e0db640 1 -- 10.20.193.68:0/1236784720 wait complete. 2026-02-18T21:01:30.866 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7f37ea0c7640 1 -- 10.20.193.68:0/1667991524 shutdown_connections 2026-02-18T21:01:30.867 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7feea4b31640 1 -- 10.20.193.68:0/3219428083 shutdown_connections 2026-02-18T21:01:30.867 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7feea4b31640 1 -- 10.20.193.68:0/3219428083 wait complete. 2026-02-18T21:01:30.867 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.848+0000 7f37ea0c7640 1 -- 10.20.193.68:0/1667991524 wait complete. 2026-02-18T21:01:30.867 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feea4b31640 1 Processor -- start 2026-02-18T21:01:30.868 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feb2e0db640 1 Processor -- start 2026-02-18T21:01:30.868 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feea4b31640 1 -- start start 2026-02-18T21:01:30.868 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feb2e0db640 1 -- start start 2026-02-18T21:01:30.869 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7f37ea0c7640 1 Processor -- start 2026-02-18T21:01:30.869 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7f37ea0c7640 1 -- start start 2026-02-18T21:01:30.869 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feb2e0db640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb2808f8a0 0x7feb28130700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:30.869 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feb2e0db640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feb2808fcb0 0x7feb2808d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:30.870 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feb2e0db640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7feb28096d20 0x7feb2808dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:30.870 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feb2e0db640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2808d570 con 0x7feb28096d20 2026-02-18T21:01:30.870 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feb2e0db640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2808c1c0 con 0x7feb2808f8a0 2026-02-18T21:01:30.870 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feb2e0db640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb2808d1a0 con 0x7feb2808fcb0 2026-02-18T21:01:30.870 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feea4b31640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feea008f690 0x7feea008c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:30.870 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feea4b31640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7feea008faa0 0x7feea008c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:30.870 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feea4b31640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feea0096b10 0x7feea008ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:30.870 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feea4b31640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea0095030 con 0x7feea008faa0 2026-02-18T21:01:30.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feea4b31640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea0120890 con 0x7feea008f690 2026-02-18T21:01:30.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feea4b31640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feea008e220 con 0x7feea0096b10 2026-02-18T21:01:30.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feb277fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb2808f8a0 0x7feb28130700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:30.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7fee9f7fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feea008f690 0x7feea008c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:30.872 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feb277fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb2808f8a0 0x7feb28130700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:45298/0 (socket says 10.20.193.68:45298) 2026-02-18T21:01:30.872 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feb277fe640 1 -- 10.20.193.68:0/3342503922 learned_addr learned my addr 10.20.193.68:0/3342503922 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:30.872 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feb1ffff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feb2808fcb0 0x7feb2808d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:30.872 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feb27fff640 1 --2- 10.20.193.68:0/3342503922 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7feb28096d20 0x7feb2808dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:30.872 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7fee9effd640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7feea008faa0 0x7feea008c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:30.872 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7fee9f7fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feea008f690 0x7feea008c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:45310/0 (socket says 10.20.193.68:45310) 2026-02-18T21:01:30.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7fee9f7fe640 1 -- 10.20.193.68:0/1395254314 learned_addr learned my addr 10.20.193.68:0/1395254314 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:30.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7fee9ffff640 1 --2- 10.20.193.68:0/1395254314 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feea0096b10 0x7feea008ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:30.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7f37ea0c7640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f37e4095c10 0x7f37e41231f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:30.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7f37ea0c7640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f37e4096520 0x7f37e4123730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:30.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7f37ea0c7640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f37e412eae0 0x7f37e4123c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:30.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7f37ea0c7640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e4099cf0 con 0x7f37e412eae0 2026-02-18T21:01:30.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7f37ea0c7640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e41248c0 con 0x7f37e4095c10 2026-02-18T21:01:30.874 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7fee9f7fe640 1 -- 10.20.193.68:0/1395254314 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feea0096b10 msgr2=0x7feea008ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.874 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7fee9f7fe640 1 --2- 10.20.193.68:0/1395254314 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feea0096b10 0x7feea008ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.874 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7f37ea0c7640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37e4126550 con 0x7f37e4096520 2026-02-18T21:01:30.874 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7feb277fe640 1 -- 10.20.193.68:0/3342503922 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feb2808fcb0 msgr2=0x7feb2808d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.875 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7feb277fe640 1 --2- 10.20.193.68:0/3342503922 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feb2808fcb0 0x7feb2808d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.875 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7feb277fe640 1 -- 10.20.193.68:0/3342503922 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7feb28096d20 msgr2=0x7feb2808dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.875 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7f37e37fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f37e4095c10 0x7f37e41231f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:30.875 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7feb277fe640 1 --2- 10.20.193.68:0/3342503922 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7feb28096d20 0x7feb2808dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.875 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7feb277fe640 1 -- 10.20.193.68:0/3342503922 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb18009450 con 0x7feb2808f8a0 2026-02-18T21:01:30.876 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7f37e37fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f37e4095c10 0x7f37e41231f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:45326/0 (socket says 10.20.193.68:45326) 2026-02-18T21:01:30.876 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7f37e37fe640 1 -- 10.20.193.68:0/857691779 learned_addr learned my addr 10.20.193.68:0/857691779 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:30.876 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7feb27fff640 1 --2- 10.20.193.68:0/3342503922 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7feb28096d20 0x7feb2808dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:30.877 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7feb1ffff640 1 --2- 10.20.193.68:0/3342503922 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feb2808fcb0 0x7feb2808d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:30.877 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7fee9f7fe640 1 -- 10.20.193.68:0/1395254314 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7feea008faa0 msgr2=0x7feea008c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.877 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7fee9f7fe640 1 --2- 10.20.193.68:0/1395254314 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7feea008faa0 0x7feea008c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.877 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7f37e3fff640 1 --2- 10.20.193.68:0/857691779 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f37e412eae0 0x7f37e4123c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:30.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7fee9f7fe640 1 -- 10.20.193.68:0/1395254314 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee98009a20 con 0x7feea008f690 2026-02-18T21:01:30.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.849+0000 7fee9effd640 1 --2- 10.20.193.68:0/1395254314 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7feea008faa0 0x7feea008c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:30.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7f37e2ffd640 1 --2- 10.20.193.68:0/857691779 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f37e4096520 0x7f37e4123730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:30.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7fee9f7fe640 1 --2- 10.20.193.68:0/1395254314 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feea008f690 0x7feea008c3d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fee9002ee50 tx=0x7fee90037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:30.879 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7feb277fe640 1 --2- 10.20.193.68:0/3342503922 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb2808f8a0 0x7feb28130700 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feb1803a040 tx=0x7feb18037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:30.879 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7fee87fff640 1 -- 10.20.193.68:0/1395254314 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90037ea0 con 0x7feea008f690 2026-02-18T21:01:30.879 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7fee87fff640 1 -- 10.20.193.68:0/1395254314 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee90042440 con 0x7feea008f690 2026-02-18T21:01:30.879 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7feea4b31640 1 -- 10.20.193.68:0/1395254314 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee90009450 con 0x7feea008f690 2026-02-18T21:01:30.880 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7f37e3fff640 1 -- 10.20.193.68:0/857691779 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f37e4096520 msgr2=0x7f37e4123730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.880 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7f37e3fff640 1 --2- 10.20.193.68:0/857691779 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f37e4096520 0x7f37e4123730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.880 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7f37e3fff640 1 -- 10.20.193.68:0/857691779 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f37e4095c10 msgr2=0x7f37e41231f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.880 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7f37e3fff640 1 --2- 10.20.193.68:0/857691779 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f37e4095c10 0x7f37e41231f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.880 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7feb24ff9640 1 -- 10.20.193.68:0/3342503922 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb180367b0 con 0x7feb2808f8a0 2026-02-18T21:01:30.881 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7f37e3fff640 1 -- 10.20.193.68:0/857691779 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d4009450 con 0x7f37e412eae0 2026-02-18T21:01:30.881 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7f37e37fe640 1 --2- 10.20.193.68:0/857691779 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f37e4095c10 0x7f37e41231f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:30.881 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7fee87fff640 1 -- 10.20.193.68:0/1395254314 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee90042840 con 0x7feea008f690 2026-02-18T21:01:30.882 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7feb24ff9640 1 -- 10.20.193.68:0/3342503922 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb18036950 con 0x7feb2808f8a0 2026-02-18T21:01:30.882 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7feb2e0db640 1 -- 10.20.193.68:0/3342503922 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb2808b870 con 0x7feb2808f8a0 2026-02-18T21:01:30.882 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7feea4b31640 1 -- 10.20.193.68:0/1395254314 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea012fba0 con 0x7feea008f690 2026-02-18T21:01:30.882 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7feb24ff9640 1 -- 10.20.193.68:0/3342503922 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb18036d10 con 0x7feb2808f8a0 2026-02-18T21:01:30.882 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7feb2e0db640 1 -- 10.20.193.68:0/3342503922 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb28130de0 con 0x7feb2808f8a0 2026-02-18T21:01:30.883 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7f37e3fff640 1 --2- 10.20.193.68:0/857691779 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f37e412eae0 0x7f37e4123c70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f37dc009e50 tx=0x7f37dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:30.883 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7f37cbfff640 1 -- 10.20.193.68:0/857691779 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc00ce20 con 0x7f37e412eae0 2026-02-18T21:01:30.883 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7f37cbfff640 1 -- 10.20.193.68:0/857691779 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37dc00f040 con 0x7f37e412eae0 2026-02-18T21:01:30.883 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7f37ea0c7640 1 -- 10.20.193.68:0/857691779 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e41262a0 con 0x7f37e412eae0 2026-02-18T21:01:30.884 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7f37cbfff640 1 -- 10.20.193.68:0/857691779 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc0146d0 con 0x7f37e412eae0 2026-02-18T21:01:30.884 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7f37ea0c7640 1 -- 10.20.193.68:0/857691779 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e41c8d50 con 0x7f37e412eae0 2026-02-18T21:01:30.884 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7feb2e0db640 1 -- 10.20.193.68:0/3342503922 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb2805f010 con 0x7feb2808f8a0 2026-02-18T21:01:30.884 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.850+0000 7feea4b31640 1 -- 10.20.193.68:0/1395254314 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea0098570 con 0x7feea008f690 2026-02-18T21:01:30.884 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.851+0000 7f37ea0c7640 1 -- 10.20.193.68:0/857691779 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e405f010 con 0x7f37e412eae0 2026-02-18T21:01:30.885 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.851+0000 7fee87fff640 1 -- 10.20.193.68:0/1395254314 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7fee9003e040 con 0x7feea008f690 2026-02-18T21:01:30.885 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.851+0000 7feb24ff9640 1 -- 10.20.193.68:0/3342503922 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7feb1803e040 con 0x7feb2808f8a0 2026-02-18T21:01:30.885 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.851+0000 7f37cbfff640 1 -- 10.20.193.68:0/857691779 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f37dc014a40 con 0x7f37e412eae0 2026-02-18T21:01:30.886 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.851+0000 7fee87fff640 1 -- 10.20.193.68:0/1395254314 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7fee900880c0 con 0x7feea008f690 2026-02-18T21:01:30.886 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.851+0000 7f37cbfff640 1 -- 10.20.193.68:0/857691779 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f37dc064720 con 0x7f37e412eae0 2026-02-18T21:01:30.886 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.851+0000 7feb24ff9640 1 -- 10.20.193.68:0/3342503922 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7feb18088c40 con 0x7feb2808f8a0 2026-02-18T21:01:30.886 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.853+0000 7feb24ff9640 1 -- 10.20.193.68:0/3342503922 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7feb18067a50 con 0x7feb2808f8a0 2026-02-18T21:01:30.887 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.854+0000 7f37cbfff640 1 -- 10.20.193.68:0/857691779 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f37dc03f5b0 con 0x7f37e412eae0 2026-02-18T21:01:30.887 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.856+0000 7fee87fff640 1 -- 10.20.193.68:0/1395254314 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7feea0098570 con 0x7feea008f690 2026-02-18T21:01:30.890 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.888+0000 7fe3b64c7640 1 Processor -- start 2026-02-18T21:01:30.891 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.888+0000 7fe3b64c7640 1 -- start start 2026-02-18T21:01:30.892 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.888+0000 7fe3b64c7640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe3b0096a50 0x7fe3b0096e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:30.892 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.888+0000 7fe3b64c7640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fe3b0097360 0x7fe3b0128e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:30.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.888+0000 7fe3b64c7640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b0098380 con 0x7fe3b0129370 2026-02-18T21:01:30.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.888+0000 7fe3b64c7640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b0099300 con 0x7fe3b0097360 2026-02-18T21:01:30.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.888+0000 7fe3b64c7640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b0069000 con 0x7fe3b0096a50 2026-02-18T21:01:30.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.888+0000 7fe3affff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe3b0096a50 0x7fe3b0096e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:30.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.888+0000 7fe3af7fe640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fe3b0097360 0x7fe3b0128e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:30.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.888+0000 7fe3affff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe3b0096a50 0x7fe3b0096e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:55526/0 (socket says 10.20.193.68:55526) 2026-02-18T21:01:30.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.888+0000 7fe3affff640 1 -- 10.20.193.68:0/907765841 learned_addr learned my addr 10.20.193.68:0/907765841 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:30.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.888+0000 7fe3b4a64640 1 --1- 10.20.193.68:0/907765841 >> v1:10.20.193.68:6789/0 conn(0x7fe3b0129370 0x7fe3b0131470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:58992/0 (socket says 10.20.193.68:58992) 2026-02-18T21:01:30.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.889+0000 7fe3affff640 1 -- 10.20.193.68:0/907765841 >> v2:10.20.193.68:3300/0 conn(0x7fe3b0097360 msgr2=0x7fe3b0128e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:30.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.889+0000 7fe3affff640 1 --2- 10.20.193.68:0/907765841 >> v2:10.20.193.68:3300/0 conn(0x7fe3b0097360 0x7fe3b0128e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.889+0000 7fe3affff640 1 -- 10.20.193.68:0/907765841 >> v1:10.20.193.68:6789/0 conn(0x7fe3b0129370 legacy=0x7fe3b0131470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.889+0000 7fe3affff640 1 -- 10.20.193.68:0/907765841 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b0098f30 con 0x7fe3b0096a50 2026-02-18T21:01:30.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.889+0000 7fe3affff640 1 --2- 10.20.193.68:0/907765841 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe3b0096a50 0x7fe3b0096e20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0009910 tx=0x7fe3a002ef40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9c946c63368d4a4 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:30.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.889+0000 7fe3aeffd640 1 -- 10.20.193.68:0/907765841 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a002faa0 con 0x7fe3b0096a50 2026-02-18T21:01:30.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.889+0000 7fe3aeffd640 1 -- 10.20.193.68:0/907765841 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a002fc00 con 0x7fe3b0096a50 2026-02-18T21:01:30.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.889+0000 7fe3aeffd640 1 -- 10.20.193.68:0/907765841 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0037440 con 0x7fe3b0096a50 2026-02-18T21:01:30.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.889+0000 7fe3b64c7640 1 -- 10.20.193.68:0/907765841 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe3b0096a50 msgr2=0x7fe3b0096e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.889+0000 7fe3b64c7640 1 --2- 10.20.193.68:0/907765841 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe3b0096a50 0x7fe3b0096e20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0009910 tx=0x7fe3a002ef40 comp rx=0 tx=0).stop 2026-02-18T21:01:30.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.889+0000 7fe3b64c7640 1 -- 10.20.193.68:0/907765841 shutdown_connections 2026-02-18T21:01:30.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.889+0000 7fe3b64c7640 1 --2- 10.20.193.68:0/907765841 >> v2:10.20.193.68:3300/0 conn(0x7fe3b0097360 0x7fe3b0128e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.889+0000 7fe3b64c7640 1 --2- 10.20.193.68:0/907765841 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe3b0096a50 0x7fe3b0096e20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.889+0000 7fe3b64c7640 1 -- 10.20.193.68:0/907765841 >> 10.20.193.68:0/907765841 conn(0x7fe3b009da20 msgr2=0x7fe3b009de20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:30.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.889+0000 7fe3b64c7640 1 -- 10.20.193.68:0/907765841 shutdown_connections 2026-02-18T21:01:30.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.889+0000 7fe3b64c7640 1 -- 10.20.193.68:0/907765841 wait complete. 2026-02-18T21:01:30.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.890+0000 7fe3b64c7640 1 Processor -- start 2026-02-18T21:01:30.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.890+0000 7fe3b64c7640 1 -- start start 2026-02-18T21:01:30.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.890+0000 7fe3b64c7640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe3b0096a50 0x7fe3b01194d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:30.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.890+0000 7fe3b64c7640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe3b0097360 0x7fe3b0119a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:30.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.890+0000 7fe3b64c7640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fe3b0129370 0x7fe3b0119f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:30.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.890+0000 7fe3b64c7640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b011c0b0 con 0x7fe3b0129370 2026-02-18T21:01:30.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.890+0000 7fe3b64c7640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b011b040 con 0x7fe3b0096a50 2026-02-18T21:01:30.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.890+0000 7fe3b64c7640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b011cd00 con 0x7fe3b0097360 2026-02-18T21:01:30.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.890+0000 7fe3af7fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe3b0097360 0x7fe3b0119a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:30.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.890+0000 7fe3affff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe3b0096a50 0x7fe3b01194d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:30.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.890+0000 7fe3af7fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe3b0097360 0x7fe3b0119a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:55536/0 (socket says 10.20.193.68:55536) 2026-02-18T21:01:30.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.890+0000 7fe3af7fe640 1 -- 10.20.193.68:0/403674950 learned_addr learned my addr 10.20.193.68:0/403674950 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:30.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.890+0000 7fe3b4a64640 1 --2- 10.20.193.68:0/403674950 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fe3b0129370 0x7fe3b0119f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:30.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.890+0000 7fe3affff640 1 -- 10.20.193.68:0/403674950 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe3b0097360 msgr2=0x7fe3b0119a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.890+0000 7fe3affff640 1 --2- 10.20.193.68:0/403674950 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe3b0097360 0x7fe3b0119a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.890+0000 7fe3affff640 1 -- 10.20.193.68:0/403674950 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fe3b0129370 msgr2=0x7fe3b0119f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.890+0000 7fe3affff640 1 --2- 10.20.193.68:0/403674950 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fe3b0129370 0x7fe3b0119f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.890+0000 7fe3affff640 1 -- 10.20.193.68:0/403674950 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a0009450 con 0x7fe3b0096a50 2026-02-18T21:01:30.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.890+0000 7fe3af7fe640 1 --2- 10.20.193.68:0/403674950 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe3b0097360 0x7fe3b0119a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:30.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.891+0000 7fe3affff640 1 --2- 10.20.193.68:0/403674950 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe3b0096a50 0x7fe3b01194d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0036000 tx=0x7fe3a0037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:30.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.891+0000 7fe3acff9640 1 -- 10.20.193.68:0/403674950 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0006b30 con 0x7fe3b0096a50 2026-02-18T21:01:30.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.891+0000 7fe3acff9640 1 -- 10.20.193.68:0/403674950 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a0037e40 con 0x7fe3b0096a50 2026-02-18T21:01:30.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.891+0000 7fe3b64c7640 1 -- 10.20.193.68:0/403674950 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b011a580 con 0x7fe3b0096a50 2026-02-18T21:01:30.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.891+0000 7fe3acff9640 1 -- 10.20.193.68:0/403674950 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a0036c90 con 0x7fe3b0096a50 2026-02-18T21:01:30.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.891+0000 7fe3b64c7640 1 -- 10.20.193.68:0/403674950 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b01be410 con 0x7fe3b0096a50 2026-02-18T21:01:30.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.891+0000 7fe3b64c7640 1 -- 10.20.193.68:0/403674950 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b005f010 con 0x7fe3b0096a50 2026-02-18T21:01:30.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.891+0000 7fe3acff9640 1 -- 10.20.193.68:0/403674950 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7fe3a003e040 con 0x7fe3b0096a50 2026-02-18T21:01:30.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.892+0000 7fe3acff9640 1 -- 10.20.193.68:0/403674950 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7fe3a00881f0 con 0x7fe3b0096a50 2026-02-18T21:01:30.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.893+0000 7fe3acff9640 1 -- 10.20.193.68:0/403674950 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7fe3a0063190 con 0x7fe3b0096a50 2026-02-18T21:01:30.919 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.917+0000 7feb2e0db640 1 -- 10.20.193.68:0/3342503922 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feb280633d0 con 0x7feb2808f8a0 2026-02-18T21:01:30.920 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.917+0000 7feb24ff9640 1 -- 10.20.193.68:0/3342503922 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feb18047070 con 0x7feb2808f8a0 2026-02-18T21:01:30.920 INFO:teuthology.orchestra.run.trial068.stdout:38654705666 2026-02-18T21:01:30.921 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.918+0000 7feb2e0db640 1 -- 10.20.193.68:0/3342503922 >> v1:10.20.193.68:6816/24610 conn(0x7feb0804d0d0 legacy=0x7feb0804f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.921 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.918+0000 7feb2e0db640 1 -- 10.20.193.68:0/3342503922 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb2808f8a0 msgr2=0x7feb28130700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.921 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.918+0000 7feb2e0db640 1 --2- 10.20.193.68:0/3342503922 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb2808f8a0 0x7feb28130700 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feb1803a040 tx=0x7feb18037000 comp rx=0 tx=0).stop 2026-02-18T21:01:30.921 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.918+0000 7feb2e0db640 1 -- 10.20.193.68:0/3342503922 shutdown_connections 2026-02-18T21:01:30.922 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.918+0000 7feb2e0db640 1 --2- 10.20.193.68:0/3342503922 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7feb28096d20 0x7feb2808dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.922 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.918+0000 7feb2e0db640 1 --2- 10.20.193.68:0/3342503922 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feb2808fcb0 0x7feb2808d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.922 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.918+0000 7feb2e0db640 1 --2- 10.20.193.68:0/3342503922 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb2808f8a0 0x7feb28130700 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.922 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.918+0000 7feb2e0db640 1 -- 10.20.193.68:0/3342503922 >> 10.20.193.68:0/3342503922 conn(0x7feb28097e10 msgr2=0x7feb28094810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:30.922 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.918+0000 7feb2e0db640 1 -- 10.20.193.68:0/3342503922 shutdown_connections 2026-02-18T21:01:30.922 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.918+0000 7feb2e0db640 1 -- 10.20.193.68:0/3342503922 wait complete. 2026-02-18T21:01:30.923 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.920+0000 7f37ea0c7640 1 -- 10.20.193.68:0/857691779 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f37e406f020 con 0x7f37e412eae0 2026-02-18T21:01:30.923 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.920+0000 7f37cbfff640 1 -- 10.20.193.68:0/857691779 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37dc018070 con 0x7f37e412eae0 2026-02-18T21:01:30.923 INFO:teuthology.orchestra.run.trial068.stdout:38654705667 2026-02-18T21:01:30.924 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.921+0000 7f37ea0c7640 1 -- 10.20.193.68:0/857691779 >> v1:10.20.193.68:6816/24610 conn(0x7f37d004d0d0 legacy=0x7f37d004f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.924 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.921+0000 7f37ea0c7640 1 -- 10.20.193.68:0/857691779 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f37e412eae0 msgr2=0x7f37e4123c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.924 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.921+0000 7f37ea0c7640 1 --2- 10.20.193.68:0/857691779 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f37e412eae0 0x7f37e4123c70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f37dc009e50 tx=0x7f37dc00b040 comp rx=0 tx=0).stop 2026-02-18T21:01:30.924 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.921+0000 7f37ea0c7640 1 -- 10.20.193.68:0/857691779 shutdown_connections 2026-02-18T21:01:30.925 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.921+0000 7f37ea0c7640 1 --2- 10.20.193.68:0/857691779 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f37e412eae0 0x7f37e4123c70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.925 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.921+0000 7f37ea0c7640 1 --2- 10.20.193.68:0/857691779 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f37e4096520 0x7f37e4123730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.925 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.921+0000 7f37ea0c7640 1 --2- 10.20.193.68:0/857691779 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f37e4095c10 0x7f37e41231f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.925 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.921+0000 7f37ea0c7640 1 -- 10.20.193.68:0/857691779 >> 10.20.193.68:0/857691779 conn(0x7f37e4096d00 msgr2=0x7f37e40934a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:30.925 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.921+0000 7f37ea0c7640 1 -- 10.20.193.68:0/857691779 shutdown_connections 2026-02-18T21:01:30.925 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.921+0000 7f37ea0c7640 1 -- 10.20.193.68:0/857691779 wait complete. 2026-02-18T21:01:30.925 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.922+0000 7feea4b31640 1 -- 10.20.193.68:0/1395254314 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feea0098570 con 0x7feea008f690 2026-02-18T21:01:30.926 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.922+0000 7fee87fff640 1 -- 10.20.193.68:0/1395254314 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feea0098570 con 0x7feea008f690 2026-02-18T21:01:30.926 INFO:teuthology.orchestra.run.trial068.stdout:38654705666 2026-02-18T21:01:30.928 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.924+0000 7feea4b31640 1 -- 10.20.193.68:0/1395254314 >> v1:10.20.193.68:6816/24610 conn(0x7fee8c04d0d0 legacy=0x7fee8c04f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.928 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.924+0000 7feea4b31640 1 -- 10.20.193.68:0/1395254314 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feea008f690 msgr2=0x7feea008c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.928 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.924+0000 7feea4b31640 1 --2- 10.20.193.68:0/1395254314 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feea008f690 0x7feea008c3d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fee9002ee50 tx=0x7fee90037000 comp rx=0 tx=0).stop 2026-02-18T21:01:30.928 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.924+0000 7feea4b31640 1 -- 10.20.193.68:0/1395254314 shutdown_connections 2026-02-18T21:01:30.928 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.924+0000 7feea4b31640 1 --2- 10.20.193.68:0/1395254314 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feea0096b10 0x7feea008ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.928 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.924+0000 7feea4b31640 1 --2- 10.20.193.68:0/1395254314 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7feea008faa0 0x7feea008c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.928 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.924+0000 7feea4b31640 1 --2- 10.20.193.68:0/1395254314 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feea008f690 0x7feea008c3d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.928 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.924+0000 7feea4b31640 1 -- 10.20.193.68:0/1395254314 >> 10.20.193.68:0/1395254314 conn(0x7feea0097c00 msgr2=0x7feea0093e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:30.929 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.924+0000 7feea4b31640 1 -- 10.20.193.68:0/1395254314 shutdown_connections 2026-02-18T21:01:30.929 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.924+0000 7feea4b31640 1 -- 10.20.193.68:0/1395254314 wait complete. 2026-02-18T21:01:30.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.1 2026-02-18T21:01:30.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.3 2026-02-18T21:01:30.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.0 2026-02-18T21:01:30.960 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.957+0000 7fe3b64c7640 1 -- 10.20.193.68:0/403674950 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe3b0063430 con 0x7fe3b0096a50 2026-02-18T21:01:30.960 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.957+0000 7fe3acff9640 1 -- 10.20.193.68:0/403674950 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe3a003c020 con 0x7fe3b0096a50 2026-02-18T21:01:30.960 INFO:teuthology.orchestra.run.trial068.stdout:38654705667 2026-02-18T21:01:30.961 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.958+0000 7fe3b64c7640 1 -- 10.20.193.68:0/403674950 >> v1:10.20.193.68:6816/24610 conn(0x7fe39c04d0d0 legacy=0x7fe39c04f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.961 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.958+0000 7fe3b64c7640 1 -- 10.20.193.68:0/403674950 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe3b0096a50 msgr2=0x7fe3b01194d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:30.961 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.958+0000 7fe3b64c7640 1 --2- 10.20.193.68:0/403674950 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe3b0096a50 0x7fe3b01194d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0036000 tx=0x7fe3a0037000 comp rx=0 tx=0).stop 2026-02-18T21:01:30.961 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.958+0000 7fe3b64c7640 1 -- 10.20.193.68:0/403674950 shutdown_connections 2026-02-18T21:01:30.962 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.958+0000 7fe3b64c7640 1 --2- 10.20.193.68:0/403674950 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fe3b0129370 0x7fe3b0119f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.962 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.958+0000 7fe3b64c7640 1 --2- 10.20.193.68:0/403674950 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe3b0097360 0x7fe3b0119a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.962 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.958+0000 7fe3b64c7640 1 --2- 10.20.193.68:0/403674950 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe3b0096a50 0x7fe3b01194d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:30.962 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.958+0000 7fe3b64c7640 1 -- 10.20.193.68:0/403674950 >> 10.20.193.68:0/403674950 conn(0x7fe3b009da20 msgr2=0x7fe3b01aebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:30.962 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.958+0000 7fe3b64c7640 1 -- 10.20.193.68:0/403674950 shutdown_connections 2026-02-18T21:01:30.962 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:30.958+0000 7fe3b64c7640 1 -- 10.20.193.68:0/403674950 wait complete. 2026-02-18T21:01:30.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.2 2026-02-18T21:01:31.931 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-18T21:01:31.932 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-18T21:01:31.936 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-18T21:01:31.969 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-18T21:01:31.998 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.995+0000 7f8fdffff640 1 Processor -- start 2026-02-18T21:01:31.998 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.995+0000 7f8fdffff640 1 -- start start 2026-02-18T21:01:31.999 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.995+0000 7f8a51adb640 1 Processor -- start 2026-02-18T21:01:31.999 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.995+0000 7f8fdffff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8fe0095a00 0x7f8fe0095dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:31.999 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.995+0000 7f8fdffff640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f8fe012d8a0 0x7f8fe012fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:31.999 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.995+0000 7f8fdffff640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe0067350 con 0x7f8fe0096310 2026-02-18T21:01:32.000 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.995+0000 7f8fdffff640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe006f700 con 0x7f8fe012d8a0 2026-02-18T21:01:32.000 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.995+0000 7f8a51adb640 1 -- start start 2026-02-18T21:01:32.001 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.995+0000 7f8fdffff640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe00678f0 con 0x7f8fe0095a00 2026-02-18T21:01:32.001 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8fdeffd640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8fe0095a00 0x7f8fe0095dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.001 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8fdeffd640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8fe0095a00 0x7f8fe0095dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:55542/0 (socket says 10.20.193.68:55542) 2026-02-18T21:01:32.001 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8fdeffd640 1 -- 10.20.193.68:0/414221438 learned_addr learned my addr 10.20.193.68:0/414221438 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:32.001 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8fdf7fe640 1 --2- 10.20.193.68:0/414221438 >> v2:10.20.193.68:3300/0 conn(0x7f8fe012d8a0 0x7f8fe012fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.001 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8fd7fff640 1 --1- 10.20.193.68:0/414221438 >> v1:10.20.193.68:6789/0 conn(0x7f8fe0096310 0x7f8fe012c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:59004/0 (socket says 10.20.193.68:59004) 2026-02-18T21:01:32.001 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8fdeffd640 1 -- 10.20.193.68:0/414221438 >> v2:10.20.193.68:3300/0 conn(0x7f8fe012d8a0 msgr2=0x7f8fe012fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:32.002 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8fdeffd640 1 --2- 10.20.193.68:0/414221438 >> v2:10.20.193.68:3300/0 conn(0x7f8fe012d8a0 0x7f8fe012fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.002 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8fdeffd640 1 -- 10.20.193.68:0/414221438 >> v1:10.20.193.68:6789/0 conn(0x7f8fe0096310 legacy=0x7f8fe012c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.002 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8fdeffd640 1 -- 10.20.193.68:0/414221438 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe0093920 con 0x7f8fe0095a00 2026-02-18T21:01:32.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8a51adb640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f8a4c06c480 0x7f8a4c12d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8a51adb640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8a4c12d650 0x7f8a4c12fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8a51adb640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4c06e010 con 0x7f8a4c06b9a0 2026-02-18T21:01:32.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8a51adb640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4c06c850 con 0x7f8a4c06c480 2026-02-18T21:01:32.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8a51adb640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c06dc70 con 0x7f8a4c12d650 2026-02-18T21:01:32.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8a4b7fe640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f8a4c06b9a0 0x7f8a4c06bd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:59014/0 (socket says 10.20.193.68:59014) 2026-02-18T21:01:32.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8a4b7fe640 1 -- 10.20.193.68:0/3395774948 learned_addr learned my addr 10.20.193.68:0/3395774948 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:01:32.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8a4affd640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f8a4c06c480 0x7f8a4c12d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8a4bfff640 1 --2- 10.20.193.68:0/3395774948 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8a4c12d650 0x7f8a4c12fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8fdeffd640 1 --2- 10.20.193.68:0/414221438 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8fe0095a00 0x7f8fe0095dd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009910 tx=0x7f8fd002eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=647ad30f65835ea5 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:32.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8a4a7fc640 1 -- 10.20.193.68:0/3395774948 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657866254 0 0) 0x7f8a4c06e010 con 0x7f8a4c06b9a0 2026-02-18T21:01:32.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8a4a7fc640 1 -- 10.20.193.68:0/3395774948 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a340034e0 con 0x7f8a4c06b9a0 2026-02-18T21:01:32.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8a4affd640 1 -- 10.20.193.68:0/3395774948 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8a4c12d650 msgr2=0x7f8a4c12fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:32.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8a4affd640 1 --2- 10.20.193.68:0/3395774948 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8a4c12d650 0x7f8a4c12fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8a4affd640 1 -- 10.20.193.68:0/3395774948 >> v1:10.20.193.68:6789/0 conn(0x7f8a4c06b9a0 legacy=0x7f8a4c06bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8a4affd640 1 -- 10.20.193.68:0/3395774948 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c098ea0 con 0x7f8a4c06c480 2026-02-18T21:01:32.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8fde7fc640 1 -- 10.20.193.68:0/414221438 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd002fa10 con 0x7f8fe0095a00 2026-02-18T21:01:32.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8fde7fc640 1 -- 10.20.193.68:0/414221438 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd002fb70 con 0x7f8fe0095a00 2026-02-18T21:01:32.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.996+0000 7f8fde7fc640 1 -- 10.20.193.68:0/414221438 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0037440 con 0x7f8fe0095a00 2026-02-18T21:01:32.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8a4affd640 1 --2- 10.20.193.68:0/3395774948 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8a4c06c480 0x7f8a4c12d110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009850 tx=0x7f8a4002ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693daa6dfa0b41fe server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:32.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8a4a7fc640 1 -- 10.20.193.68:0/3395774948 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4002f8b0 con 0x7f8a4c06c480 2026-02-18T21:01:32.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8a4a7fc640 1 -- 10.20.193.68:0/3395774948 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4002fa10 con 0x7f8a4c06c480 2026-02-18T21:01:32.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8a4a7fc640 1 -- 10.20.193.68:0/3395774948 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4002fdb0 con 0x7f8a4c06c480 2026-02-18T21:01:32.007 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8fdffff640 1 -- 10.20.193.68:0/414221438 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8fe0095a00 msgr2=0x7f8fe0095dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.007 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8fdffff640 1 --2- 10.20.193.68:0/414221438 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8fe0095a00 0x7f8fe0095dd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009910 tx=0x7f8fd002eeb0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.007 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8fdffff640 1 -- 10.20.193.68:0/414221438 shutdown_connections 2026-02-18T21:01:32.007 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8fdffff640 1 --2- 10.20.193.68:0/414221438 >> v2:10.20.193.68:3300/0 conn(0x7f8fe012d8a0 0x7f8fe012fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.008 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8fdffff640 1 --2- 10.20.193.68:0/414221438 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8fe0095a00 0x7f8fe0095dd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.008 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8fdffff640 1 -- 10.20.193.68:0/414221438 >> 10.20.193.68:0/414221438 conn(0x7f8fe0096af0 msgr2=0x7f8fe0096ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:32.008 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8fdffff640 1 -- 10.20.193.68:0/414221438 shutdown_connections 2026-02-18T21:01:32.008 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8fdffff640 1 -- 10.20.193.68:0/414221438 wait complete. 2026-02-18T21:01:32.009 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8a51adb640 1 -- 10.20.193.68:0/3395774948 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8a4c06c480 msgr2=0x7f8a4c12d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.009 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8a51adb640 1 --2- 10.20.193.68:0/3395774948 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8a4c06c480 0x7f8a4c12d110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009850 tx=0x7f8a4002ed50 comp rx=0 tx=0).stop 2026-02-18T21:01:32.009 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8a51adb640 1 -- 10.20.193.68:0/3395774948 shutdown_connections 2026-02-18T21:01:32.009 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8a51adb640 1 --2- 10.20.193.68:0/3395774948 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8a4c12d650 0x7f8a4c12fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.009 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8a51adb640 1 --2- 10.20.193.68:0/3395774948 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8a4c06c480 0x7f8a4c12d110 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.009 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8a51adb640 1 -- 10.20.193.68:0/3395774948 >> 10.20.193.68:0/3395774948 conn(0x7f8a4c09b6a0 msgr2=0x7f8a4c09baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:32.009 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8a51adb640 1 -- 10.20.193.68:0/3395774948 shutdown_connections 2026-02-18T21:01:32.009 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8a51adb640 1 -- 10.20.193.68:0/3395774948 wait complete. 2026-02-18T21:01:32.010 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8fdffff640 1 Processor -- start 2026-02-18T21:01:32.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.997+0000 7f8fdffff640 1 -- start start 2026-02-18T21:01:32.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fdffff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8fe0095a00 0x7f8fe01bca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fdffff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8fe0096310 0x7f8fe01bcf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fdffff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8fe012d8a0 0x7f8fe01bd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fdffff640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe0090f70 con 0x7f8fe012d8a0 2026-02-18T21:01:32.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fdffff640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe0120910 con 0x7f8fe0095a00 2026-02-18T21:01:32.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fdffff640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe0120bb0 con 0x7f8fe0096310 2026-02-18T21:01:32.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fd7fff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8fe0096310 0x7f8fe01bcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fdeffd640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8fe0095a00 0x7f8fe01bca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fdf7fe640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8fe012d8a0 0x7f8fe01bd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a51adb640 1 Processor -- start 2026-02-18T21:01:32.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fd7fff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8fe0096310 0x7f8fe01bcf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:55554/0 (socket says 10.20.193.68:55554) 2026-02-18T21:01:32.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fdf7fe640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8fe012d8a0 0x7f8fe01bd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:39490/0 (socket says 10.20.193.68:39490) 2026-02-18T21:01:32.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fd7fff640 1 -- 10.20.193.68:0/2833888315 learned_addr learned my addr 10.20.193.68:0/2833888315 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:32.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a51adb640 1 -- start start 2026-02-18T21:01:32.014 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fd7fff640 1 -- 10.20.193.68:0/2833888315 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8fe0095a00 msgr2=0x7f8fe01bca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.014 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fd7fff640 1 --2- 10.20.193.68:0/2833888315 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8fe0095a00 0x7f8fe01bca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.014 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fd7fff640 1 -- 10.20.193.68:0/2833888315 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8fe012d8a0 msgr2=0x7f8fe01bd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.014 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fd7fff640 1 --2- 10.20.193.68:0/2833888315 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8fe012d8a0 0x7f8fe01bd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.014 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fd7fff640 1 -- 10.20.193.68:0/2833888315 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd0009450 con 0x7f8fe0096310 2026-02-18T21:01:32.014 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fdf7fe640 1 --2- 10.20.193.68:0/2833888315 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8fe012d8a0 0x7f8fe01bd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:32.014 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fd7fff640 1 --2- 10.20.193.68:0/2833888315 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8fe0096310 0x7f8fe01bcf60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8fc800c580 tx=0x7f8fc8007e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:32.015 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a51adb640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8a4c06b9a0 0x7f8a4c068640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.015 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a51adb640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8a4c06c480 0x7f8a4c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.015 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a51adb640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8a4c12d650 0x7f8a4c0690c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.015 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a51adb640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c1202e0 con 0x7f8a4c12d650 2026-02-18T21:01:32.015 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a51adb640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c11f7c0 con 0x7f8a4c06c480 2026-02-18T21:01:32.015 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a51adb640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4c06a170 con 0x7f8a4c06b9a0 2026-02-18T21:01:32.016 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fd77fe640 1 -- 10.20.193.68:0/2833888315 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8007300 con 0x7f8fe0096310 2026-02-18T21:01:32.016 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fd77fe640 1 -- 10.20.193.68:0/2833888315 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc8007460 con 0x7f8fe0096310 2026-02-18T21:01:32.016 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fd77fe640 1 -- 10.20.193.68:0/2833888315 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc80047a0 con 0x7f8fe0096310 2026-02-18T21:01:32.016 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fdffff640 1 -- 10.20.193.68:0/2833888315 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe006e1e0 con 0x7f8fe0096310 2026-02-18T21:01:32.016 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a4b7fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8a4c06b9a0 0x7f8a4c068640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a4b7fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8a4c06b9a0 0x7f8a4c068640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:55564/0 (socket says 10.20.193.68:55564) 2026-02-18T21:01:32.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a4affd640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8a4c06c480 0x7f8a4c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a4b7fe640 1 -- 10.20.193.68:0/2901856806 learned_addr learned my addr 10.20.193.68:0/2901856806 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:32.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a4bfff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8a4c12d650 0x7f8a4c0690c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8fdffff640 1 -- 10.20.193.68:0/2833888315 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe008f580 con 0x7f8fe0096310 2026-02-18T21:01:32.018 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a4affd640 1 -- 10.20.193.68:0/2901856806 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8a4c06b9a0 msgr2=0x7f8a4c068640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.018 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a4affd640 1 --2- 10.20.193.68:0/2901856806 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8a4c06b9a0 0x7f8a4c068640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.018 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a4affd640 1 -- 10.20.193.68:0/2901856806 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8a4c12d650 msgr2=0x7f8a4c0690c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.018 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a4affd640 1 --2- 10.20.193.68:0/2901856806 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8a4c12d650 0x7f8a4c0690c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.019 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a4affd640 1 -- 10.20.193.68:0/2901856806 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a40009390 con 0x7f8a4c06c480 2026-02-18T21:01:32.019 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a4affd640 1 --2- 10.20.193.68:0/2901856806 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8a4c06c480 0x7f8a4c068b80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8a40036000 tx=0x7f8a40037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:32.019 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a33fff640 1 -- 10.20.193.68:0/2901856806 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40037e60 con 0x7f8a4c06c480 2026-02-18T21:01:32.019 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a33fff640 1 -- 10.20.193.68:0/2901856806 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a40042420 con 0x7f8a4c06c480 2026-02-18T21:01:32.019 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.998+0000 7f8a51adb640 1 -- 10.20.193.68:0/2901856806 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4c12d190 con 0x7f8a4c06c480 2026-02-18T21:01:32.019 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.999+0000 7f8a33fff640 1 -- 10.20.193.68:0/2901856806 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40042800 con 0x7f8a4c06c480 2026-02-18T21:01:32.019 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.999+0000 7f8a51adb640 1 -- 10.20.193.68:0/2901856806 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4c069820 con 0x7f8a4c06c480 2026-02-18T21:01:32.020 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.999+0000 7f8fdffff640 1 -- 10.20.193.68:0/2833888315 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe005f010 con 0x7f8fe0096310 2026-02-18T21:01:32.020 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.999+0000 7f8fd77fe640 1 -- 10.20.193.68:0/2833888315 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f8fc8004bd0 con 0x7f8fe0096310 2026-02-18T21:01:32.020 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.999+0000 7f8a51adb640 1 -- 10.20.193.68:0/2901856806 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4c06e1c0 con 0x7f8a4c06c480 2026-02-18T21:01:32.020 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.999+0000 7f8a33fff640 1 -- 10.20.193.68:0/2901856806 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f8a4003e040 con 0x7f8a4c06c480 2026-02-18T21:01:32.020 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.999+0000 7f8fd77fe640 1 -- 10.20.193.68:0/2833888315 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f8fc8062be0 con 0x7f8fe0096310 2026-02-18T21:01:32.021 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:31.999+0000 7f8a33fff640 1 -- 10.20.193.68:0/2901856806 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f8a40087c10 con 0x7f8a4c06c480 2026-02-18T21:01:32.021 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.001+0000 7f8fd77fe640 1 -- 10.20.193.68:0/2833888315 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f8fc803da50 con 0x7f8fe0096310 2026-02-18T21:01:32.021 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.001+0000 7f8a33fff640 1 -- 10.20.193.68:0/2901856806 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f8a40062b10 con 0x7f8a4c06c480 2026-02-18T21:01:32.042 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.039+0000 7f1648cc7640 1 Processor -- start 2026-02-18T21:01:32.042 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.039+0000 7f1648cc7640 1 -- start start 2026-02-18T21:01:32.042 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.039+0000 7f1648cc7640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f1644096d20 0x7f164408f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.042 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.039+0000 7f1648cc7640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f164408f8a0 0x7f164408fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.043 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.039+0000 7fd179e9b640 1 Processor -- start 2026-02-18T21:01:32.043 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.039+0000 7f1648cc7640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16440976c0 con 0x7f164412c490 2026-02-18T21:01:32.043 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.039+0000 7f1648cc7640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1644097ca0 con 0x7f1644096d20 2026-02-18T21:01:32.043 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.039+0000 7f1648cc7640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16440901f0 con 0x7f164408f8a0 2026-02-18T21:01:32.044 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.039+0000 7fd179e9b640 1 -- start start 2026-02-18T21:01:32.045 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.039+0000 7f1641d9b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f164408f8a0 0x7f164408fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.045 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.039+0000 7f164259c640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f1644096d20 0x7f164408f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.045 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.039+0000 7f1642d9d640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f164412c490 0x7f164412e870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:59028/0 (socket says 10.20.193.68:59028) 2026-02-18T21:01:32.045 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.039+0000 7f1642d9d640 1 -- 10.20.193.68:0/2519647426 learned_addr learned my addr 10.20.193.68:0/2519647426 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:01:32.045 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7f164159a640 1 -- 10.20.193.68:0/2519647426 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140126836 0 0) 0x7f16440976c0 con 0x7f164412c490 2026-02-18T21:01:32.045 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7f164159a640 1 -- 10.20.193.68:0/2519647426 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f162c0034e0 con 0x7f164412c490 2026-02-18T21:01:32.046 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7f164259c640 1 -- 10.20.193.68:0/2519647426 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f164408f8a0 msgr2=0x7f164408fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:32.046 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7f164259c640 1 --2- 10.20.193.68:0/2519647426 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f164408f8a0 0x7f164408fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.046 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7f164259c640 1 -- 10.20.193.68:0/2519647426 >> v1:10.20.193.68:6789/0 conn(0x7f164412c490 legacy=0x7f164412e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.046 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7f164259c640 1 -- 10.20.193.68:0/2519647426 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1644091700 con 0x7f1644096d20 2026-02-18T21:01:32.046 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7f1641d9b640 1 --2- 10.20.193.68:0/2519647426 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f164408f8a0 0x7f164408fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:32.047 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7fd179e9b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd174127fa0 0x7fd174128370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.047 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7fd179e9b640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fd1741288b0 0x7fd17406a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.047 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7fd179e9b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd174127da0 con 0x7fd17406a650 2026-02-18T21:01:32.047 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7fd179e9b640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd174095930 con 0x7fd1741288b0 2026-02-18T21:01:32.047 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7fd179e9b640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd174069340 con 0x7fd174127fa0 2026-02-18T21:01:32.048 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7fd16bfff640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fd1741288b0 0x7fd17406a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.048 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7fd1737fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd174127fa0 0x7fd174128370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.048 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7fd16bfff640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fd1741288b0 0x7fd17406a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:39506/0 (socket says 10.20.193.68:39506) 2026-02-18T21:01:32.048 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7fd16bfff640 1 -- 10.20.193.68:0/423758773 learned_addr learned my addr 10.20.193.68:0/423758773 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:32.048 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7fd16bfff640 1 -- 10.20.193.68:0/423758773 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd174127fa0 msgr2=0x7fd174128370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:32.048 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7fd16bfff640 1 --2- 10.20.193.68:0/423758773 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd174127fa0 0x7fd174128370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.048 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7fd16bfff640 1 -- 10.20.193.68:0/423758773 >> v1:10.20.193.68:6789/0 conn(0x7fd17406a650 legacy=0x7fd17412efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.048 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7fd16bfff640 1 -- 10.20.193.68:0/423758773 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd174095dd0 con 0x7fd1741288b0 2026-02-18T21:01:32.049 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7f164259c640 1 --2- 10.20.193.68:0/2519647426 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1644096d20 0x7f164408f360 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1634009880 tx=0x7f163402ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3155799ffff2be27 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:32.049 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7f164159a640 1 -- 10.20.193.68:0/2519647426 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163402f930 con 0x7f1644096d20 2026-02-18T21:01:32.049 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7f164159a640 1 -- 10.20.193.68:0/2519647426 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163402fa90 con 0x7f1644096d20 2026-02-18T21:01:32.049 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7f164159a640 1 -- 10.20.193.68:0/2519647426 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163402fe30 con 0x7f1644096d20 2026-02-18T21:01:32.049 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7fd16bfff640 1 --2- 10.20.193.68:0/423758773 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd1741288b0 0x7fd17406a110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009910 tx=0x7fd15c02eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe869bdef4b002ad server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:32.050 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.041+0000 7f1648cc7640 1 -- 10.20.193.68:0/2519647426 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1644096d20 msgr2=0x7f164408f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.050 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.041+0000 7f1648cc7640 1 --2- 10.20.193.68:0/2519647426 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1644096d20 0x7f164408f360 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1634009880 tx=0x7f163402ee10 comp rx=0 tx=0).stop 2026-02-18T21:01:32.050 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.040+0000 7fd172ffd640 1 -- 10.20.193.68:0/423758773 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c02fa00 con 0x7fd1741288b0 2026-02-18T21:01:32.051 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.041+0000 7fd172ffd640 1 -- 10.20.193.68:0/423758773 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15c02fb60 con 0x7fd1741288b0 2026-02-18T21:01:32.051 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.041+0000 7fd172ffd640 1 -- 10.20.193.68:0/423758773 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c037440 con 0x7fd1741288b0 2026-02-18T21:01:32.051 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.041+0000 7f1648cc7640 1 -- 10.20.193.68:0/2519647426 shutdown_connections 2026-02-18T21:01:32.051 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.041+0000 7f1648cc7640 1 --2- 10.20.193.68:0/2519647426 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f164408f8a0 0x7f164408fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.051 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.041+0000 7f1648cc7640 1 --2- 10.20.193.68:0/2519647426 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1644096d20 0x7f164408f360 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.052 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.041+0000 7f1648cc7640 1 -- 10.20.193.68:0/2519647426 >> 10.20.193.68:0/2519647426 conn(0x7f1644097e10 msgr2=0x7f1644098210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:32.052 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.041+0000 7f1648cc7640 1 -- 10.20.193.68:0/2519647426 shutdown_connections 2026-02-18T21:01:32.052 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.041+0000 7f1648cc7640 1 -- 10.20.193.68:0/2519647426 wait complete. 2026-02-18T21:01:32.052 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.041+0000 7fd179e9b640 1 -- 10.20.193.68:0/423758773 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd1741288b0 msgr2=0x7fd17406a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.053 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.041+0000 7fd179e9b640 1 --2- 10.20.193.68:0/423758773 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd1741288b0 0x7fd17406a110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009910 tx=0x7fd15c02eea0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.053 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.041+0000 7fd179e9b640 1 -- 10.20.193.68:0/423758773 shutdown_connections 2026-02-18T21:01:32.053 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.041+0000 7fd179e9b640 1 --2- 10.20.193.68:0/423758773 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd1741288b0 0x7fd17406a110 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.053 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.041+0000 7fd179e9b640 1 --2- 10.20.193.68:0/423758773 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd174127fa0 0x7fd174128370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.053 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.041+0000 7fd179e9b640 1 -- 10.20.193.68:0/423758773 >> 10.20.193.68:0/423758773 conn(0x7fd174096650 msgr2=0x7fd174096a50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:32.053 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.041+0000 7fd179e9b640 1 -- 10.20.193.68:0/423758773 shutdown_connections 2026-02-18T21:01:32.053 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.041+0000 7fd179e9b640 1 -- 10.20.193.68:0/423758773 wait complete. 2026-02-18T21:01:32.054 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.041+0000 7f1648cc7640 1 Processor -- start 2026-02-18T21:01:32.054 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.041+0000 7f1648cc7640 1 -- start start 2026-02-18T21:01:32.054 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd179e9b640 1 Processor -- start 2026-02-18T21:01:32.054 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd179e9b640 1 -- start start 2026-02-18T21:01:32.055 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f1648cc7640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f164408f8a0 0x7f164412ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.055 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f1648cc7640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1644096d20 0x7f16440883a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.055 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f1648cc7640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f164412c490 0x7f16440888e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.055 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f1648cc7640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1644089da0 con 0x7f164412c490 2026-02-18T21:01:32.056 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f1648cc7640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164408eee0 con 0x7f164408f8a0 2026-02-18T21:01:32.056 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f1648cc7640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f164408b9c0 con 0x7f1644096d20 2026-02-18T21:01:32.056 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f164259c640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f164408f8a0 0x7f164412ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.056 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f164259c640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f164408f8a0 0x7f164412ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:45380/0 (socket says 10.20.193.68:45380) 2026-02-18T21:01:32.056 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f164259c640 1 -- 10.20.193.68:0/3975805884 learned_addr learned my addr 10.20.193.68:0/3975805884 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:32.056 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f1642d9d640 1 --2- 10.20.193.68:0/3975805884 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f164412c490 0x7f16440888e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.056 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f1641d9b640 1 --2- 10.20.193.68:0/3975805884 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1644096d20 0x7f16440883a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.056 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd179e9b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd17406a650 0x7fd1741bc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.057 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f164259c640 1 -- 10.20.193.68:0/3975805884 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1644096d20 msgr2=0x7f16440883a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.057 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f164259c640 1 --2- 10.20.193.68:0/3975805884 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1644096d20 0x7f16440883a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.057 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f164259c640 1 -- 10.20.193.68:0/3975805884 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f164412c490 msgr2=0x7f16440888e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.057 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f164259c640 1 --2- 10.20.193.68:0/3975805884 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f164412c490 0x7f16440888e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.057 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f164259c640 1 -- 10.20.193.68:0/3975805884 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1638009390 con 0x7f164408f8a0 2026-02-18T21:01:32.058 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd179e9b640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd174127fa0 0x7fd1741bc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.058 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd179e9b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd1741288b0 0x7fd1741bcca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.058 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd179e9b640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd174093ed0 con 0x7fd174127fa0 2026-02-18T21:01:32.058 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd179e9b640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd174126120 con 0x7fd1741288b0 2026-02-18T21:01:32.058 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd179e9b640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1741267d0 con 0x7fd17406a650 2026-02-18T21:01:32.058 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd16bfff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd174127fa0 0x7fd1741bc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.058 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd16bfff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd174127fa0 0x7fd1741bc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:39530/0 (socket says 10.20.193.68:39530) 2026-02-18T21:01:32.059 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd16bfff640 1 -- 10.20.193.68:0/3590603440 learned_addr learned my addr 10.20.193.68:0/3590603440 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:32.059 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd1737fe640 1 --2- 10.20.193.68:0/3590603440 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd17406a650 0x7fd1741bc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.059 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd173fff640 1 --2- 10.20.193.68:0/3590603440 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd1741288b0 0x7fd1741bcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.059 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f164259c640 1 --2- 10.20.193.68:0/3975805884 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f164408f8a0 0x7f164412ba80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1634009880 tx=0x7f1634037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:32.059 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd16bfff640 1 -- 10.20.193.68:0/3590603440 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd17406a650 msgr2=0x7fd1741bc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.059 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd16bfff640 1 --2- 10.20.193.68:0/3590603440 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd17406a650 0x7fd1741bc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.060 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f1632ffd640 1 -- 10.20.193.68:0/3975805884 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1634042650 con 0x7f164408f8a0 2026-02-18T21:01:32.060 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd16bfff640 1 -- 10.20.193.68:0/3590603440 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd1741288b0 msgr2=0x7fd1741bcca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.060 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd16bfff640 1 --2- 10.20.193.68:0/3590603440 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd1741288b0 0x7fd1741bcca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.060 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd16bfff640 1 -- 10.20.193.68:0/3590603440 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c009450 con 0x7fd174127fa0 2026-02-18T21:01:32.061 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f1632ffd640 1 -- 10.20.193.68:0/3975805884 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16340427d0 con 0x7f164408f8a0 2026-02-18T21:01:32.061 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f1648cc7640 1 -- 10.20.193.68:0/3975805884 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1634009390 con 0x7f164408f8a0 2026-02-18T21:01:32.061 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f1632ffd640 1 -- 10.20.193.68:0/3975805884 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1634042b90 con 0x7f164408f8a0 2026-02-18T21:01:32.061 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7f1648cc7640 1 -- 10.20.193.68:0/3975805884 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164408b5f0 con 0x7f164408f8a0 2026-02-18T21:01:32.062 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd16bfff640 1 --2- 10.20.193.68:0/3590603440 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd174127fa0 0x7fd1741bc760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd15c03a040 tx=0x7fd15c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:32.062 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd170ff9640 1 -- 10.20.193.68:0/3590603440 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c042650 con 0x7fd174127fa0 2026-02-18T21:01:32.062 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd170ff9640 1 -- 10.20.193.68:0/3590603440 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15c0427b0 con 0x7fd174127fa0 2026-02-18T21:01:32.062 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd170ff9640 1 -- 10.20.193.68:0/3590603440 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c042b70 con 0x7fd174127fa0 2026-02-18T21:01:32.063 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd179e9b640 1 -- 10.20.193.68:0/3590603440 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd174127970 con 0x7fd174127fa0 2026-02-18T21:01:32.063 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.042+0000 7fd179e9b640 1 -- 10.20.193.68:0/3590603440 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd174125030 con 0x7fd174127fa0 2026-02-18T21:01:32.063 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.043+0000 7f1648cc7640 1 -- 10.20.193.68:0/3975805884 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164405f010 con 0x7f164408f8a0 2026-02-18T21:01:32.063 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.043+0000 7fd179e9b640 1 -- 10.20.193.68:0/3590603440 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd17405f010 con 0x7fd174127fa0 2026-02-18T21:01:32.064 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.043+0000 7f1632ffd640 1 -- 10.20.193.68:0/3975805884 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f163403e040 con 0x7f164408f8a0 2026-02-18T21:01:32.064 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.043+0000 7fd170ff9640 1 -- 10.20.193.68:0/3590603440 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7fd15c03e040 con 0x7fd174127fa0 2026-02-18T21:01:32.064 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.043+0000 7f1632ffd640 1 -- 10.20.193.68:0/3975805884 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f1634088800 con 0x7f164408f8a0 2026-02-18T21:01:32.065 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.043+0000 7fd170ff9640 1 -- 10.20.193.68:0/3590603440 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7fd15c088080 con 0x7fd174127fa0 2026-02-18T21:01:32.065 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.045+0000 7f1632ffd640 1 -- 10.20.193.68:0/3975805884 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f1634067710 con 0x7f164408f8a0 2026-02-18T21:01:32.065 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.045+0000 7fd170ff9640 1 -- 10.20.193.68:0/3590603440 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7fd15c0b1460 con 0x7fd174127fa0 2026-02-18T21:01:32.066 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.064+0000 7f8a51adb640 1 -- 10.20.193.68:0/2901856806 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8a4c069a70 con 0x7f8a4c06c480 2026-02-18T21:01:32.067 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.064+0000 7f8fdffff640 1 -- 10.20.193.68:0/2833888315 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8fe006e180 con 0x7f8fe0096310 2026-02-18T21:01:32.067 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.064+0000 7f8a33fff640 1 -- 10.20.193.68:0/2901856806 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a40047070 con 0x7f8a4c06c480 2026-02-18T21:01:32.067 INFO:teuthology.orchestra.run.trial068.stdout:38654705668 2026-02-18T21:01:32.068 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.064+0000 7f8fd77fe640 1 -- 10.20.193.68:0/2833888315 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8fc8018020 con 0x7f8fe0096310 2026-02-18T21:01:32.068 INFO:teuthology.orchestra.run.trial068.stdout:38654705669 2026-02-18T21:01:32.069 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.065+0000 7f8a51adb640 1 -- 10.20.193.68:0/2901856806 >> v1:10.20.193.68:6816/24610 conn(0x7f8a3804d0d0 legacy=0x7f8a3804f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.069 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.065+0000 7f8a51adb640 1 -- 10.20.193.68:0/2901856806 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8a4c06c480 msgr2=0x7f8a4c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.069 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.065+0000 7f8a51adb640 1 --2- 10.20.193.68:0/2901856806 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8a4c06c480 0x7f8a4c068b80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8a40036000 tx=0x7f8a40037000 comp rx=0 tx=0).stop 2026-02-18T21:01:32.069 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.065+0000 7f8a51adb640 1 -- 10.20.193.68:0/2901856806 shutdown_connections 2026-02-18T21:01:32.069 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.065+0000 7f8a51adb640 1 --2- 10.20.193.68:0/2901856806 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8a4c12d650 0x7f8a4c0690c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.069 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.065+0000 7f8a51adb640 1 --2- 10.20.193.68:0/2901856806 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8a4c06c480 0x7f8a4c068b80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.069 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.065+0000 7f8a51adb640 1 --2- 10.20.193.68:0/2901856806 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8a4c06b9a0 0x7f8a4c068640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.069 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.065+0000 7f8a51adb640 1 -- 10.20.193.68:0/2901856806 >> 10.20.193.68:0/2901856806 conn(0x7f8a4c09b6a0 msgr2=0x7f8a4c12f760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:32.069 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.065+0000 7f8a51adb640 1 -- 10.20.193.68:0/2901856806 shutdown_connections 2026-02-18T21:01:32.069 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.065+0000 7f8a51adb640 1 -- 10.20.193.68:0/2901856806 wait complete. 2026-02-18T21:01:32.070 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.066+0000 7f8fdffff640 1 -- 10.20.193.68:0/2833888315 >> v1:10.20.193.68:6816/24610 conn(0x7f8fc004d0d0 legacy=0x7f8fc004f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.070 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.066+0000 7f8fdffff640 1 -- 10.20.193.68:0/2833888315 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8fe0096310 msgr2=0x7f8fe01bcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.070 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.066+0000 7f8fdffff640 1 --2- 10.20.193.68:0/2833888315 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8fe0096310 0x7f8fe01bcf60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8fc800c580 tx=0x7f8fc8007e90 comp rx=0 tx=0).stop 2026-02-18T21:01:32.070 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.066+0000 7f8fdffff640 1 -- 10.20.193.68:0/2833888315 shutdown_connections 2026-02-18T21:01:32.070 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.066+0000 7f8fdffff640 1 --2- 10.20.193.68:0/2833888315 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8fe012d8a0 0x7f8fe01bd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.071 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.066+0000 7f8fdffff640 1 --2- 10.20.193.68:0/2833888315 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8fe0096310 0x7f8fe01bcf60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.071 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.066+0000 7f8fdffff640 1 --2- 10.20.193.68:0/2833888315 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8fe0095a00 0x7f8fe01bca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.071 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.066+0000 7f8fdffff640 1 -- 10.20.193.68:0/2833888315 >> 10.20.193.68:0/2833888315 conn(0x7f8fe0096af0 msgr2=0x7f8fe0087fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:32.071 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.066+0000 7f8fdffff640 1 -- 10.20.193.68:0/2833888315 shutdown_connections 2026-02-18T21:01:32.071 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.066+0000 7f8fdffff640 1 -- 10.20.193.68:0/2833888315 wait complete. 2026-02-18T21:01:32.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705668 for osd.1 2026-02-18T21:01:32.077 DEBUG:teuthology.parallel:result is None 2026-02-18T21:01:32.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705669 for osd.3 2026-02-18T21:01:32.078 DEBUG:teuthology.parallel:result is None 2026-02-18T21:01:32.109 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.106+0000 7fd179e9b640 1 -- 10.20.193.68:0/3590603440 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd174088580 con 0x7fd174127fa0 2026-02-18T21:01:32.109 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.107+0000 7fd170ff9640 1 -- 10.20.193.68:0/3590603440 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd15c047020 con 0x7fd174127fa0 2026-02-18T21:01:32.110 INFO:teuthology.orchestra.run.trial068.stdout:38654705668 2026-02-18T21:01:32.111 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.107+0000 7fd179e9b640 1 -- 10.20.193.68:0/3590603440 >> v1:10.20.193.68:6816/24610 conn(0x7fd15404d0d0 legacy=0x7fd15404f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.111 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.107+0000 7fd179e9b640 1 -- 10.20.193.68:0/3590603440 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd174127fa0 msgr2=0x7fd1741bc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.111 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.107+0000 7fd179e9b640 1 --2- 10.20.193.68:0/3590603440 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd174127fa0 0x7fd1741bc760 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd15c03a040 tx=0x7fd15c037000 comp rx=0 tx=0).stop 2026-02-18T21:01:32.111 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.108+0000 7fd179e9b640 1 -- 10.20.193.68:0/3590603440 shutdown_connections 2026-02-18T21:01:32.111 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.108+0000 7fd179e9b640 1 --2- 10.20.193.68:0/3590603440 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd1741288b0 0x7fd1741bcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.111 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.108+0000 7fd179e9b640 1 --2- 10.20.193.68:0/3590603440 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd174127fa0 0x7fd1741bc760 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.111 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.108+0000 7fd179e9b640 1 --2- 10.20.193.68:0/3590603440 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd17406a650 0x7fd1741bc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.111 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.108+0000 7fd179e9b640 1 -- 10.20.193.68:0/3590603440 >> 10.20.193.68:0/3590603440 conn(0x7fd174096650 msgr2=0x7fd1741afd70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:32.111 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.108+0000 7fd179e9b640 1 -- 10.20.193.68:0/3590603440 shutdown_connections 2026-02-18T21:01:32.111 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.108+0000 7fd179e9b640 1 -- 10.20.193.68:0/3590603440 wait complete. 2026-02-18T21:01:32.112 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.109+0000 7f1648cc7640 1 -- 10.20.193.68:0/3975805884 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f164408ae40 con 0x7f164408f8a0 2026-02-18T21:01:32.112 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.109+0000 7f1632ffd640 1 -- 10.20.193.68:0/3975805884 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1634047020 con 0x7f164408f8a0 2026-02-18T21:01:32.112 INFO:teuthology.orchestra.run.trial068.stdout:38654705669 2026-02-18T21:01:32.113 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.110+0000 7f1648cc7640 1 -- 10.20.193.68:0/3975805884 >> v1:10.20.193.68:6816/24610 conn(0x7f162404d0d0 legacy=0x7f162404f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.114 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.110+0000 7f1648cc7640 1 -- 10.20.193.68:0/3975805884 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f164408f8a0 msgr2=0x7f164412ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.114 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.110+0000 7f1648cc7640 1 --2- 10.20.193.68:0/3975805884 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f164408f8a0 0x7f164412ba80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1634009880 tx=0x7f1634037000 comp rx=0 tx=0).stop 2026-02-18T21:01:32.114 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.110+0000 7f1648cc7640 1 -- 10.20.193.68:0/3975805884 shutdown_connections 2026-02-18T21:01:32.114 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.110+0000 7f1648cc7640 1 --2- 10.20.193.68:0/3975805884 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f164412c490 0x7f16440888e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.114 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.110+0000 7f1648cc7640 1 --2- 10.20.193.68:0/3975805884 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1644096d20 0x7f16440883a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.114 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.110+0000 7f1648cc7640 1 --2- 10.20.193.68:0/3975805884 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f164408f8a0 0x7f164412ba80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.114 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.110+0000 7f1648cc7640 1 -- 10.20.193.68:0/3975805884 >> 10.20.193.68:0/3975805884 conn(0x7f1644097e10 msgr2=0x7f164412e870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:32.114 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.110+0000 7f1648cc7640 1 -- 10.20.193.68:0/3975805884 shutdown_connections 2026-02-18T21:01:32.114 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.110+0000 7f1648cc7640 1 -- 10.20.193.68:0/3975805884 wait complete. 2026-02-18T21:01:32.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705668 for osd.0 2026-02-18T21:01:32.118 DEBUG:teuthology.parallel:result is None 2026-02-18T21:01:32.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705669 for osd.2 2026-02-18T21:01:32.121 DEBUG:teuthology.parallel:result is None 2026-02-18T21:01:32.121 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-18T21:01:32.121 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-18T21:01:32.230 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.223+0000 7f35f4cdb640 1 Processor -- start 2026-02-18T21:01:32.230 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.223+0000 7f35f4cdb640 1 -- start start 2026-02-18T21:01:32.231 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.224+0000 7f35f4cdb640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f35f0092760 0x7f35f0092b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.231 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.224+0000 7f35f4cdb640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f35f0093440 0x7f35f012fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.231 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.224+0000 7f35f4cdb640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f0094c20 con 0x7f35f0093070 2026-02-18T21:01:32.231 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.224+0000 7f35f4cdb640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f006b380 con 0x7f35f0093440 2026-02-18T21:01:32.231 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.224+0000 7f35f4cdb640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35f0064490 con 0x7f35f0092760 2026-02-18T21:01:32.231 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.224+0000 7f35ee59c640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f35f0092760 0x7f35f0092b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.231 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.224+0000 7f35ee59c640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f35f0092760 0x7f35f0092b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:55582/0 (socket says 10.20.193.68:55582) 2026-02-18T21:01:32.231 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.224+0000 7f35ee59c640 1 -- 10.20.193.68:0/838587979 learned_addr learned my addr 10.20.193.68:0/838587979 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:32.231 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.224+0000 7f35eed9d640 1 --2- 10.20.193.68:0/838587979 >> v2:10.20.193.68:3300/0 conn(0x7f35f0093440 0x7f35f012fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.232 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.224+0000 7f35edd9b640 1 -- 10.20.193.68:0/838587979 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601411599 0 0) 0x7f35f0094c20 con 0x7f35f0093070 2026-02-18T21:01:32.232 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.224+0000 7f35edd9b640 1 -- 10.20.193.68:0/838587979 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35dc0034e0 con 0x7f35f0093070 2026-02-18T21:01:32.232 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.224+0000 7f35ee59c640 1 -- 10.20.193.68:0/838587979 >> v2:10.20.193.68:3300/0 conn(0x7f35f0093440 msgr2=0x7f35f012fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:32.232 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.224+0000 7f35ee59c640 1 --2- 10.20.193.68:0/838587979 >> v2:10.20.193.68:3300/0 conn(0x7f35f0093440 0x7f35f012fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.232 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.224+0000 7f35ee59c640 1 -- 10.20.193.68:0/838587979 >> v1:10.20.193.68:6789/0 conn(0x7f35f0093070 legacy=0x7f35f012c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.232 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.224+0000 7f35ee59c640 1 -- 10.20.193.68:0/838587979 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f00956f0 con 0x7f35f0092760 2026-02-18T21:01:32.232 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.224+0000 7f35ee59c640 1 --2- 10.20.193.68:0/838587979 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f35f0092760 0x7f35f0092b30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009940 tx=0x7f35e002eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8050fc7e88a31b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:32.232 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.225+0000 7f35edd9b640 1 -- 10.20.193.68:0/838587979 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e002f9f0 con 0x7f35f0092760 2026-02-18T21:01:32.232 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.225+0000 7f35edd9b640 1 -- 10.20.193.68:0/838587979 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e002fb50 con 0x7f35f0092760 2026-02-18T21:01:32.232 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.225+0000 7f35edd9b640 1 -- 10.20.193.68:0/838587979 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e0037440 con 0x7f35f0092760 2026-02-18T21:01:32.232 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.225+0000 7f35f4cdb640 1 -- 10.20.193.68:0/838587979 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f35f0092760 msgr2=0x7f35f0092b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.232 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.225+0000 7f35f4cdb640 1 --2- 10.20.193.68:0/838587979 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f35f0092760 0x7f35f0092b30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009940 tx=0x7f35e002eed0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.233 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.225+0000 7f35f4cdb640 1 -- 10.20.193.68:0/838587979 shutdown_connections 2026-02-18T21:01:32.233 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.225+0000 7f35f4cdb640 1 --2- 10.20.193.68:0/838587979 >> v2:10.20.193.68:3300/0 conn(0x7f35f0093440 0x7f35f012fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.233 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.225+0000 7f35f4cdb640 1 --2- 10.20.193.68:0/838587979 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f35f0092760 0x7f35f0092b30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.233 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.225+0000 7f35f4cdb640 1 -- 10.20.193.68:0/838587979 >> 10.20.193.68:0/838587979 conn(0x7f35f0097d70 msgr2=0x7f35f0098170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:32.233 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.225+0000 7f35f4cdb640 1 -- 10.20.193.68:0/838587979 shutdown_connections 2026-02-18T21:01:32.233 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.225+0000 7f35f4cdb640 1 -- 10.20.193.68:0/838587979 wait complete. 2026-02-18T21:01:32.233 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.225+0000 7f35f4cdb640 1 Processor -- start 2026-02-18T21:01:32.233 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.225+0000 7f35f4cdb640 1 -- start start 2026-02-18T21:01:32.233 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35f4cdb640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f35f0092760 0x7f35f01be460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.233 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35f4cdb640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f35f0093070 0x7f35f01be9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.233 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35f4cdb640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f35f0093440 0x7f35f01beee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.233 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35f4cdb640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f01bbe20 con 0x7f35f0093070 2026-02-18T21:01:32.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35f4cdb640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f006f7d0 con 0x7f35f0092760 2026-02-18T21:01:32.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35f4cdb640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35f006ee40 con 0x7f35f0093440 2026-02-18T21:01:32.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35e7fff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f35f0093070 0x7f35f01be9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35ee59c640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f35f0092760 0x7f35f01be460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35e7fff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f35f0093070 0x7f35f01be9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:39556/0 (socket says 10.20.193.68:39556) 2026-02-18T21:01:32.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35e7fff640 1 -- 10.20.193.68:0/2652245368 learned_addr learned my addr 10.20.193.68:0/2652245368 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:32.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35eed9d640 1 --2- 10.20.193.68:0/2652245368 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f35f0093440 0x7f35f01beee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35e7fff640 1 -- 10.20.193.68:0/2652245368 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f35f0093440 msgr2=0x7f35f01beee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35e7fff640 1 --2- 10.20.193.68:0/2652245368 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f35f0093440 0x7f35f01beee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35e7fff640 1 -- 10.20.193.68:0/2652245368 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f35f0092760 msgr2=0x7f35f01be460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35e7fff640 1 --2- 10.20.193.68:0/2652245368 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f35f0092760 0x7f35f01be460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35e7fff640 1 -- 10.20.193.68:0/2652245368 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e0009450 con 0x7f35f0093070 2026-02-18T21:01:32.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35ee59c640 1 --2- 10.20.193.68:0/2652245368 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f35f0092760 0x7f35f01be460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:32.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35eed9d640 1 --2- 10.20.193.68:0/2652245368 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f35f0093440 0x7f35f01beee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:32.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35e7fff640 1 --2- 10.20.193.68:0/2652245368 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f35f0093070 0x7f35f01be9a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f35d800c580 tx=0x7f35d8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:32.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35e6ffd640 1 -- 10.20.193.68:0/2652245368 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d8012630 con 0x7f35f0093070 2026-02-18T21:01:32.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35e6ffd640 1 -- 10.20.193.68:0/2652245368 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d8012790 con 0x7f35f0093070 2026-02-18T21:01:32.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35f4cdb640 1 -- 10.20.193.68:0/2652245368 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f01a7680 con 0x7f35f0093070 2026-02-18T21:01:32.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35e6ffd640 1 -- 10.20.193.68:0/2652245368 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d8012b50 con 0x7f35f0093070 2026-02-18T21:01:32.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.226+0000 7f35f4cdb640 1 -- 10.20.193.68:0/2652245368 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f01a5060 con 0x7f35f0093070 2026-02-18T21:01:32.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.227+0000 7f35f4cdb640 1 -- 10.20.193.68:0/2652245368 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f005f010 con 0x7f35f0093070 2026-02-18T21:01:32.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.227+0000 7f35e6ffd640 1 -- 10.20.193.68:0/2652245368 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f35d801b400 con 0x7f35f0093070 2026-02-18T21:01:32.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.227+0000 7f35e6ffd640 1 -- 10.20.193.68:0/2652245368 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f35d8063800 con 0x7f35f0093070 2026-02-18T21:01:32.236 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.229+0000 7f35e6ffd640 1 -- 10.20.193.68:0/2652245368 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f35d803e630 con 0x7f35f0093070 2026-02-18T21:01:32.291 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.288+0000 7f35f4cdb640 1 -- 10.20.193.68:0/2652245368 --> v1:10.20.193.68:6816/24610 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35f0096590 con 0x7f35d004d100 2026-02-18T21:01:32.292 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.289+0000 7f35e6ffd640 1 -- 10.20.193.68:0/2652245368 <== mgr.4137 v1:10.20.193.68:6816/24610 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34940 (unknown 2965378022 0 799721845) 0x7f35f0096590 con 0x7f35d004d100 2026-02-18T21:01:32.292 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:01:32.294 INFO:teuthology.orchestra.run.trial068.stderr:dumped all 2026-02-18T21:01:32.294 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.290+0000 7f35f4cdb640 1 -- 10.20.193.68:0/2652245368 >> v1:10.20.193.68:6816/24610 conn(0x7f35d004d100 legacy=0x7f35d004f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.294 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.290+0000 7f35f4cdb640 1 -- 10.20.193.68:0/2652245368 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f35f0093070 msgr2=0x7f35f01be9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.294 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.290+0000 7f35f4cdb640 1 --2- 10.20.193.68:0/2652245368 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f35f0093070 0x7f35f01be9a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f35d800c580 tx=0x7f35d8007d30 comp rx=0 tx=0).stop 2026-02-18T21:01:32.294 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.290+0000 7f35f4cdb640 1 -- 10.20.193.68:0/2652245368 shutdown_connections 2026-02-18T21:01:32.294 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.290+0000 7f35f4cdb640 1 --2- 10.20.193.68:0/2652245368 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f35f0093440 0x7f35f01beee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.294 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.290+0000 7f35f4cdb640 1 --2- 10.20.193.68:0/2652245368 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f35f0093070 0x7f35f01be9a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.294 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.290+0000 7f35f4cdb640 1 --2- 10.20.193.68:0/2652245368 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f35f0092760 0x7f35f01be460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.294 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.290+0000 7f35f4cdb640 1 -- 10.20.193.68:0/2652245368 >> 10.20.193.68:0/2652245368 conn(0x7f35f0097d70 msgr2=0x7f35f0090950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:32.294 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.290+0000 7f35f4cdb640 1 -- 10.20.193.68:0/2652245368 shutdown_connections 2026-02-18T21:01:32.295 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.290+0000 7f35f4cdb640 1 -- 10.20.193.68:0/2652245368 wait complete. 2026-02-18T21:01:32.299 INFO:teuthology.orchestra.run.trial068.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-18T21:01:30.887223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1207772,"kb_used_data":1704,"kb_used_omap":6,"kb_used_meta":1206009,"kb_avail":376279588,"statfs":{"total":386547056640,"available":385310298112,"internally_reserved":0,"allocated":1744896,"data_stored":1331543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6812,"internal_metadata":1234953572},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.914853"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-18T21:01:28.980728+0000","last_change":"2026-02-18T21:01:28.980829+0000","last_active":"2026-02-18T21:01:28.980728+0000","last_peered":"2026-02-18T21:01:28.980728+0000","last_clean":"2026-02-18T21:01:28.980728+0000","last_became_active":"2026-02-18T21:01:26.977322+0000","last_became_peered":"2026-02-18T21:01:26.977322+0000","last_unstale":"2026-02-18T21:01:28.980728+0000","last_undegraded":"2026-02-18T21:01:28.980728+0000","last_fullsized":"2026-02-18T21:01:28.980728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T21:26:32.514855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000486527,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-18T21:01:28.979395+0000","last_change":"2026-02-18T21:01:28.979532+0000","last_active":"2026-02-18T21:01:28.979395+0000","last_peered":"2026-02-18T21:01:28.979395+0000","last_clean":"2026-02-18T21:01:28.979395+0000","last_became_active":"2026-02-18T21:01:26.977639+0000","last_became_peered":"2026-02-18T21:01:26.977639+0000","last_unstale":"2026-02-18T21:01:28.979395+0000","last_undegraded":"2026-02-18T21:01:28.979395+0000","last_fullsized":"2026-02-18T21:01:28.979395+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T02:00:29.756605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018692399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-18T21:01:28.980649+0000","last_change":"2026-02-18T21:01:28.980780+0000","last_active":"2026-02-18T21:01:28.980649+0000","last_peered":"2026-02-18T21:01:28.980649+0000","last_clean":"2026-02-18T21:01:28.980649+0000","last_became_active":"2026-02-18T21:01:26.977061+0000","last_became_peered":"2026-02-18T21:01:26.977061+0000","last_unstale":"2026-02-18T21:01:28.980649+0000","last_undegraded":"2026-02-18T21:01:28.980649+0000","last_fullsized":"2026-02-18T21:01:28.980649+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T02:02:29.480539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044243599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-18T21:01:28.979411+0000","last_change":"2026-02-18T21:01:28.979551+0000","last_active":"2026-02-18T21:01:28.979411+0000","last_peered":"2026-02-18T21:01:28.979411+0000","last_clean":"2026-02-18T21:01:28.979411+0000","last_became_active":"2026-02-18T21:01:26.977643+0000","last_became_peered":"2026-02-18T21:01:26.977643+0000","last_unstale":"2026-02-18T21:01:28.979411+0000","last_undegraded":"2026-02-18T21:01:28.979411+0000","last_fullsized":"2026-02-18T21:01:28.979411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T23:54:23.501222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020214300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"16'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-18T21:01:28.980699+0000","last_change":"2026-02-18T21:01:28.980699+0000","last_active":"2026-02-18T21:01:28.980699+0000","last_peered":"2026-02-18T21:01:28.980699+0000","last_clean":"2026-02-18T21:01:28.980699+0000","last_became_active":"2026-02-18T21:01:26.977359+0000","last_became_peered":"2026-02-18T21:01:26.977359+0000","last_unstale":"2026-02-18T21:01:28.980699+0000","last_undegraded":"2026-02-18T21:01:28.980699+0000","last_fullsized":"2026-02-18T21:01:28.980699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T01:30:13.508600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036890000000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-18T21:01:28.979257+0000","last_change":"2026-02-18T21:01:28.979387+0000","last_active":"2026-02-18T21:01:28.979257+0000","last_peered":"2026-02-18T21:01:28.979257+0000","last_clean":"2026-02-18T21:01:28.979257+0000","last_became_active":"2026-02-18T21:01:26.976598+0000","last_became_peered":"2026-02-18T21:01:26.976598+0000","last_unstale":"2026-02-18T21:01:28.979257+0000","last_undegraded":"2026-02-18T21:01:28.979257+0000","last_fullsized":"2026-02-18T21:01:28.979257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T02:00:29.756605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021428500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-18T21:01:28.980397+0000","last_change":"2026-02-18T21:01:28.980480+0000","last_active":"2026-02-18T21:01:28.980397+0000","last_peered":"2026-02-18T21:01:28.980397+0000","last_clean":"2026-02-18T21:01:28.980397+0000","last_became_active":"2026-02-18T21:01:26.977362+0000","last_became_peered":"2026-02-18T21:01:26.977362+0000","last_unstale":"2026-02-18T21:01:28.980397+0000","last_undegraded":"2026-02-18T21:01:28.980397+0000","last_fullsized":"2026-02-18T21:01:28.980397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T03:05:33.777234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017934099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"14'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-18T21:01:28.980412+0000","last_change":"2026-02-18T21:01:28.980495+0000","last_active":"2026-02-18T21:01:28.980412+0000","last_peered":"2026-02-18T21:01:28.980412+0000","last_clean":"2026-02-18T21:01:28.980412+0000","last_became_active":"2026-02-18T21:01:26.977066+0000","last_became_peered":"2026-02-18T21:01:26.977066+0000","last_unstale":"2026-02-18T21:01:28.980412+0000","last_undegraded":"2026-02-18T21:01:28.980412+0000","last_fullsized":"2026-02-18T21:01:28.980412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T03:08:40.742665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000176987,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"11'72","reported_seq":103,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-18T21:01:27.977374+0000","last_change":"2026-02-18T21:01:21.968408+0000","last_active":"2026-02-18T21:01:27.977374+0000","last_peered":"2026-02-18T21:01:27.977374+0000","last_clean":"2026-02-18T21:01:27.977374+0000","last_became_active":"2026-02-18T21:01:21.967863+0000","last_became_peered":"2026-02-18T21:01:21.967863+0000","last_unstale":"2026-02-18T21:01:27.977374+0000","last_undegraded":"2026-02-18T21:01:27.977374+0000","last_fullsized":"2026-02-18T21:01:27.977374+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:20.963920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:20.963920+0000","last_clean_scrub_stamp":"2026-02-18T21:01:20.963920+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T05:29:54.216192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301648,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070192,"statfs":{"total":96636764160,"available":96327876608,"internally_reserved":0,"allocated":135168,"data_stored":35138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301656,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070184,"statfs":{"total":96636764160,"available":96327868416,"internally_reserved":0,"allocated":139264,"data_stored":38550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.13300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.159}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17799999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302236,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069604,"statfs":{"total":96636764160,"available":96327274496,"internally_reserved":0,"allocated":737280,"data_stored":628937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302232,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069608,"statfs":{"total":96636764160,"available":96327278592,"internally_reserved":0,"allocated":733184,"data_stored":628918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.126}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-18T21:01:32.301 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-18T21:01:32.371 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.364+0000 7f68e69dd640 1 Processor -- start 2026-02-18T21:01:32.371 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.364+0000 7f68e69dd640 1 -- start start 2026-02-18T21:01:32.372 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.365+0000 7f68e69dd640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f68e0097530 0x7f68e012f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.372 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.365+0000 7f68e69dd640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f68e012f9a0 0x7f68e0131d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.372 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.365+0000 7f68e69dd640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e0098380 con 0x7f68e0096a50 2026-02-18T21:01:32.372 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.365+0000 7f68e69dd640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e0099300 con 0x7f68e0097530 2026-02-18T21:01:32.372 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.365+0000 7f68e69dd640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e0069000 con 0x7f68e012f9a0 2026-02-18T21:01:32.372 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.365+0000 7f68df7fe640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f68e0097530 0x7f68e012f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.372 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.365+0000 7f68df7fe640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f68e0097530 0x7f68e012f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:39566/0 (socket says 10.20.193.68:39566) 2026-02-18T21:01:32.372 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.365+0000 7f68df7fe640 1 -- 10.20.193.68:0/3542174093 learned_addr learned my addr 10.20.193.68:0/3542174093 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:32.372 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.365+0000 7f68dffff640 1 --1- 10.20.193.68:0/3542174093 >> v1:10.20.193.68:6789/0 conn(0x7f68e0096a50 0x7f68e0096e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:59058/0 (socket says 10.20.193.68:59058) 2026-02-18T21:01:32.372 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.365+0000 7f68e4f7a640 1 --2- 10.20.193.68:0/3542174093 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f68e012f9a0 0x7f68e0131d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.373 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.365+0000 7f68df7fe640 1 -- 10.20.193.68:0/3542174093 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f68e012f9a0 msgr2=0x7f68e0131d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:32.373 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.365+0000 7f68df7fe640 1 --2- 10.20.193.68:0/3542174093 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f68e012f9a0 0x7f68e0131d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.373 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.365+0000 7f68df7fe640 1 -- 10.20.193.68:0/3542174093 >> v1:10.20.193.68:6789/0 conn(0x7f68e0096a50 legacy=0x7f68e0096e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.373 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.365+0000 7f68df7fe640 1 -- 10.20.193.68:0/3542174093 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e0098f30 con 0x7f68e0097530 2026-02-18T21:01:32.373 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.365+0000 7f68df7fe640 1 --2- 10.20.193.68:0/3542174093 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f68e0097530 0x7f68e012f460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f68d4009940 tx=0x7f68d402ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef7d5df46159286 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:32.373 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.365+0000 7f68deffd640 1 -- 10.20.193.68:0/3542174093 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d402fa90 con 0x7f68e0097530 2026-02-18T21:01:32.373 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.365+0000 7f68deffd640 1 -- 10.20.193.68:0/3542174093 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d402fbf0 con 0x7f68e0097530 2026-02-18T21:01:32.373 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.365+0000 7f68deffd640 1 -- 10.20.193.68:0/3542174093 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d4037440 con 0x7f68e0097530 2026-02-18T21:01:32.373 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.366+0000 7f68e69dd640 1 -- 10.20.193.68:0/3542174093 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f68e0097530 msgr2=0x7f68e012f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.373 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.366+0000 7f68e69dd640 1 --2- 10.20.193.68:0/3542174093 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f68e0097530 0x7f68e012f460 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f68d4009940 tx=0x7f68d402ef70 comp rx=0 tx=0).stop 2026-02-18T21:01:32.373 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.366+0000 7f68e69dd640 1 -- 10.20.193.68:0/3542174093 shutdown_connections 2026-02-18T21:01:32.373 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.366+0000 7f68e69dd640 1 --2- 10.20.193.68:0/3542174093 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f68e012f9a0 0x7f68e0131d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.366+0000 7f68e69dd640 1 --2- 10.20.193.68:0/3542174093 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f68e0097530 0x7f68e012f460 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.366+0000 7f68e69dd640 1 -- 10.20.193.68:0/3542174093 >> 10.20.193.68:0/3542174093 conn(0x7f68e009da20 msgr2=0x7f68e009de20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:32.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.366+0000 7f68e69dd640 1 -- 10.20.193.68:0/3542174093 shutdown_connections 2026-02-18T21:01:32.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.366+0000 7f68e69dd640 1 -- 10.20.193.68:0/3542174093 wait complete. 2026-02-18T21:01:32.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.366+0000 7f68e69dd640 1 Processor -- start 2026-02-18T21:01:32.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.366+0000 7f68e69dd640 1 -- start start 2026-02-18T21:01:32.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.366+0000 7f68e69dd640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f68e0096a50 0x7f68e011c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.366+0000 7f68e69dd640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f68e0097530 0x7f68e011c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.366+0000 7f68e69dd640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f68e012f9a0 0x7f68e011cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.366+0000 7f68e69dd640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e011fbe0 con 0x7f68e012f9a0 2026-02-18T21:01:32.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.366+0000 7f68e69dd640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e011f810 con 0x7f68e0096a50 2026-02-18T21:01:32.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.366+0000 7f68e69dd640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68e012cb00 con 0x7f68e0097530 2026-02-18T21:01:32.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.367+0000 7f68dffff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f68e0096a50 0x7f68e011c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.367+0000 7f68e4f7a640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f68e012f9a0 0x7f68e011cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.367+0000 7f68dffff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f68e0096a50 0x7f68e011c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:45426/0 (socket says 10.20.193.68:45426) 2026-02-18T21:01:32.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.367+0000 7f68df7fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f68e0097530 0x7f68e011c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.367+0000 7f68dffff640 1 -- 10.20.193.68:0/3506612744 learned_addr learned my addr 10.20.193.68:0/3506612744 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:32.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.367+0000 7f68e4f7a640 1 -- 10.20.193.68:0/3506612744 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f68e0097530 msgr2=0x7f68e011c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.367+0000 7f68e4f7a640 1 --2- 10.20.193.68:0/3506612744 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f68e0097530 0x7f68e011c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.367+0000 7f68e4f7a640 1 -- 10.20.193.68:0/3506612744 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f68e0096a50 msgr2=0x7f68e011c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.367+0000 7f68e4f7a640 1 --2- 10.20.193.68:0/3506612744 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f68e0096a50 0x7f68e011c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.367+0000 7f68e4f7a640 1 -- 10.20.193.68:0/3506612744 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d4009450 con 0x7f68e012f9a0 2026-02-18T21:01:32.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.367+0000 7f68dffff640 1 --2- 10.20.193.68:0/3506612744 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f68e0096a50 0x7f68e011c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:32.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.367+0000 7f68e4f7a640 1 --2- 10.20.193.68:0/3506612744 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f68e012f9a0 0x7f68e011cf10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f68d8009e50 tx=0x7f68d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:32.376 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.367+0000 7f68dcff9640 1 -- 10.20.193.68:0/3506612744 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d800ce20 con 0x7f68e012f9a0 2026-02-18T21:01:32.376 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.367+0000 7f68dcff9640 1 -- 10.20.193.68:0/3506612744 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d800f040 con 0x7f68e012f9a0 2026-02-18T21:01:32.376 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.367+0000 7f68e69dd640 1 -- 10.20.193.68:0/3506612744 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e011d450 con 0x7f68e012f9a0 2026-02-18T21:01:32.376 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.367+0000 7f68dcff9640 1 -- 10.20.193.68:0/3506612744 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d80146d0 con 0x7f68e012f9a0 2026-02-18T21:01:32.376 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.367+0000 7f68e69dd640 1 -- 10.20.193.68:0/3506612744 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e011f030 con 0x7f68e012f9a0 2026-02-18T21:01:32.376 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.367+0000 7f68e69dd640 1 -- 10.20.193.68:0/3506612744 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e011dee0 con 0x7f68e012f9a0 2026-02-18T21:01:32.376 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.368+0000 7f68dcff9640 1 -- 10.20.193.68:0/3506612744 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f68d8014a40 con 0x7f68e012f9a0 2026-02-18T21:01:32.376 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.368+0000 7f68dcff9640 1 -- 10.20.193.68:0/3506612744 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7f68d80647b0 con 0x7f68e012f9a0 2026-02-18T21:01:32.377 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.369+0000 7f68dcff9640 1 -- 10.20.193.68:0/3506612744 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f68d803f640 con 0x7f68e012f9a0 2026-02-18T21:01:32.432 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.429+0000 7f68e69dd640 1 -- 10.20.193.68:0/3506612744 --> v1:10.20.193.68:6816/24610 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68e005f010 con 0x7f68cc04d0d0 2026-02-18T21:01:32.433 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.430+0000 7f68dcff9640 1 -- 10.20.193.68:0/3506612744 <== mgr.4137 v1:10.20.193.68:6816/24610 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34940 (unknown 2965378022 0 799721845) 0x7f68e005f010 con 0x7f68cc04d0d0 2026-02-18T21:01:32.433 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:01:32.434 INFO:teuthology.orchestra.run.trial068.stderr:dumped all 2026-02-18T21:01:32.434 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.430+0000 7f68e69dd640 1 -- 10.20.193.68:0/3506612744 >> v1:10.20.193.68:6816/24610 conn(0x7f68cc04d0d0 legacy=0x7f68cc04f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.435 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.430+0000 7f68e69dd640 1 -- 10.20.193.68:0/3506612744 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f68e012f9a0 msgr2=0x7f68e011cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.435 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.430+0000 7f68e69dd640 1 --2- 10.20.193.68:0/3506612744 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f68e012f9a0 0x7f68e011cf10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f68d8009e50 tx=0x7f68d800b040 comp rx=0 tx=0).stop 2026-02-18T21:01:32.435 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.430+0000 7f68e69dd640 1 -- 10.20.193.68:0/3506612744 shutdown_connections 2026-02-18T21:01:32.435 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.430+0000 7f68e69dd640 1 --2- 10.20.193.68:0/3506612744 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f68e012f9a0 0x7f68e011cf10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.435 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.431+0000 7f68e69dd640 1 --2- 10.20.193.68:0/3506612744 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f68e0097530 0x7f68e011c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.435 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.431+0000 7f68e69dd640 1 --2- 10.20.193.68:0/3506612744 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f68e0096a50 0x7f68e011c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.435 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.431+0000 7f68e69dd640 1 -- 10.20.193.68:0/3506612744 >> 10.20.193.68:0/3506612744 conn(0x7f68e009da20 msgr2=0x7f68e012f210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:32.435 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.431+0000 7f68e69dd640 1 -- 10.20.193.68:0/3506612744 shutdown_connections 2026-02-18T21:01:32.435 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.431+0000 7f68e69dd640 1 -- 10.20.193.68:0/3506612744 wait complete. 2026-02-18T21:01:32.441 INFO:teuthology.orchestra.run.trial068.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-18T21:01:30.887223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1207772,"kb_used_data":1704,"kb_used_omap":6,"kb_used_meta":1206009,"kb_avail":376279588,"statfs":{"total":386547056640,"available":385310298112,"internally_reserved":0,"allocated":1744896,"data_stored":1331543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6812,"internal_metadata":1234953572},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.914853"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-18T21:01:28.980728+0000","last_change":"2026-02-18T21:01:28.980829+0000","last_active":"2026-02-18T21:01:28.980728+0000","last_peered":"2026-02-18T21:01:28.980728+0000","last_clean":"2026-02-18T21:01:28.980728+0000","last_became_active":"2026-02-18T21:01:26.977322+0000","last_became_peered":"2026-02-18T21:01:26.977322+0000","last_unstale":"2026-02-18T21:01:28.980728+0000","last_undegraded":"2026-02-18T21:01:28.980728+0000","last_fullsized":"2026-02-18T21:01:28.980728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T21:26:32.514855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000486527,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-18T21:01:28.979395+0000","last_change":"2026-02-18T21:01:28.979532+0000","last_active":"2026-02-18T21:01:28.979395+0000","last_peered":"2026-02-18T21:01:28.979395+0000","last_clean":"2026-02-18T21:01:28.979395+0000","last_became_active":"2026-02-18T21:01:26.977639+0000","last_became_peered":"2026-02-18T21:01:26.977639+0000","last_unstale":"2026-02-18T21:01:28.979395+0000","last_undegraded":"2026-02-18T21:01:28.979395+0000","last_fullsized":"2026-02-18T21:01:28.979395+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T02:00:29.756605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018692399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-18T21:01:28.980649+0000","last_change":"2026-02-18T21:01:28.980780+0000","last_active":"2026-02-18T21:01:28.980649+0000","last_peered":"2026-02-18T21:01:28.980649+0000","last_clean":"2026-02-18T21:01:28.980649+0000","last_became_active":"2026-02-18T21:01:26.977061+0000","last_became_peered":"2026-02-18T21:01:26.977061+0000","last_unstale":"2026-02-18T21:01:28.980649+0000","last_undegraded":"2026-02-18T21:01:28.980649+0000","last_fullsized":"2026-02-18T21:01:28.980649+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T02:02:29.480539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044243599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-18T21:01:28.979411+0000","last_change":"2026-02-18T21:01:28.979551+0000","last_active":"2026-02-18T21:01:28.979411+0000","last_peered":"2026-02-18T21:01:28.979411+0000","last_clean":"2026-02-18T21:01:28.979411+0000","last_became_active":"2026-02-18T21:01:26.977643+0000","last_became_peered":"2026-02-18T21:01:26.977643+0000","last_unstale":"2026-02-18T21:01:28.979411+0000","last_undegraded":"2026-02-18T21:01:28.979411+0000","last_fullsized":"2026-02-18T21:01:28.979411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T23:54:23.501222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020214300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"16'2","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-18T21:01:28.980699+0000","last_change":"2026-02-18T21:01:28.980699+0000","last_active":"2026-02-18T21:01:28.980699+0000","last_peered":"2026-02-18T21:01:28.980699+0000","last_clean":"2026-02-18T21:01:28.980699+0000","last_became_active":"2026-02-18T21:01:26.977359+0000","last_became_peered":"2026-02-18T21:01:26.977359+0000","last_unstale":"2026-02-18T21:01:28.980699+0000","last_undegraded":"2026-02-18T21:01:28.980699+0000","last_fullsized":"2026-02-18T21:01:28.980699+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T01:30:13.508600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036890000000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-18T21:01:28.979257+0000","last_change":"2026-02-18T21:01:28.979387+0000","last_active":"2026-02-18T21:01:28.979257+0000","last_peered":"2026-02-18T21:01:28.979257+0000","last_clean":"2026-02-18T21:01:28.979257+0000","last_became_active":"2026-02-18T21:01:26.976598+0000","last_became_peered":"2026-02-18T21:01:26.976598+0000","last_unstale":"2026-02-18T21:01:28.979257+0000","last_undegraded":"2026-02-18T21:01:28.979257+0000","last_fullsized":"2026-02-18T21:01:28.979257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T02:00:29.756605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021428500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-18T21:01:28.980397+0000","last_change":"2026-02-18T21:01:28.980480+0000","last_active":"2026-02-18T21:01:28.980397+0000","last_peered":"2026-02-18T21:01:28.980397+0000","last_clean":"2026-02-18T21:01:28.980397+0000","last_became_active":"2026-02-18T21:01:26.977362+0000","last_became_peered":"2026-02-18T21:01:26.977362+0000","last_unstale":"2026-02-18T21:01:28.980397+0000","last_undegraded":"2026-02-18T21:01:28.980397+0000","last_fullsized":"2026-02-18T21:01:28.980397+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T03:05:33.777234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017934099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"14'1","reported_seq":15,"reported_epoch":16,"state":"active+clean","last_fresh":"2026-02-18T21:01:28.980412+0000","last_change":"2026-02-18T21:01:28.980495+0000","last_active":"2026-02-18T21:01:28.980412+0000","last_peered":"2026-02-18T21:01:28.980412+0000","last_clean":"2026-02-18T21:01:28.980412+0000","last_became_active":"2026-02-18T21:01:26.977066+0000","last_became_peered":"2026-02-18T21:01:26.977066+0000","last_unstale":"2026-02-18T21:01:28.980412+0000","last_undegraded":"2026-02-18T21:01:28.980412+0000","last_fullsized":"2026-02-18T21:01:28.980412+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T03:08:40.742665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000176987,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"11'72","reported_seq":103,"reported_epoch":15,"state":"active+clean","last_fresh":"2026-02-18T21:01:27.977374+0000","last_change":"2026-02-18T21:01:21.968408+0000","last_active":"2026-02-18T21:01:27.977374+0000","last_peered":"2026-02-18T21:01:27.977374+0000","last_clean":"2026-02-18T21:01:27.977374+0000","last_became_active":"2026-02-18T21:01:21.967863+0000","last_became_peered":"2026-02-18T21:01:21.967863+0000","last_unstale":"2026-02-18T21:01:27.977374+0000","last_undegraded":"2026-02-18T21:01:27.977374+0000","last_fullsized":"2026-02-18T21:01:27.977374+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:20.963920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:20.963920+0000","last_clean_scrub_stamp":"2026-02-18T21:01:20.963920+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T05:29:54.216192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301648,"kb_used_data":132,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070192,"statfs":{"total":96636764160,"available":96327876608,"internally_reserved":0,"allocated":135168,"data_stored":35138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301656,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070184,"statfs":{"total":96636764160,"available":96327868416,"internally_reserved":0,"allocated":139264,"data_stored":38550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.13300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.159}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17799999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302236,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069604,"statfs":{"total":96636764160,"available":96327274496,"internally_reserved":0,"allocated":737280,"data_stored":628937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302232,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069608,"statfs":{"total":96636764160,"available":96327278592,"internally_reserved":0,"allocated":733184,"data_stored":628918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.126}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-18T21:01:32.442 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-18T21:01:32.442 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-18T21:01:32.442 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-18T21:01:32.442 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-18T21:01:32.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.503+0000 7fa23e5bc640 1 Processor -- start 2026-02-18T21:01:32.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.503+0000 7fa23e5bc640 1 -- start start 2026-02-18T21:01:32.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.503+0000 7fa23e5bc640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa238093900 0x7fa238095c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.511 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.503+0000 7fa23e5bc640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fa238096520 0x7fa23812fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.511 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.503+0000 7fa23e5bc640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23806f8a0 con 0x7fa238096150 2026-02-18T21:01:32.511 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.503+0000 7fa23e5bc640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2380969a0 con 0x7fa238096520 2026-02-18T21:01:32.511 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.503+0000 7fa23e5bc640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa238096ae0 con 0x7fa238093900 2026-02-18T21:01:32.511 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.504+0000 7fa23cb59640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fa238096520 0x7fa23812fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.511 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.504+0000 7fa237fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa238093900 0x7fa238095c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.511 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.504+0000 7fa22ffff640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fa238096150 0x7fa23812c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:59060/0 (socket says 10.20.193.68:59060) 2026-02-18T21:01:32.511 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.504+0000 7fa22ffff640 1 -- 10.20.193.68:0/204506407 learned_addr learned my addr 10.20.193.68:0/204506407 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:01:32.511 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.504+0000 7fa23cb59640 1 --2- 10.20.193.68:0/204506407 >> v2:10.20.193.68:3300/0 conn(0x7fa238096520 0x7fa23812fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:39590/0 (socket says 10.20.193.68:39590) 2026-02-18T21:01:32.511 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.504+0000 7fa23cb59640 1 -- 10.20.193.68:0/204506407 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa238093900 msgr2=0x7fa238095c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:32.512 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.504+0000 7fa23cb59640 1 --2- 10.20.193.68:0/204506407 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa238093900 0x7fa238095c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.512 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.504+0000 7fa23cb59640 1 -- 10.20.193.68:0/204506407 >> v1:10.20.193.68:6789/0 conn(0x7fa238096150 legacy=0x7fa23812c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.512 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.504+0000 7fa2377fe640 1 -- 10.20.193.68:0/204506407 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495377033 0 0) 0x7fa23806f8a0 con 0x7fa238096150 2026-02-18T21:01:32.512 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.504+0000 7fa23cb59640 1 -- 10.20.193.68:0/204506407 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa238067ef0 con 0x7fa238096520 2026-02-18T21:01:32.512 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.504+0000 7fa23cb59640 1 --2- 10.20.193.68:0/204506407 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa238096520 0x7fa23812fac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa230009e60 tx=0x7fa23002f280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9780ce06b4e5c03 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:32.512 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.504+0000 7fa2377fe640 1 -- 10.20.193.68:0/204506407 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23002fda0 con 0x7fa238096520 2026-02-18T21:01:32.512 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.504+0000 7fa2377fe640 1 -- 10.20.193.68:0/204506407 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa230037440 con 0x7fa238096520 2026-02-18T21:01:32.512 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.504+0000 7fa2377fe640 1 -- 10.20.193.68:0/204506407 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2300377e0 con 0x7fa238096520 2026-02-18T21:01:32.512 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.505+0000 7fa23e5bc640 1 -- 10.20.193.68:0/204506407 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa238096520 msgr2=0x7fa23812fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.512 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.505+0000 7fa23e5bc640 1 --2- 10.20.193.68:0/204506407 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa238096520 0x7fa23812fac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa230009e60 tx=0x7fa23002f280 comp rx=0 tx=0).stop 2026-02-18T21:01:32.512 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.505+0000 7fa23e5bc640 1 -- 10.20.193.68:0/204506407 shutdown_connections 2026-02-18T21:01:32.512 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.505+0000 7fa23e5bc640 1 --2- 10.20.193.68:0/204506407 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa238096520 0x7fa23812fac0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.513 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.505+0000 7fa23e5bc640 1 --2- 10.20.193.68:0/204506407 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa238093900 0x7fa238095c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.513 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.505+0000 7fa23e5bc640 1 -- 10.20.193.68:0/204506407 >> 10.20.193.68:0/204506407 conn(0x7fa238096d00 msgr2=0x7fa238097100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:32.513 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.505+0000 7fa23e5bc640 1 -- 10.20.193.68:0/204506407 shutdown_connections 2026-02-18T21:01:32.513 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.505+0000 7fa23e5bc640 1 -- 10.20.193.68:0/204506407 wait complete. 2026-02-18T21:01:32.513 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.505+0000 7fa23e5bc640 1 Processor -- start 2026-02-18T21:01:32.513 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.505+0000 7fa23e5bc640 1 -- start start 2026-02-18T21:01:32.513 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.505+0000 7fa23e5bc640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa238093900 0x7fa2381be090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.513 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.505+0000 7fa23e5bc640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa238096150 0x7fa2381be5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.513 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.505+0000 7fa23e5bc640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa238096520 0x7fa2381beb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.513 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.505+0000 7fa23e5bc640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa238122380 con 0x7fa238096520 2026-02-18T21:01:32.513 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.505+0000 7fa23e5bc640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa238122750 con 0x7fa238093900 2026-02-18T21:01:32.513 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.505+0000 7fa23e5bc640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa238120a50 con 0x7fa238096150 2026-02-18T21:01:32.513 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.505+0000 7fa237fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa238093900 0x7fa2381be090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.514 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.505+0000 7fa23cb59640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa238096520 0x7fa2381beb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.514 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.506+0000 7fa237fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa238093900 0x7fa2381be090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:45444/0 (socket says 10.20.193.68:45444) 2026-02-18T21:01:32.514 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.506+0000 7fa237fff640 1 -- 10.20.193.68:0/1775201292 learned_addr learned my addr 10.20.193.68:0/1775201292 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:32.514 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.506+0000 7fa22ffff640 1 --2- 10.20.193.68:0/1775201292 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa238096150 0x7fa2381be5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.514 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.506+0000 7fa237fff640 1 -- 10.20.193.68:0/1775201292 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa238096150 msgr2=0x7fa2381be5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.514 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.506+0000 7fa237fff640 1 --2- 10.20.193.68:0/1775201292 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa238096150 0x7fa2381be5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.514 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.506+0000 7fa237fff640 1 -- 10.20.193.68:0/1775201292 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa238096520 msgr2=0x7fa2381beb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.514 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.506+0000 7fa237fff640 1 --2- 10.20.193.68:0/1775201292 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa238096520 0x7fa2381beb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.514 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.506+0000 7fa237fff640 1 -- 10.20.193.68:0/1775201292 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa230009a20 con 0x7fa238093900 2026-02-18T21:01:32.514 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.506+0000 7fa23cb59640 1 --2- 10.20.193.68:0/1775201292 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa238096520 0x7fa2381beb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:32.514 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.506+0000 7fa237fff640 1 --2- 10.20.193.68:0/1775201292 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa238093900 0x7fa2381be090 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa22800e900 tx=0x7fa2280090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:32.515 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.506+0000 7fa2357fa640 1 -- 10.20.193.68:0/1775201292 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22800c8e0 con 0x7fa238093900 2026-02-18T21:01:32.515 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.506+0000 7fa2357fa640 1 -- 10.20.193.68:0/1775201292 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22800ca40 con 0x7fa238093900 2026-02-18T21:01:32.515 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.506+0000 7fa2357fa640 1 -- 10.20.193.68:0/1775201292 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22800cdc0 con 0x7fa238093900 2026-02-18T21:01:32.515 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.506+0000 7fa23e5bc640 1 -- 10.20.193.68:0/1775201292 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa238121ba0 con 0x7fa238093900 2026-02-18T21:01:32.515 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.506+0000 7fa23e5bc640 1 -- 10.20.193.68:0/1775201292 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23811f480 con 0x7fa238093900 2026-02-18T21:01:32.515 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.506+0000 7fa23e5bc640 1 -- 10.20.193.68:0/1775201292 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23805f010 con 0x7fa238093900 2026-02-18T21:01:32.515 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.507+0000 7fa2357fa640 1 -- 10.20.193.68:0/1775201292 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7fa228013680 con 0x7fa238093900 2026-02-18T21:01:32.515 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.507+0000 7fa2357fa640 1 -- 10.20.193.68:0/1775201292 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7fa228063aa0 con 0x7fa238093900 2026-02-18T21:01:32.516 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.508+0000 7fa2357fa640 1 -- 10.20.193.68:0/1775201292 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7fa22803e930 con 0x7fa238093900 2026-02-18T21:01:32.581 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.578+0000 7fa23e5bc640 1 -- 10.20.193.68:0/1775201292 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa238121d90 con 0x7fa238093900 2026-02-18T21:01:32.581 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.578+0000 7fa2357fa640 1 -- 10.20.193.68:0/1775201292 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa228042140 con 0x7fa238093900 2026-02-18T21:01:32.581 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:01:32.581 INFO:teuthology.orchestra.run.trial068.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-18T21:01:32.582 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.579+0000 7fa23e5bc640 1 -- 10.20.193.68:0/1775201292 >> v1:10.20.193.68:6816/24610 conn(0x7fa21804d0d0 legacy=0x7fa21804f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.582 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.579+0000 7fa23e5bc640 1 -- 10.20.193.68:0/1775201292 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa238093900 msgr2=0x7fa2381be090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.582 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.579+0000 7fa23e5bc640 1 --2- 10.20.193.68:0/1775201292 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa238093900 0x7fa2381be090 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa22800e900 tx=0x7fa2280090f0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.583 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.579+0000 7fa23e5bc640 1 -- 10.20.193.68:0/1775201292 shutdown_connections 2026-02-18T21:01:32.583 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.579+0000 7fa23e5bc640 1 --2- 10.20.193.68:0/1775201292 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa238096520 0x7fa2381beb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.583 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.579+0000 7fa23e5bc640 1 --2- 10.20.193.68:0/1775201292 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa238096150 0x7fa2381be5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.583 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.579+0000 7fa23e5bc640 1 --2- 10.20.193.68:0/1775201292 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa238093900 0x7fa2381be090 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.583 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.579+0000 7fa23e5bc640 1 -- 10.20.193.68:0/1775201292 >> 10.20.193.68:0/1775201292 conn(0x7fa238096d00 msgr2=0x7fa238098ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:32.583 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.579+0000 7fa23e5bc640 1 -- 10.20.193.68:0/1775201292 shutdown_connections 2026-02-18T21:01:32.583 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.579+0000 7fa23e5bc640 1 -- 10.20.193.68:0/1775201292 wait complete. 2026-02-18T21:01:32.589 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-18T21:01:32.590 INFO:teuthology.run_tasks:Running task exec... 2026-02-18T21:01:32.605 INFO:teuthology.task.exec:Executing custom commands... 2026-02-18T21:01:32.606 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@trial068.front.sepia.ceph.com 2026-02-18T21:01:32.606 DEBUG:teuthology.orchestra.run.trial068:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client quincy' 2026-02-18T21:01:32.672 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.665+0000 7fc95c31b640 1 Processor -- start 2026-02-18T21:01:32.672 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.665+0000 7fc95c31b640 1 -- start start 2026-02-18T21:01:32.673 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.666+0000 7fc95c31b640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fc954068fd0 0x7fc954129e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.673 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.666+0000 7fc95c31b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc95412a7c0 0x7fc954129510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.673 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.666+0000 7fc95c31b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9540982f0 con 0x7fc95412a3c0 2026-02-18T21:01:32.673 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.666+0000 7fc95c31b640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc954097d50 con 0x7fc954068fd0 2026-02-18T21:01:32.673 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.666+0000 7fc95c31b640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc954099200 con 0x7fc95412a7c0 2026-02-18T21:01:32.673 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.666+0000 7fc95a0b7640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fc954068fd0 0x7fc954129e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.673 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.666+0000 7fc95a8b8640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc95412a7c0 0x7fc954129510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.673 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.666+0000 7fc9598b6640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fc95412a3c0 0x7fc954128e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:59066/0 (socket says 10.20.193.68:59066) 2026-02-18T21:01:32.673 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.666+0000 7fc9598b6640 1 -- 10.20.193.68:0/807415825 learned_addr learned my addr 10.20.193.68:0/807415825 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:01:32.673 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.666+0000 7fc95a8b8640 1 -- 10.20.193.68:0/807415825 >> v2:10.20.193.68:3300/0 conn(0x7fc954068fd0 msgr2=0x7fc954129e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:32.674 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.666+0000 7fc95a8b8640 1 --2- 10.20.193.68:0/807415825 >> v2:10.20.193.68:3300/0 conn(0x7fc954068fd0 0x7fc954129e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.674 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.666+0000 7fc95a8b8640 1 -- 10.20.193.68:0/807415825 >> v1:10.20.193.68:6789/0 conn(0x7fc95412a3c0 legacy=0x7fc954128e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.674 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.666+0000 7fc95a8b8640 1 -- 10.20.193.68:0/807415825 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9540994c0 con 0x7fc95412a7c0 2026-02-18T21:01:32.674 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.666+0000 7fc95a8b8640 1 --2- 10.20.193.68:0/807415825 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc95412a7c0 0x7fc954129510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009850 tx=0x7fc94c02ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df48a5bfb7d49f06 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:32.674 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.666+0000 7fc9590b5640 1 -- 10.20.193.68:0/807415825 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c02f8b0 con 0x7fc95412a7c0 2026-02-18T21:01:32.674 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.666+0000 7fc9590b5640 1 -- 10.20.193.68:0/807415825 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c02fa10 con 0x7fc95412a7c0 2026-02-18T21:01:32.674 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.666+0000 7fc9590b5640 1 -- 10.20.193.68:0/807415825 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c02fdf0 con 0x7fc95412a7c0 2026-02-18T21:01:32.674 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.667+0000 7fc95c31b640 1 -- 10.20.193.68:0/807415825 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc95412a7c0 msgr2=0x7fc954129510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.674 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.667+0000 7fc95c31b640 1 --2- 10.20.193.68:0/807415825 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc95412a7c0 0x7fc954129510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009850 tx=0x7fc94c02ed50 comp rx=0 tx=0).stop 2026-02-18T21:01:32.674 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.667+0000 7fc95c31b640 1 -- 10.20.193.68:0/807415825 shutdown_connections 2026-02-18T21:01:32.674 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.667+0000 7fc95c31b640 1 --2- 10.20.193.68:0/807415825 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc95412a7c0 0x7fc954129510 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.674 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.667+0000 7fc95c31b640 1 --2- 10.20.193.68:0/807415825 >> v2:10.20.193.68:3300/0 conn(0x7fc954068fd0 0x7fc954129e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.675 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.667+0000 7fc95c31b640 1 -- 10.20.193.68:0/807415825 >> 10.20.193.68:0/807415825 conn(0x7fc95409dbc0 msgr2=0x7fc95409dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:32.675 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.667+0000 7fc95c31b640 1 -- 10.20.193.68:0/807415825 shutdown_connections 2026-02-18T21:01:32.675 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.667+0000 7fc95c31b640 1 -- 10.20.193.68:0/807415825 wait complete. 2026-02-18T21:01:32.675 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.667+0000 7fc95c31b640 1 Processor -- start 2026-02-18T21:01:32.675 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.667+0000 7fc95c31b640 1 -- start start 2026-02-18T21:01:32.675 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.667+0000 7fc95c31b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc954068fd0 0x7fc95411a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.675 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.667+0000 7fc95c31b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc95412a3c0 0x7fc95411aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.675 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.667+0000 7fc95c31b640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc95412a7c0 0x7fc95411b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:32.675 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.667+0000 7fc95c31b640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95411d1d0 con 0x7fc95412a7c0 2026-02-18T21:01:32.675 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.667+0000 7fc95c31b640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95411b6c0 con 0x7fc95412a3c0 2026-02-18T21:01:32.675 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.667+0000 7fc95c31b640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc95411dd80 con 0x7fc954068fd0 2026-02-18T21:01:32.675 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.668+0000 7fc9598b6640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc95412a3c0 0x7fc95411aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.676 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.668+0000 7fc95a8b8640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc95412a7c0 0x7fc95411b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.676 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.668+0000 7fc95a0b7640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc954068fd0 0x7fc95411a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:32.676 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.668+0000 7fc9598b6640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc95412a3c0 0x7fc95411aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:45460/0 (socket says 10.20.193.68:45460) 2026-02-18T21:01:32.676 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.668+0000 7fc95a8b8640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc95412a7c0 0x7fc95411b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:39638/0 (socket says 10.20.193.68:39638) 2026-02-18T21:01:32.676 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.668+0000 7fc95a8b8640 1 -- 10.20.193.68:0/2278183007 learned_addr learned my addr 10.20.193.68:0/2278183007 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:32.676 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.668+0000 7fc95a8b8640 1 -- 10.20.193.68:0/2278183007 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc954068fd0 msgr2=0x7fc95411a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.676 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.668+0000 7fc95a8b8640 1 --2- 10.20.193.68:0/2278183007 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc954068fd0 0x7fc95411a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.676 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.668+0000 7fc95a8b8640 1 -- 10.20.193.68:0/2278183007 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc95412a3c0 msgr2=0x7fc95411aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.676 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.668+0000 7fc95a8b8640 1 --2- 10.20.193.68:0/2278183007 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc95412a3c0 0x7fc95411aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.676 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.668+0000 7fc95a8b8640 1 -- 10.20.193.68:0/2278183007 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c009390 con 0x7fc95412a7c0 2026-02-18T21:01:32.676 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.668+0000 7fc95a8b8640 1 --2- 10.20.193.68:0/2278183007 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc95412a7c0 0x7fc95411b020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009850 tx=0x7fc94c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:32.677 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.668+0000 7fc94affd640 1 -- 10.20.193.68:0/2278183007 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c042630 con 0x7fc95412a7c0 2026-02-18T21:01:32.677 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.668+0000 7fc94affd640 1 -- 10.20.193.68:0/2278183007 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94c042790 con 0x7fc95412a7c0 2026-02-18T21:01:32.677 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.668+0000 7fc95c31b640 1 -- 10.20.193.68:0/2278183007 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc95411d940 con 0x7fc95412a7c0 2026-02-18T21:01:32.677 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.668+0000 7fc94affd640 1 -- 10.20.193.68:0/2278183007 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94c042b50 con 0x7fc95412a7c0 2026-02-18T21:01:32.677 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.668+0000 7fc95c31b640 1 -- 10.20.193.68:0/2278183007 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9541be830 con 0x7fc95412a7c0 2026-02-18T21:01:32.677 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.668+0000 7fc95c31b640 1 -- 10.20.193.68:0/2278183007 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95405f010 con 0x7fc95412a7c0 2026-02-18T21:01:32.677 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.669+0000 7fc94affd640 1 -- 10.20.193.68:0/2278183007 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7fc94c03e040 con 0x7fc95412a7c0 2026-02-18T21:01:32.677 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.669+0000 7fc94affd640 1 -- 10.20.193.68:0/2278183007 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 2862+0+0 (secure 0 0 0) 0x7fc94c088000 con 0x7fc95412a7c0 2026-02-18T21:01:32.678 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.671+0000 7fc94affd640 1 -- 10.20.193.68:0/2278183007 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7fc94c063020 con 0x7fc95412a7c0 2026-02-18T21:01:32.738 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.735+0000 7fc95c31b640 1 -- 10.20.193.68:0/2278183007 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "quincy"} v 0) v1 -- 0x7fc9541293d0 con 0x7fc95412a7c0 2026-02-18T21:01:32.988 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.985+0000 7fc94affd640 1 -- 10.20.193.68:0/2278183007 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "quincy"}]=0 set require_min_compat_client to quincy v17) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc94c0470a0 con 0x7fc95412a7c0 2026-02-18T21:01:32.988 INFO:teuthology.orchestra.run.trial068.stderr:set require_min_compat_client to quincy 2026-02-18T21:01:32.989 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.986+0000 7fc95c31b640 1 -- 10.20.193.68:0/2278183007 >> v1:10.20.193.68:6816/24610 conn(0x7fc93804d0d0 legacy=0x7fc93804f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.989 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.986+0000 7fc95c31b640 1 -- 10.20.193.68:0/2278183007 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc95412a7c0 msgr2=0x7fc95411b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:32.990 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.986+0000 7fc95c31b640 1 --2- 10.20.193.68:0/2278183007 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc95412a7c0 0x7fc95411b020 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc94c009850 tx=0x7fc94c037000 comp rx=0 tx=0).stop 2026-02-18T21:01:32.990 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.986+0000 7fc95c31b640 1 -- 10.20.193.68:0/2278183007 shutdown_connections 2026-02-18T21:01:32.990 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.986+0000 7fc95c31b640 1 --2- 10.20.193.68:0/2278183007 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc95412a7c0 0x7fc95411b020 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.990 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.986+0000 7fc95c31b640 1 --2- 10.20.193.68:0/2278183007 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc95412a3c0 0x7fc95411aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.990 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.986+0000 7fc95c31b640 1 --2- 10.20.193.68:0/2278183007 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc954068fd0 0x7fc95411a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:32.990 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.986+0000 7fc95c31b640 1 -- 10.20.193.68:0/2278183007 >> 10.20.193.68:0/2278183007 conn(0x7fc95409dbc0 msgr2=0x7fc9541b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:32.990 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.986+0000 7fc95c31b640 1 -- 10.20.193.68:0/2278183007 shutdown_connections 2026-02-18T21:01:32.990 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:32.986+0000 7fc95c31b640 1 -- 10.20.193.68:0/2278183007 wait complete. 2026-02-18T21:01:32.996 INFO:teuthology.run_tasks:Running task print... 2026-02-18T21:01:33.011 INFO:teuthology.task.print:**** done ceph 2026-02-18T21:01:33.011 INFO:teuthology.run_tasks:Running task print... 2026-02-18T21:01:33.024 INFO:teuthology.task.print:*** upgrading, no cephfs present 2026-02-18T21:01:33.024 INFO:teuthology.run_tasks:Running task exec... 2026-02-18T21:01:33.039 INFO:teuthology.task.exec:Executing custom commands... 2026-02-18T21:01:33.039 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@trial068.front.sepia.ceph.com 2026-02-18T21:01:33.039 DEBUG:teuthology.orchestra.run.trial068:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs dump' 2026-02-18T21:01:33.106 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.099+0000 7f34adc31640 1 Processor -- start 2026-02-18T21:01:33.106 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.099+0000 7f34adc31640 1 -- start start 2026-02-18T21:01:33.106 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.099+0000 7f34adc31640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f34a8097500 0x7f34a812f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:33.106 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.099+0000 7f34adc31640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f34a812f780 0x7f34a8131b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:33.106 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.099+0000 7f34adc31640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a809a3c0 con 0x7f34a8096a20 2026-02-18T21:01:33.106 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.099+0000 7f34adc31640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a8099b60 con 0x7f34a8097500 2026-02-18T21:01:33.106 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.099+0000 7f34adc31640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a80978d0 con 0x7f34a812f780 2026-02-18T21:01:33.106 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.099+0000 7f349ffff640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f34a8097500 0x7f34a812f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:33.107 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.099+0000 7f34a77fe640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f34a8096a20 0x7f34a8096df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:59080/0 (socket says 10.20.193.68:59080) 2026-02-18T21:01:33.107 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.099+0000 7f34a7fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f34a812f780 0x7f34a8131b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:33.107 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.099+0000 7f34a77fe640 1 -- 10.20.193.68:0/1725513234 learned_addr learned my addr 10.20.193.68:0/1725513234 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:01:33.107 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.099+0000 7f34a7fff640 1 -- 10.20.193.68:0/1725513234 >> v2:10.20.193.68:3300/0 conn(0x7f34a8097500 msgr2=0x7f34a812f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:01:33.107 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.099+0000 7f34a7fff640 1 --2- 10.20.193.68:0/1725513234 >> v2:10.20.193.68:3300/0 conn(0x7f34a8097500 0x7f34a812f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:33.107 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.099+0000 7f34a7fff640 1 -- 10.20.193.68:0/1725513234 >> v1:10.20.193.68:6789/0 conn(0x7f34a8096a20 legacy=0x7f34a8096df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:33.107 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.099+0000 7f34a7fff640 1 -- 10.20.193.68:0/1725513234 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a809a680 con 0x7f34a812f780 2026-02-18T21:01:33.107 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.099+0000 7f349ffff640 1 --2- 10.20.193.68:0/1725513234 >> v2:10.20.193.68:3300/0 conn(0x7f34a8097500 0x7f34a812f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:33.107 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.099+0000 7f34a7fff640 1 --2- 10.20.193.68:0/1725513234 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f34a812f780 0x7f34a8131b60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f34a0009e60 tx=0x7f34a002f290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea01d10292bc01 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:33.107 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.100+0000 7f34a6ffd640 1 -- 10.20.193.68:0/1725513234 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a002fdb0 con 0x7f34a812f780 2026-02-18T21:01:33.107 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.100+0000 7f34a6ffd640 1 -- 10.20.193.68:0/1725513234 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a0037440 con 0x7f34a812f780 2026-02-18T21:01:33.107 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.100+0000 7f34a6ffd640 1 -- 10.20.193.68:0/1725513234 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a00377e0 con 0x7f34a812f780 2026-02-18T21:01:33.108 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.100+0000 7f34adc31640 1 -- 10.20.193.68:0/1725513234 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f34a812f780 msgr2=0x7f34a8131b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:33.108 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.100+0000 7f34adc31640 1 --2- 10.20.193.68:0/1725513234 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f34a812f780 0x7f34a8131b60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f34a0009e60 tx=0x7f34a002f290 comp rx=0 tx=0).stop 2026-02-18T21:01:33.108 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.100+0000 7f34adc31640 1 -- 10.20.193.68:0/1725513234 shutdown_connections 2026-02-18T21:01:33.108 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.100+0000 7f34adc31640 1 --2- 10.20.193.68:0/1725513234 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f34a812f780 0x7f34a8131b60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:33.108 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.100+0000 7f34adc31640 1 --2- 10.20.193.68:0/1725513234 >> v2:10.20.193.68:3300/0 conn(0x7f34a8097500 0x7f34a812f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:33.108 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.100+0000 7f34adc31640 1 -- 10.20.193.68:0/1725513234 >> 10.20.193.68:0/1725513234 conn(0x7f34a809d9b0 msgr2=0x7f34a809ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:33.108 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.100+0000 7f34adc31640 1 -- 10.20.193.68:0/1725513234 shutdown_connections 2026-02-18T21:01:33.108 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.100+0000 7f34adc31640 1 -- 10.20.193.68:0/1725513234 wait complete. 2026-02-18T21:01:33.108 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.100+0000 7f34adc31640 1 Processor -- start 2026-02-18T21:01:33.108 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.100+0000 7f34adc31640 1 -- start start 2026-02-18T21:01:33.108 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34adc31640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f34a8096a20 0x7f34a811c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:33.108 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34adc31640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f34a8097500 0x7f34a811cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:33.109 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34adc31640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f34a812f780 0x7f34a811d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:01:33.109 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34adc31640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a811e450 con 0x7f34a812f780 2026-02-18T21:01:33.109 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34adc31640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a81200c0 con 0x7f34a8096a20 2026-02-18T21:01:33.109 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34adc31640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34a811d900 con 0x7f34a8097500 2026-02-18T21:01:33.109 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34a77fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f34a8096a20 0x7f34a811c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:33.109 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34a7fff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f34a812f780 0x7f34a811d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:33.109 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34a77fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f34a8096a20 0x7f34a811c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:45478/0 (socket says 10.20.193.68:45478) 2026-02-18T21:01:33.109 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34a77fe640 1 -- 10.20.193.68:0/3376511188 learned_addr learned my addr 10.20.193.68:0/3376511188 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:01:33.109 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f349ffff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f34a8097500 0x7f34a811cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:01:33.109 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34a7fff640 1 -- 10.20.193.68:0/3376511188 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f34a8097500 msgr2=0x7f34a811cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:33.109 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34a7fff640 1 --2- 10.20.193.68:0/3376511188 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f34a8097500 0x7f34a811cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:33.110 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34a7fff640 1 -- 10.20.193.68:0/3376511188 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f34a8096a20 msgr2=0x7f34a811c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:33.110 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34a7fff640 1 --2- 10.20.193.68:0/3376511188 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f34a8096a20 0x7f34a811c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:33.110 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34a7fff640 1 -- 10.20.193.68:0/3376511188 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3490009390 con 0x7f34a812f780 2026-02-18T21:01:33.110 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34a77fe640 1 --2- 10.20.193.68:0/3376511188 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f34a8096a20 0x7f34a811c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:01:33.110 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34a7fff640 1 --2- 10.20.193.68:0/3376511188 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f34a812f780 0x7f34a811d2a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f34a8098fe0 tx=0x7f34a003a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:01:33.110 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34a4ff9640 1 -- 10.20.193.68:0/3376511188 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0036a60 con 0x7f34a812f780 2026-02-18T21:01:33.110 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34a4ff9640 1 -- 10.20.193.68:0/3376511188 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a0036c00 con 0x7f34a812f780 2026-02-18T21:01:33.110 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34adc31640 1 -- 10.20.193.68:0/3376511188 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a0009a20 con 0x7f34a812f780 2026-02-18T21:01:33.110 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34a4ff9640 1 -- 10.20.193.68:0/3376511188 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a004a410 con 0x7f34a812f780 2026-02-18T21:01:33.110 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.101+0000 7f34adc31640 1 -- 10.20.193.68:0/3376511188 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a81be2f0 con 0x7f34a812f780 2026-02-18T21:01:33.110 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.102+0000 7f34adc31640 1 -- 10.20.193.68:0/3376511188 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a811f7f0 con 0x7f34a812f780 2026-02-18T21:01:33.110 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.102+0000 7f34a4ff9640 1 -- 10.20.193.68:0/3376511188 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 5) v1 ==== 59209+0+0 (secure 0 0 0) 0x7f34a0003020 con 0x7f34a812f780 2026-02-18T21:01:33.111 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.102+0000 7f34a4ff9640 1 -- 10.20.193.68:0/3376511188 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 2834+0+0 (secure 0 0 0) 0x7f34a0089180 con 0x7f34a812f780 2026-02-18T21:01:33.111 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.104+0000 7f34a4ff9640 1 -- 10.20.193.68:0/3376511188 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+140354 (secure 0 0 0) 0x7f34a0063f80 con 0x7f34a812f780 2026-02-18T21:01:33.180 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.177+0000 7f34adc31640 1 -- 10.20.193.68:0/3376511188 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f34a805f010 con 0x7f34a812f780 2026-02-18T21:01:33.180 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.177+0000 7f34a4ff9640 1 -- 10.20.193.68:0/3376511188 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 1 v1) v1 ==== 75+0+358 (secure 0 0 0) 0x7f34a0045070 con 0x7f34a812f780 2026-02-18T21:01:33.180 INFO:teuthology.orchestra.run.trial068.stdout:e1 2026-02-18T21:01:33.180 INFO:teuthology.orchestra.run.trial068.stdout:enable_multiple, ever_enabled_multiple: 1,1 2026-02-18T21:01:33.181 INFO:teuthology.orchestra.run.trial068.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2026-02-18T21:01:33.181 INFO:teuthology.orchestra.run.trial068.stdout:legacy client fscid: -1 2026-02-18T21:01:33.181 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:01:33.181 INFO:teuthology.orchestra.run.trial068.stdout:No filesystems configured 2026-02-18T21:01:33.182 INFO:teuthology.orchestra.run.trial068.stderr:dumped fsmap epoch 1 2026-02-18T21:01:33.182 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.178+0000 7f34adc31640 1 -- 10.20.193.68:0/3376511188 >> v1:10.20.193.68:6816/24610 conn(0x7f348804d100 legacy=0x7f348804f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:33.182 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.178+0000 7f34adc31640 1 -- 10.20.193.68:0/3376511188 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f34a812f780 msgr2=0x7f34a811d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:01:33.182 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.178+0000 7f34adc31640 1 --2- 10.20.193.68:0/3376511188 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f34a812f780 0x7f34a811d2a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f34a8098fe0 tx=0x7f34a003a000 comp rx=0 tx=0).stop 2026-02-18T21:01:33.182 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.178+0000 7f34adc31640 1 -- 10.20.193.68:0/3376511188 shutdown_connections 2026-02-18T21:01:33.182 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.178+0000 7f34adc31640 1 --2- 10.20.193.68:0/3376511188 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f34a812f780 0x7f34a811d2a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:33.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.178+0000 7f34adc31640 1 --2- 10.20.193.68:0/3376511188 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f34a8097500 0x7f34a811cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:33.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.178+0000 7f34adc31640 1 --2- 10.20.193.68:0/3376511188 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f34a8096a20 0x7f34a811c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:01:33.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.178+0000 7f34adc31640 1 -- 10.20.193.68:0/3376511188 >> 10.20.193.68:0/3376511188 conn(0x7f34a809d9b0 msgr2=0x7f34a8115c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:01:33.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.178+0000 7f34adc31640 1 -- 10.20.193.68:0/3376511188 shutdown_connections 2026-02-18T21:01:33.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:01:33.178+0000 7f34adc31640 1 -- 10.20.193.68:0/3376511188 wait complete. 2026-02-18T21:01:33.188 INFO:teuthology.run_tasks:Running task install.upgrade... 2026-02-18T21:01:33.203 INFO:teuthology.task.install:project ceph config {'mon.a': None} overrides {'flavor': 'default', 'sha1': '5c7d9533eb2b3fdb031dd48c8022c4d967a9a910'} 2026-02-18T21:01:33.203 INFO:teuthology.task.install:remote ubuntu@trial068.front.sepia.ceph.com config {'flavor': 'default', 'sha1': '5c7d9533eb2b3fdb031dd48c8022c4d967a9a910'} 2026-02-18T21:01:33.204 INFO:teuthology.task.install:extra packages: [] 2026-02-18T21:01:33.212 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-18T21:01:33.212 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2026-02-18T21:01:33.212 DEBUG:teuthology.orchestra.run.trial068:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2026-02-18T21:01:33.233 INFO:teuthology.orchestra.run.trial068.stdout:17.2.9-0.el9 2026-02-18T21:01:33.233 INFO:teuthology.packaging:The installed version of ceph-common is 17.2.9-0.el9 2026-02-18T21:01:33.234 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5c7d9533eb2b3fdb031dd48c8022c4d967a9a910 2026-02-18T21:01:33.393 INFO:teuthology.task.install:Ceph rpm upgrade from 17.2.9-0.el9 to 19.2.3-689.g5c7d9533 2026-02-18T21:01:33.393 INFO:teuthology.task.install.rpm:Host trial068 is: centos 9.stream x86_64 2026-02-18T21:01:33.393 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5c7d9533eb2b3fdb031dd48c8022c4d967a9a910 2026-02-18T21:01:33.528 INFO:teuthology.task.install.rpm:Repo base URL: https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260217.080557-squid/5c7d9533eb2b3fdb031dd48c8022c4d967a9a910/centos/9/flavors/default/ 2026-02-18T21:01:33.528 DEBUG:teuthology.orchestra.run.trial068:> sudo rm -f /etc/yum.repos.d/ceph.repo 2026-02-18T21:01:33.680 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260217.080557-squid/5c7d9533eb2b3fdb031dd48c8022c4d967a9a910/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260217.080557-squid/5c7d9533eb2b3fdb031dd48c8022c4d967a9a910/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260217.080557-squid/5c7d9533eb2b3fdb031dd48c8022c4d967a9a910/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-18T21:01:33.680 DEBUG:teuthology.orchestra.run.trial068:> set -ex 2026-02-18T21:01:33.680 DEBUG:teuthology.orchestra.run.trial068:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-18T21:01:33.704 DEBUG:teuthology.orchestra.run.trial068:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/5c7d9533eb2b3fdb031dd48c8022c4d967a9a910/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-18T21:01:33.769 DEBUG:teuthology.orchestra.run.trial068:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-18T21:01:33.833 DEBUG:teuthology.orchestra.run.trial068:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-18T21:01:33.889 INFO:teuthology.orchestra.run.trial068.stdout:check_obsoletes = 1 2026-02-18T21:01:33.899 DEBUG:teuthology.orchestra.run.trial068:> sudo yum clean all 2026-02-18T21:01:34.058 INFO:teuthology.orchestra.run.trial068.stdout:56 files removed 2026-02-18T21:01:34.073 DEBUG:teuthology.orchestra.run.trial068:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2026-02-18T21:01:34.360 INFO:teuthology.orchestra.run.trial068.stdout:ceph packages for x86_64 610 kB/s | 86 kB 00:00 2026-02-18T21:01:34.489 INFO:teuthology.orchestra.run.trial068.stdout:ceph noarch packages 116 kB/s | 12 kB 00:00 2026-02-18T21:01:34.615 INFO:teuthology.orchestra.run.trial068.stdout:ceph source packages 18 kB/s | 1.9 kB 00:00 2026-02-18T21:01:35.305 INFO:teuthology.orchestra.run.trial068.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-18T21:01:38.449 INFO:teuthology.orchestra.run.trial068.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-18T21:01:41.833 INFO:teuthology.orchestra.run.trial068.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 7.8 MB 00:01 2026-02-18T21:01:42.686 INFO:teuthology.orchestra.run.trial068.stdout:CentOS Stream 9 - Extras packages 157 kB/s | 20 kB 00:00 2026-02-18T21:01:42.940 INFO:teuthology.orchestra.run.trial068.stdout:Extra Packages for Enterprise Linux 106 MB/s | 20 MB 00:00 2026-02-18T21:01:46.149 INFO:teuthology.orchestra.run.trial068.stdout:lab-extras 2.2 MB/s | 50 kB 00:00 2026-02-18T21:01:47.342 INFO:teuthology.orchestra.run.trial068.stderr:Package cephadm available, but not installed. 2026-02-18T21:01:47.342 INFO:teuthology.orchestra.run.trial068.stdout:No match for argument: cephadm 2026-02-18T21:01:47.344 INFO:teuthology.orchestra.run.trial068.stderr:Package ceph-mgr-dashboard available, but not installed. 2026-02-18T21:01:47.345 INFO:teuthology.orchestra.run.trial068.stdout:No match for argument: ceph-mgr-dashboard 2026-02-18T21:01:47.345 INFO:teuthology.orchestra.run.trial068.stderr:Package ceph-mgr-diskprediction-local available, but not installed. 2026-02-18T21:01:47.345 INFO:teuthology.orchestra.run.trial068.stdout:No match for argument: ceph-mgr-diskprediction-local 2026-02-18T21:01:47.346 INFO:teuthology.orchestra.run.trial068.stderr:Package ceph-mgr-rook available, but not installed. 2026-02-18T21:01:47.346 INFO:teuthology.orchestra.run.trial068.stdout:No match for argument: ceph-mgr-rook 2026-02-18T21:01:47.346 INFO:teuthology.orchestra.run.trial068.stderr:Package ceph-mgr-cephadm available, but not installed. 2026-02-18T21:01:47.347 INFO:teuthology.orchestra.run.trial068.stdout:No match for argument: ceph-mgr-cephadm 2026-02-18T21:01:47.347 INFO:teuthology.orchestra.run.trial068.stderr:Package ceph-volume available, but not installed. 2026-02-18T21:01:47.347 INFO:teuthology.orchestra.run.trial068.stdout:No match for argument: ceph-volume 2026-02-18T21:01:47.384 INFO:teuthology.orchestra.run.trial068.stdout:Dependencies resolved. 2026-02-18T21:01:47.385 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:01:47.385 INFO:teuthology.orchestra.run.trial068.stdout: Package Arch Version Repository Size 2026-02-18T21:01:47.386 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:01:47.386 INFO:teuthology.orchestra.run.trial068.stdout:Upgrading: 2026-02-18T21:01:47.386 INFO:teuthology.orchestra.run.trial068.stdout: ceph x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 6.5 k 2026-02-18T21:01:47.386 INFO:teuthology.orchestra.run.trial068.stdout: ceph-base x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 5.5 M 2026-02-18T21:01:47.386 INFO:teuthology.orchestra.run.trial068.stdout: ceph-common x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 22 M 2026-02-18T21:01:47.386 INFO:teuthology.orchestra.run.trial068.stdout: ceph-fuse x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 1.2 M 2026-02-18T21:01:47.386 INFO:teuthology.orchestra.run.trial068.stdout: ceph-immutable-object-cache 2026-02-18T21:01:47.386 INFO:teuthology.orchestra.run.trial068.stdout: x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 145 k 2026-02-18T21:01:47.386 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mds x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 2.4 M 2026-02-18T21:01:47.387 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 1.1 M 2026-02-18T21:01:47.387 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-modules-core noarch 2:19.2.3-689.g5c7d9533.el9 ceph-noarch 253 k 2026-02-18T21:01:47.387 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mon x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 4.7 M 2026-02-18T21:01:47.387 INFO:teuthology.orchestra.run.trial068.stdout: ceph-osd x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 17 M 2026-02-18T21:01:47.387 INFO:teuthology.orchestra.run.trial068.stdout: ceph-radosgw x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 11 M 2026-02-18T21:01:47.387 INFO:teuthology.orchestra.run.trial068.stdout: ceph-selinux x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 25 k 2026-02-18T21:01:47.387 INFO:teuthology.orchestra.run.trial068.stdout: ceph-test x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 50 M 2026-02-18T21:01:47.387 INFO:teuthology.orchestra.run.trial068.stdout: libcephfs-devel x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 34 k 2026-02-18T21:01:47.387 INFO:teuthology.orchestra.run.trial068.stdout: libcephfs2 x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 999 k 2026-02-18T21:01:47.387 INFO:teuthology.orchestra.run.trial068.stdout: libcephsqlite x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 163 k 2026-02-18T21:01:47.387 INFO:teuthology.orchestra.run.trial068.stdout: librados-devel x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 126 k 2026-02-18T21:01:47.388 INFO:teuthology.orchestra.run.trial068.stdout: librados2 x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 3.4 M 2026-02-18T21:01:47.388 INFO:teuthology.orchestra.run.trial068.stdout: libradosstriper1 x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 503 k 2026-02-18T21:01:47.388 INFO:teuthology.orchestra.run.trial068.stdout: librbd1 x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 3.2 M 2026-02-18T21:01:47.388 INFO:teuthology.orchestra.run.trial068.stdout: librgw2 x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 5.4 M 2026-02-18T21:01:47.388 INFO:teuthology.orchestra.run.trial068.stdout: python3-ceph-argparse x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 45 k 2026-02-18T21:01:47.388 INFO:teuthology.orchestra.run.trial068.stdout: python3-ceph-common x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 142 k 2026-02-18T21:01:47.388 INFO:teuthology.orchestra.run.trial068.stdout: python3-cephfs x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 165 k 2026-02-18T21:01:47.388 INFO:teuthology.orchestra.run.trial068.stdout: python3-rados x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 322 k 2026-02-18T21:01:47.388 INFO:teuthology.orchestra.run.trial068.stdout: python3-rbd x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 303 k 2026-02-18T21:01:47.388 INFO:teuthology.orchestra.run.trial068.stdout: python3-rgw x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 100 k 2026-02-18T21:01:47.388 INFO:teuthology.orchestra.run.trial068.stdout: rbd-fuse x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 85 k 2026-02-18T21:01:47.389 INFO:teuthology.orchestra.run.trial068.stdout: rbd-mirror x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 3.1 M 2026-02-18T21:01:47.389 INFO:teuthology.orchestra.run.trial068.stdout: rbd-nbd x86_64 2:19.2.3-689.g5c7d9533.el9 ceph 171 k 2026-02-18T21:01:47.389 INFO:teuthology.orchestra.run.trial068.stdout:Installing dependencies: 2026-02-18T21:01:47.389 INFO:teuthology.orchestra.run.trial068.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-18T21:01:47.389 INFO:teuthology.orchestra.run.trial068.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-18T21:01:47.389 INFO:teuthology.orchestra.run.trial068.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-18T21:01:47.389 INFO:teuthology.orchestra.run.trial068.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-18T21:01:47.389 INFO:teuthology.orchestra.run.trial068.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-18T21:01:47.389 INFO:teuthology.orchestra.run.trial068.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-18T21:01:47.389 INFO:teuthology.orchestra.run.trial068.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-18T21:01:47.389 INFO:teuthology.orchestra.run.trial068.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-18T21:01:47.389 INFO:teuthology.orchestra.run.trial068.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-18T21:01:47.390 INFO:teuthology.orchestra.run.trial068.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-18T21:01:47.390 INFO:teuthology.orchestra.run.trial068.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-18T21:01:47.390 INFO:teuthology.orchestra.run.trial068.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-18T21:01:47.390 INFO:teuthology.orchestra.run.trial068.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-18T21:01:47.390 INFO:teuthology.orchestra.run.trial068.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-18T21:01:47.390 INFO:teuthology.orchestra.run.trial068.stdout:Installing weak dependencies: 2026-02-18T21:01:47.390 INFO:teuthology.orchestra.run.trial068.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-18T21:01:47.390 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:01:47.390 INFO:teuthology.orchestra.run.trial068.stdout:Transaction Summary 2026-02-18T21:01:47.390 INFO:teuthology.orchestra.run.trial068.stdout:================================================================================ 2026-02-18T21:01:47.391 INFO:teuthology.orchestra.run.trial068.stdout:Install 15 Packages 2026-02-18T21:01:47.391 INFO:teuthology.orchestra.run.trial068.stdout:Upgrade 30 Packages 2026-02-18T21:01:47.391 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:01:47.391 INFO:teuthology.orchestra.run.trial068.stdout:Total download size: 140 M 2026-02-18T21:01:47.392 INFO:teuthology.orchestra.run.trial068.stdout:Downloading Packages: 2026-02-18T21:01:47.957 INFO:teuthology.orchestra.run.trial068.stdout:(1/45): pciutils-3.7.0-7.el9.x86_64.rpm 2.2 MB/s | 93 kB 00:00 2026-02-18T21:01:47.959 INFO:teuthology.orchestra.run.trial068.stdout:(2/45): unzip-6.0-59.el9.x86_64.rpm 4.1 MB/s | 182 kB 00:00 2026-02-18T21:01:47.964 INFO:teuthology.orchestra.run.trial068.stdout:(3/45): zip-3.0-35.el9.x86_64.rpm 5.4 MB/s | 266 kB 00:00 2026-02-18T21:01:48.076 INFO:teuthology.orchestra.run.trial068.stdout:(4/45): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2026-02-18T21:01:48.085 INFO:teuthology.orchestra.run.trial068.stdout:(5/45): libnbd-1.20.3-4.el9.x86_64.rpm 1.3 MB/s | 164 kB 00:00 2026-02-18T21:01:48.089 INFO:teuthology.orchestra.run.trial068.stdout:(6/45): boost-program-options-1.75.0-13.el9.x86 788 kB/s | 104 kB 00:00 2026-02-18T21:01:48.108 INFO:teuthology.orchestra.run.trial068.stdout:(7/45): qatlib-service-25.08.0-2.el9.x86_64.rpm 1.6 MB/s | 37 kB 00:00 2026-02-18T21:01:48.119 INFO:teuthology.orchestra.run.trial068.stdout:(8/45): qatlib-25.08.0-2.el9.x86_64.rpm 5.4 MB/s | 240 kB 00:00 2026-02-18T21:01:48.123 INFO:teuthology.orchestra.run.trial068.stdout:(9/45): qatzip-libs-1.3.1-1.el9.x86_64.rpm 1.9 MB/s | 66 kB 00:00 2026-02-18T21:01:48.172 INFO:teuthology.orchestra.run.trial068.stdout:(10/45): lua-devel-5.4.4-4.el9.x86_64.rpm 349 kB/s | 22 kB 00:00 2026-02-18T21:01:48.213 INFO:teuthology.orchestra.run.trial068.stdout:(11/45): libarrow-doc-9.0.0-15.el9.noarch.rpm 274 kB/s | 25 kB 00:00 2026-02-18T21:01:48.301 INFO:teuthology.orchestra.run.trial068.stdout:(12/45): luarocks-3.9.2-5.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2026-02-18T21:01:48.324 INFO:teuthology.orchestra.run.trial068.stdout:(13/45): parquet-libs-9.0.0-15.el9.x86_64.rpm 7.4 MB/s | 838 kB 00:00 2026-02-18T21:01:48.345 INFO:teuthology.orchestra.run.trial068.stdout:(14/45): re2-20211101-20.el9.x86_64.rpm 4.3 MB/s | 191 kB 00:00 2026-02-18T21:01:48.360 INFO:teuthology.orchestra.run.trial068.stdout:(15/45): libarrow-9.0.0-15.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2026-02-18T21:01:48.384 INFO:teuthology.orchestra.run.trial068.stdout:(16/45): ceph-19.2.3-689.g5c7d9533.el9.x86_64.r 110 kB/s | 6.5 kB 00:00 2026-02-18T21:01:48.466 INFO:teuthology.orchestra.run.trial068.stdout:(17/45): ceph-fuse-19.2.3-689.g5c7d9533.el9.x86 14 MB/s | 1.2 MB 00:00 2026-02-18T21:01:48.490 INFO:teuthology.orchestra.run.trial068.stdout:(18/45): ceph-immutable-object-cache-19.2.3-689 5.9 MB/s | 145 kB 00:00 2026-02-18T21:01:48.644 INFO:teuthology.orchestra.run.trial068.stdout:(19/45): ceph-base-19.2.3-689.g5c7d9533.el9.x86 18 MB/s | 5.5 MB 00:00 2026-02-18T21:01:48.647 INFO:teuthology.orchestra.run.trial068.stdout:(20/45): ceph-mds-19.2.3-689.g5c7d9533.el9.x86_ 15 MB/s | 2.4 MB 00:00 2026-02-18T21:01:48.683 INFO:teuthology.orchestra.run.trial068.stdout:(21/45): ceph-mgr-19.2.3-689.g5c7d9533.el9.x86_ 28 MB/s | 1.1 MB 00:00 2026-02-18T21:01:48.912 INFO:teuthology.orchestra.run.trial068.stdout:(22/45): ceph-mon-19.2.3-689.g5c7d9533.el9.x86_ 18 MB/s | 4.7 MB 00:00 2026-02-18T21:01:49.499 INFO:teuthology.orchestra.run.trial068.stdout:(23/45): ceph-osd-19.2.3-689.g5c7d9533.el9.x86_ 21 MB/s | 17 MB 00:00 2026-02-18T21:01:49.513 INFO:teuthology.orchestra.run.trial068.stdout:(24/45): ceph-radosgw-19.2.3-689.g5c7d9533.el9. 18 MB/s | 11 MB 00:00 2026-02-18T21:01:49.513 INFO:teuthology.orchestra.run.trial068.stdout:(25/45): ceph-selinux-19.2.3-689.g5c7d9533.el9. 1.8 MB/s | 25 kB 00:00 2026-02-18T21:01:49.554 INFO:teuthology.orchestra.run.trial068.stdout:(26/45): libcephfs-devel-19.2.3-689.g5c7d9533.e 829 kB/s | 34 kB 00:00 2026-02-18T21:01:49.587 INFO:teuthology.orchestra.run.trial068.stdout:(27/45): ceph-common-19.2.3-689.g5c7d9533.el9.x 18 MB/s | 22 MB 00:01 2026-02-18T21:01:49.594 INFO:teuthology.orchestra.run.trial068.stdout:(28/45): libcephfs2-19.2.3-689.g5c7d9533.el9.x8 24 MB/s | 999 kB 00:00 2026-02-18T21:01:49.615 INFO:teuthology.orchestra.run.trial068.stdout:(29/45): libcephsqlite-19.2.3-689.g5c7d9533.el9 5.8 MB/s | 163 kB 00:00 2026-02-18T21:01:49.618 INFO:teuthology.orchestra.run.trial068.stdout:(30/45): librados-devel-19.2.3-689.g5c7d9533.el 5.1 MB/s | 126 kB 00:00 2026-02-18T21:01:49.664 INFO:teuthology.orchestra.run.trial068.stdout:(31/45): libradosstriper1-19.2.3-689.g5c7d9533. 11 MB/s | 503 kB 00:00 2026-02-18T21:01:49.807 INFO:teuthology.orchestra.run.trial068.stdout:(32/45): librados2-19.2.3-689.g5c7d9533.el9.x86 18 MB/s | 3.4 MB 00:00 2026-02-18T21:01:49.824 INFO:teuthology.orchestra.run.trial068.stdout:(33/45): librbd1-19.2.3-689.g5c7d9533.el9.x86_6 20 MB/s | 3.2 MB 00:00 2026-02-18T21:01:49.861 INFO:teuthology.orchestra.run.trial068.stdout:(34/45): python3-ceph-argparse-19.2.3-689.g5c7d 1.2 MB/s | 45 kB 00:00 2026-02-18T21:01:49.901 INFO:teuthology.orchestra.run.trial068.stdout:(35/45): python3-ceph-common-19.2.3-689.g5c7d95 3.5 MB/s | 142 kB 00:00 2026-02-18T21:01:49.942 INFO:teuthology.orchestra.run.trial068.stdout:(36/45): python3-cephfs-19.2.3-689.g5c7d9533.el 4.0 MB/s | 165 kB 00:00 2026-02-18T21:01:49.985 INFO:teuthology.orchestra.run.trial068.stdout:(37/45): python3-rados-19.2.3-689.g5c7d9533.el9 7.3 MB/s | 322 kB 00:00 2026-02-18T21:01:50.029 INFO:teuthology.orchestra.run.trial068.stdout:(38/45): python3-rbd-19.2.3-689.g5c7d9533.el9.x 6.8 MB/s | 303 kB 00:00 2026-02-18T21:01:50.054 INFO:teuthology.orchestra.run.trial068.stdout:(39/45): librgw2-19.2.3-689.g5c7d9533.el9.x86_6 22 MB/s | 5.4 MB 00:00 2026-02-18T21:01:50.060 INFO:teuthology.orchestra.run.trial068.stdout:(40/45): python3-rgw-19.2.3-689.g5c7d9533.el9.x 3.1 MB/s | 100 kB 00:00 2026-02-18T21:01:50.080 INFO:teuthology.orchestra.run.trial068.stdout:(41/45): rbd-fuse-19.2.3-689.g5c7d9533.el9.x86_ 3.1 MB/s | 85 kB 00:00 2026-02-18T21:01:50.124 INFO:teuthology.orchestra.run.trial068.stdout:(42/45): rbd-nbd-19.2.3-689.g5c7d9533.el9.x86_6 3.8 MB/s | 171 kB 00:00 2026-02-18T21:01:50.169 INFO:teuthology.orchestra.run.trial068.stdout:(43/45): ceph-mgr-modules-core-19.2.3-689.g5c7d 5.4 MB/s | 253 kB 00:00 2026-02-18T21:01:50.187 INFO:teuthology.orchestra.run.trial068.stdout:(44/45): rbd-mirror-19.2.3-689.g5c7d9533.el9.x8 25 MB/s | 3.1 MB 00:00 2026-02-18T21:01:50.771 INFO:teuthology.orchestra.run.trial068.stdout:(45/45): ceph-test-19.2.3-689.g5c7d9533.el9.x86 39 MB/s | 50 MB 00:01 2026-02-18T21:01:50.775 INFO:teuthology.orchestra.run.trial068.stdout:-------------------------------------------------------------------------------- 2026-02-18T21:01:50.775 INFO:teuthology.orchestra.run.trial068.stdout:Total 41 MB/s | 140 MB 00:03 2026-02-18T21:01:50.852 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction check 2026-02-18T21:01:50.879 INFO:teuthology.orchestra.run.trial068.stdout:Transaction check succeeded. 2026-02-18T21:01:50.879 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction test 2026-02-18T21:01:51.347 INFO:teuthology.orchestra.run.trial068.stdout:Transaction test succeeded. 2026-02-18T21:01:51.347 INFO:teuthology.orchestra.run.trial068.stdout:Running transaction 2026-02-18T21:01:51.987 INFO:teuthology.orchestra.run.trial068.stdout: Preparing : 1/1 2026-02-18T21:01:51.993 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : librados2-2:19.2.3-689.g5c7d9533.el9.x86_64 1/75 2026-02-18T21:01:52.047 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librados2-2:19.2.3-689.g5c7d9533.el9.x86_64 1/75 2026-02-18T21:01:52.049 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : libcephfs2-2:19.2.3-689.g5c7d9533.el9.x86_64 2/75 2026-02-18T21:01:52.077 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: libcephfs2-2:19.2.3-689.g5c7d9533.el9.x86_64 2/75 2026-02-18T21:01:52.082 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : python3-rados-2:19.2.3-689.g5c7d9533.el9.x86_64 3/75 2026-02-18T21:01:52.225 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 4/75 2026-02-18T21:01:52.226 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : librbd1-2:19.2.3-689.g5c7d9533.el9.x86_64 5/75 2026-02-18T21:01:52.243 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librbd1-2:19.2.3-689.g5c7d9533.el9.x86_64 5/75 2026-02-18T21:01:52.244 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : libcephsqlite-2:19.2.3-689.g5c7d9533.el9.x86_64 6/75 2026-02-18T21:01:52.276 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: libcephsqlite-2:19.2.3-689.g5c7d9533.el9.x86_64 6/75 2026-02-18T21:01:52.277 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : libradosstriper1-2:19.2.3-689.g5c7d9533.el9.x86_64 7/75 2026-02-18T21:01:52.291 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: libradosstriper1-2:19.2.3-689.g5c7d9533.el9.x86_64 7/75 2026-02-18T21:01:52.297 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : python3-ceph-argparse-2:19.2.3-689.g5c7d9533.el9.x 8/75 2026-02-18T21:01:52.303 INFO:teuthology.orchestra.run.trial068.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/75 2026-02-18T21:01:52.309 INFO:teuthology.orchestra.run.trial068.stdout: Installing : unzip-6.0-59.el9.x86_64 10/75 2026-02-18T21:01:52.333 INFO:teuthology.orchestra.run.trial068.stdout: Installing : zip-3.0-35.el9.x86_64 11/75 2026-02-18T21:01:52.336 INFO:teuthology.orchestra.run.trial068.stdout: Installing : luarocks-3.9.2-5.el9.noarch 12/75 2026-02-18T21:01:52.345 INFO:teuthology.orchestra.run.trial068.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 13/75 2026-02-18T21:01:52.361 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : python3-cephfs-2:19.2.3-689.g5c7d9533.el9.x86_64 14/75 2026-02-18T21:01:52.369 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : python3-rbd-2:19.2.3-689.g5c7d9533.el9.x86_64 15/75 2026-02-18T21:01:52.415 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : librados-devel-2:19.2.3-689.g5c7d9533.el9.x86_64 16/75 2026-02-18T21:01:52.442 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : ceph-mgr-modules-core-2:19.2.3-689.g5c7d9533.el9.n 17/75 2026-02-18T21:01:52.445 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : python3-ceph-common-2:19.2.3-689.g5c7d9533.el9.x86 18/75 2026-02-18T21:01:52.477 INFO:teuthology.orchestra.run.trial068.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/75 2026-02-18T21:01:52.479 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 20/75 2026-02-18T21:01:52.481 INFO:teuthology.orchestra.run.trial068.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 21/75 2026-02-18T21:01:52.487 INFO:teuthology.orchestra.run.trial068.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 22/75 2026-02-18T21:01:52.721 INFO:teuthology.orchestra.run.trial068.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 23/75 2026-02-18T21:01:52.729 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : librgw2-2:19.2.3-689.g5c7d9533.el9.x86_64 24/75 2026-02-18T21:01:52.745 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librgw2-2:19.2.3-689.g5c7d9533.el9.x86_64 24/75 2026-02-18T21:01:52.746 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : python3-rgw-2:19.2.3-689.g5c7d9533.el9.x86_64 25/75 2026-02-18T21:01:53.753 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-common-2:19.2.3-689.g5c7d9533.el9.x86_64 26/75 2026-02-18T21:01:53.774 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : ceph-common-2:19.2.3-689.g5c7d9533.el9.x86_64 26/75 2026-02-18T21:01:53.791 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-common-2:19.2.3-689.g5c7d9533.el9.x86_64 26/75 2026-02-18T21:01:53.796 INFO:teuthology.orchestra.run.trial068.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/75 2026-02-18T21:01:53.798 INFO:teuthology.orchestra.run.trial068.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/75 2026-02-18T21:01:53.799 INFO:teuthology.orchestra.run.trial068.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/75 2026-02-18T21:01:53.817 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/75 2026-02-18T21:01:54.095 INFO:teuthology.orchestra.run.trial068.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/75 2026-02-18T21:01:54.102 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : ceph-base-2:19.2.3-689.g5c7d9533.el9.x86_64 31/75 2026-02-18T21:01:54.116 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-base-2:19.2.3-689.g5c7d9533.el9.x86_64 31/75 2026-02-18T21:01:54.117 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : ceph-selinux-2:19.2.3-689.g5c7d9533.el9.x86_64 32/75 2026-02-18T21:01:58.334 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-selinux-2:19.2.3-689.g5c7d9533.el9.x86_64 32/75 2026-02-18T21:01:58.338 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : ceph-mds-2:19.2.3-689.g5c7d9533.el9.x86_64 33/75 2026-02-18T21:01:58.394 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mds-2:19.2.3-689.g5c7d9533.el9.x86_64 33/75 2026-02-18T21:01:58.395 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : ceph-mgr-2:19.2.3-689.g5c7d9533.el9.x86_64 34/75 2026-02-18T21:01:58.611 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mgr-2:19.2.3-689.g5c7d9533.el9.x86_64 34/75 2026-02-18T21:01:58.621 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : ceph-mon-2:19.2.3-689.g5c7d9533.el9.x86_64 35/75 2026-02-18T21:01:59.359 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mon-2:19.2.3-689.g5c7d9533.el9.x86_64 35/75 2026-02-18T21:01:59.375 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : ceph-osd-2:19.2.3-689.g5c7d9533.el9.x86_64 36/75 2026-02-18T21:01:59.384 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-osd-2:19.2.3-689.g5c7d9533.el9.x86_64 36/75 2026-02-18T21:01:59.842 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : ceph-2:19.2.3-689.g5c7d9533.el9.x86_64 37/75 2026-02-18T21:01:59.861 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : ceph-radosgw-2:19.2.3-689.g5c7d9533.el9.x86_64 38/75 2026-02-18T21:01:59.875 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-689.g5c7d9533.el9.x86_64 38/75 2026-02-18T21:01:59.876 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : ceph-immutable-object-cache-2:19.2.3-689.g5c7d9533 39/75 2026-02-18T21:02:00.024 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-689.g5c7d9533 39/75 2026-02-18T21:02:00.029 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : rbd-mirror-2:19.2.3-689.g5c7d9533.el9.x86_64 40/75 2026-02-18T21:02:02.438 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: rbd-mirror-2:19.2.3-689.g5c7d9533.el9.x86_64 40/75 2026-02-18T21:02:02.445 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : ceph-test-2:19.2.3-689.g5c7d9533.el9.x86_64 41/75 2026-02-18T21:02:02.449 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : libcephfs-devel-2:19.2.3-689.g5c7d9533.el9.x86_64 42/75 2026-02-18T21:02:02.459 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : rbd-fuse-2:19.2.3-689.g5c7d9533.el9.x86_64 43/75 2026-02-18T21:02:02.511 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : rbd-nbd-2:19.2.3-689.g5c7d9533.el9.x86_64 44/75 2026-02-18T21:02:02.512 INFO:teuthology.orchestra.run.trial068.stdout: Upgrading : ceph-fuse-2:19.2.3-689.g5c7d9533.el9.x86_64 45/75 2026-02-18T21:02:02.518 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : ceph-2:17.2.9-0.el9.x86_64 46/75 2026-02-18T21:02:02.521 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : ceph-test-2:17.2.9-0.el9.x86_64 47/75 2026-02-18T21:02:02.529 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-radosgw-2:17.2.9-0.el9.x86_64 48/75 2026-02-18T21:02:02.529 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : ceph-radosgw-2:17.2.9-0.el9.x86_64 48/75 2026-02-18T21:02:02.544 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-radosgw-2:17.2.9-0.el9.x86_64 48/75 2026-02-18T21:02:02.546 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : rbd-nbd-2:17.2.9-0.el9.x86_64 49/75 2026-02-18T21:02:02.552 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: rbd-mirror-2:17.2.9-0.el9.x86_64 50/75 2026-02-18T21:02:02.552 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : rbd-mirror-2:17.2.9-0.el9.x86_64 50/75 2026-02-18T21:02:02.560 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: rbd-mirror-2:17.2.9-0.el9.x86_64 50/75 2026-02-18T21:02:02.566 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mgr-2:17.2.9-0.el9.x86_64 51/75 2026-02-18T21:02:02.566 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : ceph-mgr-2:17.2.9-0.el9.x86_64 51/75 2026-02-18T21:02:02.573 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mgr-2:17.2.9-0.el9.x86_64 51/75 2026-02-18T21:02:02.575 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : rbd-fuse-2:17.2.9-0.el9.x86_64 52/75 2026-02-18T21:02:02.580 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 53/75 2026-02-18T21:02:02.580 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 53/75 2026-02-18T21:02:02.587 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 53/75 2026-02-18T21:02:02.588 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : libcephfs-devel-2:17.2.9-0.el9.x86_64 54/75 2026-02-18T21:02:02.588 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : libcephsqlite-2:17.2.9-0.el9.x86_64 55/75 2026-02-18T21:02:02.600 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: libcephsqlite-2:17.2.9-0.el9.x86_64 55/75 2026-02-18T21:02:02.601 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : librados-devel-2:17.2.9-0.el9.x86_64 56/75 2026-02-18T21:02:02.607 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mds-2:17.2.9-0.el9.x86_64 57/75 2026-02-18T21:02:02.607 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : ceph-mds-2:17.2.9-0.el9.x86_64 57/75 2026-02-18T21:02:02.615 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mds-2:17.2.9-0.el9.x86_64 57/75 2026-02-18T21:02:02.620 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mon-2:17.2.9-0.el9.x86_64 58/75 2026-02-18T21:02:02.620 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : ceph-mon-2:17.2.9-0.el9.x86_64 58/75 2026-02-18T21:02:02.628 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-mon-2:17.2.9-0.el9.x86_64 58/75 2026-02-18T21:02:02.633 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-osd-2:17.2.9-0.el9.x86_64 59/75 2026-02-18T21:02:02.633 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : ceph-osd-2:17.2.9-0.el9.x86_64 59/75 2026-02-18T21:02:02.641 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-osd-2:17.2.9-0.el9.x86_64 59/75 2026-02-18T21:02:02.641 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : ceph-selinux-2:17.2.9-0.el9.x86_64 60/75 2026-02-18T21:02:02.647 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-selinux-2:17.2.9-0.el9.x86_64 60/75 2026-02-18T21:02:02.654 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-base-2:17.2.9-0.el9.x86_64 61/75 2026-02-18T21:02:02.654 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : ceph-base-2:17.2.9-0.el9.x86_64 61/75 2026-02-18T21:02:02.670 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-base-2:17.2.9-0.el9.x86_64 61/75 2026-02-18T21:02:02.670 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : ceph-common-2:17.2.9-0.el9.x86_64 62/75 2026-02-18T21:02:02.678 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: ceph-common-2:17.2.9-0.el9.x86_64 62/75 2026-02-18T21:02:02.678 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : libradosstriper1-2:17.2.9-0.el9.x86_64 63/75 2026-02-18T21:02:02.690 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: libradosstriper1-2:17.2.9-0.el9.x86_64 63/75 2026-02-18T21:02:02.691 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : python3-cephfs-2:17.2.9-0.el9.x86_64 64/75 2026-02-18T21:02:02.693 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : python3-rbd-2:17.2.9-0.el9.x86_64 65/75 2026-02-18T21:02:02.693 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : librbd1-2:17.2.9-0.el9.x86_64 66/75 2026-02-18T21:02:02.704 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librbd1-2:17.2.9-0.el9.x86_64 66/75 2026-02-18T21:02:02.706 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : python3-rgw-2:17.2.9-0.el9.x86_64 67/75 2026-02-18T21:02:02.706 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : librgw2-2:17.2.9-0.el9.x86_64 68/75 2026-02-18T21:02:02.717 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librgw2-2:17.2.9-0.el9.x86_64 68/75 2026-02-18T21:02:02.718 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : python3-rados-2:17.2.9-0.el9.x86_64 69/75 2026-02-18T21:02:02.718 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : libcephfs2-2:17.2.9-0.el9.x86_64 70/75 2026-02-18T21:02:02.730 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: libcephfs2-2:17.2.9-0.el9.x86_64 70/75 2026-02-18T21:02:02.732 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : ceph-fuse-2:17.2.9-0.el9.x86_64 71/75 2026-02-18T21:02:02.733 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : python3-ceph-argparse-2:17.2.9-0.el9.x86_64 72/75 2026-02-18T21:02:02.735 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : python3-ceph-common-2:17.2.9-0.el9.x86_64 73/75 2026-02-18T21:02:02.737 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : ceph-mgr-modules-core-2:17.2.9-0.el9.noarch 74/75 2026-02-18T21:02:02.737 INFO:teuthology.orchestra.run.trial068.stdout: Cleanup : librados2-2:17.2.9-0.el9.x86_64 75/75 2026-02-18T21:02:02.791 INFO:teuthology.orchestra.run.trial068.stdout: Running scriptlet: librados2-2:17.2.9-0.el9.x86_64 75/75 2026-02-18T21:02:02.791 INFO:teuthology.orchestra.run.trial068.stdout:Creating group 'qat' with GID 991. 2026-02-18T21:02:02.791 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:03.131 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 1/75 2026-02-18T21:02:03.132 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : unzip-6.0-59.el9.x86_64 2/75 2026-02-18T21:02:03.132 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : zip-3.0-35.el9.x86_64 3/75 2026-02-18T21:02:03.132 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 4/75 2026-02-18T21:02:03.132 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 5/75 2026-02-18T21:02:03.132 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : lua-5.4.4-4.el9.x86_64 6/75 2026-02-18T21:02:03.132 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 7/75 2026-02-18T21:02:03.133 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 8/75 2026-02-18T21:02:03.133 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 9/75 2026-02-18T21:02:03.133 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 10/75 2026-02-18T21:02:03.133 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 11/75 2026-02-18T21:02:03.133 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 12/75 2026-02-18T21:02:03.133 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 13/75 2026-02-18T21:02:03.133 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 14/75 2026-02-18T21:02:03.134 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : re2-1:20211101-20.el9.x86_64 15/75 2026-02-18T21:02:03.134 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-2:19.2.3-689.g5c7d9533.el9.x86_64 16/75 2026-02-18T21:02:03.134 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-2:17.2.9-0.el9.x86_64 17/75 2026-02-18T21:02:03.134 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-base-2:19.2.3-689.g5c7d9533.el9.x86_64 18/75 2026-02-18T21:02:03.134 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-base-2:17.2.9-0.el9.x86_64 19/75 2026-02-18T21:02:03.134 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-common-2:19.2.3-689.g5c7d9533.el9.x86_64 20/75 2026-02-18T21:02:03.134 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-common-2:17.2.9-0.el9.x86_64 21/75 2026-02-18T21:02:03.134 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-fuse-2:19.2.3-689.g5c7d9533.el9.x86_64 22/75 2026-02-18T21:02:03.135 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-fuse-2:17.2.9-0.el9.x86_64 23/75 2026-02-18T21:02:03.135 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-689.g5c7d9533 24/75 2026-02-18T21:02:03.135 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-immutable-object-cache-2:17.2.9-0.el9.x86_64 25/75 2026-02-18T21:02:03.135 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mds-2:19.2.3-689.g5c7d9533.el9.x86_64 26/75 2026-02-18T21:02:03.135 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mds-2:17.2.9-0.el9.x86_64 27/75 2026-02-18T21:02:03.135 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mgr-2:19.2.3-689.g5c7d9533.el9.x86_64 28/75 2026-02-18T21:02:03.135 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mgr-2:17.2.9-0.el9.x86_64 29/75 2026-02-18T21:02:03.135 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mon-2:19.2.3-689.g5c7d9533.el9.x86_64 30/75 2026-02-18T21:02:03.135 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mon-2:17.2.9-0.el9.x86_64 31/75 2026-02-18T21:02:03.135 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-osd-2:19.2.3-689.g5c7d9533.el9.x86_64 32/75 2026-02-18T21:02:03.135 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-osd-2:17.2.9-0.el9.x86_64 33/75 2026-02-18T21:02:03.136 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-radosgw-2:19.2.3-689.g5c7d9533.el9.x86_64 34/75 2026-02-18T21:02:03.136 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-radosgw-2:17.2.9-0.el9.x86_64 35/75 2026-02-18T21:02:03.136 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-selinux-2:19.2.3-689.g5c7d9533.el9.x86_64 36/75 2026-02-18T21:02:03.136 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-selinux-2:17.2.9-0.el9.x86_64 37/75 2026-02-18T21:02:03.136 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-test-2:19.2.3-689.g5c7d9533.el9.x86_64 38/75 2026-02-18T21:02:03.136 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-test-2:17.2.9-0.el9.x86_64 39/75 2026-02-18T21:02:03.136 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libcephfs-devel-2:19.2.3-689.g5c7d9533.el9.x86_64 40/75 2026-02-18T21:02:03.136 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libcephfs-devel-2:17.2.9-0.el9.x86_64 41/75 2026-02-18T21:02:03.136 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libcephfs2-2:19.2.3-689.g5c7d9533.el9.x86_64 42/75 2026-02-18T21:02:03.136 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libcephfs2-2:17.2.9-0.el9.x86_64 43/75 2026-02-18T21:02:03.136 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libcephsqlite-2:19.2.3-689.g5c7d9533.el9.x86_64 44/75 2026-02-18T21:02:03.136 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libcephsqlite-2:17.2.9-0.el9.x86_64 45/75 2026-02-18T21:02:03.136 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librados-devel-2:19.2.3-689.g5c7d9533.el9.x86_64 46/75 2026-02-18T21:02:03.136 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librados-devel-2:17.2.9-0.el9.x86_64 47/75 2026-02-18T21:02:03.137 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librados2-2:19.2.3-689.g5c7d9533.el9.x86_64 48/75 2026-02-18T21:02:03.137 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librados2-2:17.2.9-0.el9.x86_64 49/75 2026-02-18T21:02:03.137 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libradosstriper1-2:19.2.3-689.g5c7d9533.el9.x86_64 50/75 2026-02-18T21:02:03.137 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : libradosstriper1-2:17.2.9-0.el9.x86_64 51/75 2026-02-18T21:02:03.137 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librbd1-2:19.2.3-689.g5c7d9533.el9.x86_64 52/75 2026-02-18T21:02:03.137 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librbd1-2:17.2.9-0.el9.x86_64 53/75 2026-02-18T21:02:03.137 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librgw2-2:19.2.3-689.g5c7d9533.el9.x86_64 54/75 2026-02-18T21:02:03.137 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : librgw2-2:17.2.9-0.el9.x86_64 55/75 2026-02-18T21:02:03.137 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-ceph-argparse-2:19.2.3-689.g5c7d9533.el9.x 56/75 2026-02-18T21:02:03.137 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-ceph-argparse-2:17.2.9-0.el9.x86_64 57/75 2026-02-18T21:02:03.137 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-ceph-common-2:19.2.3-689.g5c7d9533.el9.x86 58/75 2026-02-18T21:02:03.137 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-ceph-common-2:17.2.9-0.el9.x86_64 59/75 2026-02-18T21:02:03.137 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-cephfs-2:19.2.3-689.g5c7d9533.el9.x86_64 60/75 2026-02-18T21:02:03.138 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-cephfs-2:17.2.9-0.el9.x86_64 61/75 2026-02-18T21:02:03.138 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-rados-2:19.2.3-689.g5c7d9533.el9.x86_64 62/75 2026-02-18T21:02:03.138 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-rados-2:17.2.9-0.el9.x86_64 63/75 2026-02-18T21:02:03.138 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-rbd-2:19.2.3-689.g5c7d9533.el9.x86_64 64/75 2026-02-18T21:02:03.138 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-rbd-2:17.2.9-0.el9.x86_64 65/75 2026-02-18T21:02:03.138 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-rgw-2:19.2.3-689.g5c7d9533.el9.x86_64 66/75 2026-02-18T21:02:03.138 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : python3-rgw-2:17.2.9-0.el9.x86_64 67/75 2026-02-18T21:02:03.138 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : rbd-fuse-2:19.2.3-689.g5c7d9533.el9.x86_64 68/75 2026-02-18T21:02:03.139 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : rbd-fuse-2:17.2.9-0.el9.x86_64 69/75 2026-02-18T21:02:03.139 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : rbd-mirror-2:19.2.3-689.g5c7d9533.el9.x86_64 70/75 2026-02-18T21:02:03.139 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : rbd-mirror-2:17.2.9-0.el9.x86_64 71/75 2026-02-18T21:02:03.139 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : rbd-nbd-2:19.2.3-689.g5c7d9533.el9.x86_64 72/75 2026-02-18T21:02:03.139 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : rbd-nbd-2:17.2.9-0.el9.x86_64 73/75 2026-02-18T21:02:03.139 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-689.g5c7d9533.el9.n 74/75 2026-02-18T21:02:03.191 INFO:teuthology.orchestra.run.trial068.stdout: Verifying : ceph-mgr-modules-core-2:17.2.9-0.el9.noarch 75/75 2026-02-18T21:02:03.191 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:03.191 INFO:teuthology.orchestra.run.trial068.stdout:Upgraded: 2026-02-18T21:02:03.191 INFO:teuthology.orchestra.run.trial068.stdout: ceph-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.191 INFO:teuthology.orchestra.run.trial068.stdout: ceph-base-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.191 INFO:teuthology.orchestra.run.trial068.stdout: ceph-common-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.191 INFO:teuthology.orchestra.run.trial068.stdout: ceph-fuse-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.191 INFO:teuthology.orchestra.run.trial068.stdout: ceph-immutable-object-cache-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.191 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mds-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.191 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.191 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mgr-modules-core-2:19.2.3-689.g5c7d9533.el9.noarch 2026-02-18T21:02:03.191 INFO:teuthology.orchestra.run.trial068.stdout: ceph-mon-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.191 INFO:teuthology.orchestra.run.trial068.stdout: ceph-osd-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.191 INFO:teuthology.orchestra.run.trial068.stdout: ceph-radosgw-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.191 INFO:teuthology.orchestra.run.trial068.stdout: ceph-selinux-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.191 INFO:teuthology.orchestra.run.trial068.stdout: ceph-test-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.191 INFO:teuthology.orchestra.run.trial068.stdout: libcephfs-devel-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.191 INFO:teuthology.orchestra.run.trial068.stdout: libcephfs2-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: libcephsqlite-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: librados-devel-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: librados2-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: libradosstriper1-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: librbd1-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: librgw2-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: python3-ceph-argparse-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: python3-ceph-common-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: python3-cephfs-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: python3-rados-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: python3-rbd-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: python3-rgw-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: rbd-fuse-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: rbd-mirror-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: rbd-nbd-2:19.2.3-689.g5c7d9533.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout:Installed: 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: boost-program-options-1.75.0-13.el9.x86_64 libarrow-9.0.0-15.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: libarrow-doc-9.0.0-15.el9.noarch libnbd-1.20.3-4.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: lua-5.4.4-4.el9.x86_64 lua-devel-5.4.4-4.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: luarocks-3.9.2-5.el9.noarch parquet-libs-9.0.0-15.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: pciutils-3.7.0-7.el9.x86_64 qatlib-25.08.0-2.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: qatlib-service-25.08.0-2.el9.x86_64 qatzip-libs-1.3.1-1.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: re2-1:20211101-20.el9.x86_64 unzip-6.0-59.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: zip-3.0-35.el9.x86_64 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:03.192 INFO:teuthology.orchestra.run.trial068.stdout:Complete! 2026-02-18T21:02:03.243 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5c7d9533eb2b3fdb031dd48c8022c4d967a9a910 2026-02-18T21:02:03.427 DEBUG:teuthology.orchestra.run.trial068:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-18T21:02:03.449 INFO:teuthology.orchestra.run.trial068.stdout:19.2.3-689.g5c7d9533.el9 2026-02-18T21:02:03.449 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-689.g5c7d9533.el9 2026-02-18T21:02:03.449 INFO:teuthology.task.install:The correct ceph version 19.2.3-689.g5c7d9533 is installed. 2026-02-18T21:02:03.451 INFO:teuthology.run_tasks:Running task print... 2026-02-18T21:02:03.458 INFO:teuthology.task.print:**** done install.upgrade 2026-02-18T21:02:03.458 INFO:teuthology.run_tasks:Running task ceph.restart... 2026-02-18T21:02:03.474 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-18T21:02:03.474 INFO:teuthology.orchestra.run:waiting for 300 2026-02-18T21:02:03.499 INFO:tasks.ceph.mon.a:Stopped 2026-02-18T21:02:03.499 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-18T21:02:03.499 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-18T21:02:03.541 INFO:tasks.ceph.mon.a:Started 2026-02-18T21:02:03.541 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-18T21:02:03.542 INFO:teuthology.orchestra.run:waiting for 300 2026-02-18T21:02:03.550 INFO:tasks.ceph.mon.b:Stopped 2026-02-18T21:02:03.551 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-18T21:02:03.551 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-18T21:02:03.593 INFO:tasks.ceph.mon.b:Started 2026-02-18T21:02:03.594 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-18T21:02:03.594 INFO:teuthology.orchestra.run:waiting for 300 2026-02-18T21:02:03.605 INFO:tasks.ceph.mon.c:Stopped 2026-02-18T21:02:03.605 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-18T21:02:03.605 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-18T21:02:03.648 INFO:tasks.ceph.mon.c:Started 2026-02-18T21:02:03.648 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-18T21:02:03.649 INFO:teuthology.orchestra.run:waiting for 300 2026-02-18T21:02:03.670 INFO:tasks.ceph.mgr.x:Stopped 2026-02-18T21:02:03.670 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-18T21:02:03.670 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-18T21:02:03.712 INFO:tasks.ceph.mgr.x:Started 2026-02-18T21:02:03.713 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-18T21:02:03.713 INFO:teuthology.orchestra.run:waiting for 300 2026-02-18T21:02:03.735 INFO:tasks.ceph.mgr.y:Stopped 2026-02-18T21:02:03.735 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-18T21:02:03.735 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2026-02-18T21:02:03.777 INFO:tasks.ceph.mgr.y:Started 2026-02-18T21:02:03.777 INFO:teuthology.run_tasks:Running task ceph.healthy... 2026-02-18T21:02:03.793 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-18T21:02:03.793 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-18T21:02:03.794 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-18T21:02:03.868 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.862+0000 7f10a6fcb640 1 Processor -- start 2026-02-18T21:02:03.868 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.862+0000 7f10a6fcb640 1 -- start start 2026-02-18T21:02:03.868 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f10a6fcb640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f10a0114bb0 0x7f10a0114f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:03.868 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f10a6fcb640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f10a01154d0 0x7f10a01304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:03.868 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f10a6fcb640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f10a01309e0 0x7f10a0130e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:03.868 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f10a6fcb640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f10a00716e0 con 0x7f10a0114bb0 2026-02-18T21:02:03.869 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f10a6fcb640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f10a0071400 con 0x7f10a01154d0 2026-02-18T21:02:03.869 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f10a6fcb640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f10a009e090 con 0x7f10a01309e0 2026-02-18T21:02:03.869 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f1097fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f10a01154d0 0x7f10a01304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:03.869 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f10a4d40640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f10a0114bb0 0x7f10a0114f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:03.869 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f1097fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f10a01154d0 0x7f10a01304a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:38940/0 (socket says 10.20.193.68:38940) 2026-02-18T21:02:03.869 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f1097fff640 1 -- 10.20.193.68:0/2008362288 learned_addr learned my addr 10.20.193.68:0/2008362288 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:03.869 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f10a4d40640 1 --2- 10.20.193.68:0/2008362288 >> v2:10.20.193.68:3300/0 conn(0x7f10a0114bb0 0x7f10a0114f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:47202/0 (socket says 10.20.193.68:47202) 2026-02-18T21:02:03.869 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f10a5541640 1 --2- 10.20.193.68:0/2008362288 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f10a01309e0 0x7f10a0130e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:03.869 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f1097fff640 1 -- 10.20.193.68:0/2008362288 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f10a01309e0 msgr2=0x7f10a0130e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:03.869 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f1097fff640 1 --2- 10.20.193.68:0/2008362288 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f10a01309e0 0x7f10a0130e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:03.869 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f1097fff640 1 -- 10.20.193.68:0/2008362288 >> v2:10.20.193.68:3300/0 conn(0x7f10a0114bb0 msgr2=0x7f10a0114f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:03.870 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f1097fff640 1 --2- 10.20.193.68:0/2008362288 >> v2:10.20.193.68:3300/0 conn(0x7f10a0114bb0 0x7f10a0114f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:03.870 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f1097fff640 1 -- 10.20.193.68:0/2008362288 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a0071ca0 con 0x7f10a01154d0 2026-02-18T21:02:03.870 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f1097fff640 1 --2- 10.20.193.68:0/2008362288 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f10a01154d0 0x7f10a01304a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1088009970 tx=0x7f108802ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6368f45f719fa83 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:03.870 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f10977fe640 1 -- 10.20.193.68:0/2008362288 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108803c070 con 0x7f10a01154d0 2026-02-18T21:02:03.870 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f10977fe640 1 -- 10.20.193.68:0/2008362288 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f108802fac0 con 0x7f10a01154d0 2026-02-18T21:02:03.870 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.863+0000 7f10977fe640 1 -- 10.20.193.68:0/2008362288 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1088037440 con 0x7f10a01154d0 2026-02-18T21:02:03.870 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f10a6fcb640 1 -- 10.20.193.68:0/2008362288 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f10a01154d0 msgr2=0x7f10a01304a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:03.870 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f10a6fcb640 1 --2- 10.20.193.68:0/2008362288 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f10a01154d0 0x7f10a01304a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1088009970 tx=0x7f108802ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:03.870 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f10a6fcb640 1 -- 10.20.193.68:0/2008362288 shutdown_connections 2026-02-18T21:02:03.870 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f10a6fcb640 1 --2- 10.20.193.68:0/2008362288 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f10a01154d0 0x7f10a01304a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:03.870 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f10a6fcb640 1 --2- 10.20.193.68:0/2008362288 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f10a01309e0 0x7f10a0130e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:03.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f10a6fcb640 1 --2- 10.20.193.68:0/2008362288 >> v2:10.20.193.68:3300/0 conn(0x7f10a0114bb0 0x7f10a0114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:03.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f10a6fcb640 1 -- 10.20.193.68:0/2008362288 >> 10.20.193.68:0/2008362288 conn(0x7f10a009cee0 msgr2=0x7f10a009d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:03.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f10a6fcb640 1 -- 10.20.193.68:0/2008362288 shutdown_connections 2026-02-18T21:02:03.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f10a6fcb640 1 -- 10.20.193.68:0/2008362288 wait complete. 2026-02-18T21:02:03.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f10a6fcb640 1 Processor -- start 2026-02-18T21:02:03.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f10a6fcb640 1 -- start start 2026-02-18T21:02:03.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f10a6fcb640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f10a0114bb0 0x7f10a011eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:03.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f10a6fcb640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f10a01154d0 0x7f10a011f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:03.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f10a6fcb640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f10a01309e0 0x7f10a011fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:03.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f10a6fcb640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f10a01376f0 con 0x7f10a0114bb0 2026-02-18T21:02:03.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f10a6fcb640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f10a01158e0 con 0x7f10a01154d0 2026-02-18T21:02:03.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f10a6fcb640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f10a0137870 con 0x7f10a01309e0 2026-02-18T21:02:03.872 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f1097fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f10a01154d0 0x7f10a011f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:03.872 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f10a4d40640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f10a0114bb0 0x7f10a011eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:03.872 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f1097fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f10a01154d0 0x7f10a011f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:38948/0 (socket says 10.20.193.68:38948) 2026-02-18T21:02:03.872 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f10a5541640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f10a01309e0 0x7f10a011fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:03.872 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.864+0000 7f1097fff640 1 -- 10.20.193.68:0/2475062721 learned_addr learned my addr 10.20.193.68:0/2475062721 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:03.872 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.865+0000 7f1097fff640 1 -- 10.20.193.68:0/2475062721 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f10a01309e0 msgr2=0x7f10a011fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:03.872 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.865+0000 7f1097fff640 1 --2- 10.20.193.68:0/2475062721 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f10a01309e0 0x7f10a011fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:03.872 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.865+0000 7f1097fff640 1 -- 10.20.193.68:0/2475062721 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f10a0114bb0 msgr2=0x7f10a011eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:03.872 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.865+0000 7f1097fff640 1 --2- 10.20.193.68:0/2475062721 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f10a0114bb0 0x7f10a011eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:03.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.865+0000 7f1097fff640 1 -- 10.20.193.68:0/2475062721 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a0121980 con 0x7f10a01154d0 2026-02-18T21:02:03.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.865+0000 7f10a4d40640 1 --2- 10.20.193.68:0/2475062721 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f10a0114bb0 0x7f10a011eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-18T21:02:03.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.865+0000 7f1097fff640 1 --2- 10.20.193.68:0/2475062721 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f10a01154d0 0x7f10a011f530 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1088009aa0 tx=0x7f10880047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:03.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.865+0000 7f10957fa640 1 -- 10.20.193.68:0/2475062721 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1088047070 con 0x7f10a01154d0 2026-02-18T21:02:03.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.865+0000 7f10957fa640 1 -- 10.20.193.68:0/2475062721 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1088042630 con 0x7f10a01154d0 2026-02-18T21:02:03.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.865+0000 7f10957fa640 1 -- 10.20.193.68:0/2475062721 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f108803c040 con 0x7f10a01154d0 2026-02-18T21:02:03.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.865+0000 7f10a6fcb640 1 -- 10.20.193.68:0/2475062721 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a0073760 con 0x7f10a01154d0 2026-02-18T21:02:03.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.865+0000 7f10a6fcb640 1 -- 10.20.193.68:0/2475062721 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a0120fb0 con 0x7f10a01154d0 2026-02-18T21:02:03.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.865+0000 7f10957fa640 1 -- 10.20.193.68:0/2475062721 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 6) ==== 59491+0+0 (secure 0 0 0) 0x7f108802f940 con 0x7f10a01154d0 2026-02-18T21:02:03.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.865+0000 7f10a6fcb640 1 -- 10.20.193.68:0/2475062721 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a0121210 con 0x7f10a01154d0 2026-02-18T21:02:03.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.866+0000 7f10a4d40640 1 -- 10.20.193.68:0/2475062721 >> v1:10.20.193.68:6816/24610 conn(0x7f107004d6e0 legacy=0x7f107004fba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.68:6816/24610 2026-02-18T21:02:03.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.866+0000 7f10957fa640 1 -- 10.20.193.68:0/2475062721 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 2834+0+0 (secure 0 0 0) 0x7f1088088b50 con 0x7f10a01154d0 2026-02-18T21:02:03.874 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.868+0000 7f10957fa640 1 -- 10.20.193.68:0/2475062721 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+144236 (secure 0 0 0) 0x7f10a0121980 con 0x7f10a01154d0 2026-02-18T21:02:03.942 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:03.940+0000 7f7b98017140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-18T21:02:03.945 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.944+0000 7f10a6fcb640 1 -- 10.20.193.68:0/2475062721 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f10a0069ef0 con 0x7f10a01154d0 2026-02-18T21:02:03.946 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.945+0000 7f10957fa640 1 -- 10.20.193.68:0/2475062721 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v6) ==== 74+0+117344 (secure 0 0 0) 0x7f1088063b20 con 0x7f10a01154d0 2026-02-18T21:02:03.947 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:03.949 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.946+0000 7f10a6fcb640 1 -- 10.20.193.68:0/2475062721 >> v1:10.20.193.68:6816/24610 conn(0x7f107004d6e0 legacy=0x7f107004fba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-18T21:02:03.949 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.946+0000 7f10a6fcb640 1 -- 10.20.193.68:0/2475062721 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f10a01154d0 msgr2=0x7f10a011f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:03.949 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.946+0000 7f10a6fcb640 1 --2- 10.20.193.68:0/2475062721 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f10a01154d0 0x7f10a011f530 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1088009aa0 tx=0x7f10880047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:03.949 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.946+0000 7f10a6fcb640 1 -- 10.20.193.68:0/2475062721 shutdown_connections 2026-02-18T21:02:03.949 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.946+0000 7f10a6fcb640 1 --2- 10.20.193.68:0/2475062721 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f10a01309e0 0x7f10a011fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:03.949 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.946+0000 7f10a6fcb640 1 --2- 10.20.193.68:0/2475062721 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f10a01154d0 0x7f10a011f530 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:03.949 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.946+0000 7f10a6fcb640 1 --2- 10.20.193.68:0/2475062721 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f10a0114bb0 0x7f10a011eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:03.949 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.946+0000 7f10a6fcb640 1 -- 10.20.193.68:0/2475062721 >> 10.20.193.68:0/2475062721 conn(0x7f10a009cee0 msgr2=0x7f10a006fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:03.949 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.946+0000 7f10a6fcb640 1 -- 10.20.193.68:0/2475062721 shutdown_connections 2026-02-18T21:02:03.950 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:03.946+0000 7f10a6fcb640 1 -- 10.20.193.68:0/2475062721 wait complete. 2026-02-18T21:02:03.955 INFO:teuthology.orchestra.run.trial068.stdout:{"epoch":6,"flags":0,"active_gid":4137,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6816","nonce":24610}]},"active_addr":"10.20.193.68:6816/24610","active_change":"2026-02-18T21:01:12.883175+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4133,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.68:0","nonce":991885778}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.68:0","nonce":3536457986}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.68:0","nonce":4112610678}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.68:0","nonce":4267957295}]}]} 2026-02-18T21:02:03.960 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-18T21:02:03.960 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-18T21:02:03.960 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-18T21:02:04.032 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.026+0000 7fe0c803d640 1 Processor -- start 2026-02-18T21:02:04.032 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.026+0000 7fe0c803d640 1 -- start start 2026-02-18T21:02:04.032 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.027+0000 7fe0c803d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe0c012e1b0 0x7fe0c012e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.032 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.027+0000 7fe0c803d640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fe0c0073680 0x7fe0c0071400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.032 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.027+0000 7fe0c803d640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c009e090 con 0x7fe0c0071940 2026-02-18T21:02:04.032 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.027+0000 7fe0c803d640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7fe0c0073e60 con 0x7fe0c0073680 2026-02-18T21:02:04.032 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.027+0000 7fe0c803d640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c012ead0 con 0x7fe0c012e1b0 2026-02-18T21:02:04.032 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.027+0000 7fe0c5db2640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe0c012e1b0 0x7fe0c012e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.033 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.027+0000 7fe0c55b1640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fe0c0073680 0x7fe0c0071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.033 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.027+0000 7fe0c5db2640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe0c012e1b0 0x7fe0c012e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:38968/0 (socket says 10.20.193.68:38968) 2026-02-18T21:02:04.033 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.027+0000 7fe0c5db2640 1 -- 10.20.193.68:0/227915499 learned_addr learned my addr 10.20.193.68:0/227915499 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:04.033 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.027+0000 7fe0c5db2640 1 -- 10.20.193.68:0/227915499 >> v2:10.20.193.68:3300/0 conn(0x7fe0c0073680 msgr2=0x7fe0c0071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:04.033 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.027+0000 7fe0c5db2640 1 --2- 10.20.193.68:0/227915499 >> v2:10.20.193.68:3300/0 conn(0x7fe0c0073680 0x7fe0c0071400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.033 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.027+0000 7fe0c5db2640 1 -- 10.20.193.68:0/227915499 >> v1:10.20.193.68:6789/0 conn(0x7fe0c0071940 legacy=0x7fe0c0135080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.033 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.027+0000 7fe0c5db2640 1 -- 10.20.193.68:0/227915499 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c0072d10 con 0x7fe0c012e1b0 2026-02-18T21:02:04.033 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.028+0000 7fe0c5db2640 1 --2- 10.20.193.68:0/227915499 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe0c012e1b0 0x7fe0c012e590 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0009970 tx=0x7fe0b002ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=355484e22a6ec954 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:04.033 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.028+0000 7fe0c4db0640 1 -- 10.20.193.68:0/227915499 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b003c070 con 0x7fe0c012e1b0 2026-02-18T21:02:04.033 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.028+0000 7fe0c4db0640 1 -- 10.20.193.68:0/227915499 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b002fb10 con 0x7fe0c012e1b0 2026-02-18T21:02:04.033 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.028+0000 7fe0c4db0640 1 -- 10.20.193.68:0/227915499 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0037440 con 0x7fe0c012e1b0 2026-02-18T21:02:04.034 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.028+0000 7fe0c803d640 1 -- 10.20.193.68:0/227915499 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe0c012e1b0 msgr2=0x7fe0c012e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.034 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.028+0000 7fe0c803d640 1 --2- 10.20.193.68:0/227915499 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe0c012e1b0 0x7fe0c012e590 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0009970 tx=0x7fe0b002ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:04.034 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.028+0000 7fe0c803d640 1 -- 10.20.193.68:0/227915499 shutdown_connections 2026-02-18T21:02:04.034 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.028+0000 7fe0c803d640 1 --2- 10.20.193.68:0/227915499 >> v2:10.20.193.68:3300/0 conn(0x7fe0c0073680 0x7fe0c0071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.034 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.028+0000 7fe0c803d640 1 --2- 10.20.193.68:0/227915499 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe0c012e1b0 0x7fe0c012e590 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.034 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.028+0000 7fe0c803d640 1 -- 10.20.193.68:0/227915499 >> 10.20.193.68:0/227915499 conn(0x7fe0c009cee0 msgr2=0x7fe0c009d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:04.034 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.028+0000 7fe0c803d640 1 -- 10.20.193.68:0/227915499 shutdown_connections 2026-02-18T21:02:04.034 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.028+0000 7fe0c803d640 1 -- 10.20.193.68:0/227915499 wait complete. 2026-02-18T21:02:04.034 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.028+0000 7fe0c803d640 1 Processor -- start 2026-02-18T21:02:04.034 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.028+0000 7fe0c803d640 1 -- start start 2026-02-18T21:02:04.034 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0c803d640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fe0c0071940 0x7fe0c0131ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.034 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0c803d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe0c0073680 0x7fe0c0132430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0c803d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe0c012e1b0 0x7fe0c0132970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0c803d640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c0072160 con 0x7fe0c0071940 2026-02-18T21:02:04.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0c803d640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c0071fe0 con 0x7fe0c0073680 2026-02-18T21:02:04.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0c803d640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fe0c01367a0 con 0x7fe0c012e1b0 2026-02-18T21:02:04.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0c5db2640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fe0c0071940 0x7fe0c0131ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0c55b1640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe0c0073680 0x7fe0c0132430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0c55b1640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe0c0073680 0x7fe0c0132430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:38980/0 (socket says 10.20.193.68:38980) 2026-02-18T21:02:04.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0c5db2640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fe0c0071940 0x7fe0c0131ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:47252/0 (socket says 10.20.193.68:47252) 2026-02-18T21:02:04.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0c55b1640 1 -- 10.20.193.68:0/1168072474 learned_addr learned my addr 10.20.193.68:0/1168072474 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:04.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0c65b3640 1 --2- 10.20.193.68:0/1168072474 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe0c012e1b0 0x7fe0c0132970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0c55b1640 1 -- 10.20.193.68:0/1168072474 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe0c012e1b0 msgr2=0x7fe0c0132970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0c55b1640 1 --2- 10.20.193.68:0/1168072474 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe0c012e1b0 0x7fe0c0132970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0c55b1640 1 -- 10.20.193.68:0/1168072474 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fe0c0071940 msgr2=0x7fe0c0131ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0c55b1640 1 --2- 10.20.193.68:0/1168072474 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fe0c0071940 0x7fe0c0131ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0c55b1640 1 -- 10.20.193.68:0/1168072474 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c0133910 con 0x7fe0c0073680 2026-02-18T21:02:04.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0c55b1640 1 --2- 10.20.193.68:0/1168072474 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe0c0073680 0x7fe0c0132430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400ebe0 tx=0x7fe0b400c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:04.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0ae7fc640 1 -- 10.20.193.68:0/1168072474 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4017070 con 0x7fe0c0073680 2026-02-18T21:02:04.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0ae7fc640 1 -- 10.20.193.68:0/1168072474 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b400cc40 con 0x7fe0c0073680 2026-02-18T21:02:04.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0c803d640 1 -- 10.20.193.68:0/1168072474 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c0134510 con 0x7fe0c0073680 2026-02-18T21:02:04.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0ae7fc640 1 -- 10.20.193.68:0/1168072474 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4013470 con 0x7fe0c0073680 2026-02-18T21:02:04.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.029+0000 7fe0c803d640 1 -- 10.20.193.68:0/1168072474 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c0136450 con 0x7fe0c0073680 2026-02-18T21:02:04.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.030+0000 7fe0c803d640 1 -- 10.20.193.68:0/1168072474 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c0071400 con 0x7fe0c0073680 2026-02-18T21:02:04.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.030+0000 7fe0ae7fc640 1 -- 10.20.193.68:0/1168072474 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 6) ==== 59491+0+0 (secure 0 0 0) 0x7fe0b4024060 con 0x7fe0c0073680 2026-02-18T21:02:04.037 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.030+0000 7fe0c5db2640 1 -- 10.20.193.68:0/1168072474 >> v1:10.20.193.68:6816/24610 conn(0x7fe09004d6b0 legacy=0x7fe09004fb70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.68:6816/24610 2026-02-18T21:02:04.037 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.030+0000 7fe0ae7fc640 1 -- 10.20.193.68:0/1168072474 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 2834+0+0 (secure 0 0 0) 0x7fe0b4064010 con 0x7fe0c0073680 2026-02-18T21:02:04.037 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.032+0000 7fe0ae7fc640 1 -- 10.20.193.68:0/1168072474 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+144236 (secure 0 0 0) 0x7fe0b403ef70 con 0x7fe0c0073680 2026-02-18T21:02:04.053 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.052+0000 7f9f2700e140 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2026-02-18T21:02:04.072 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.071+0000 7f7b98017140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-18T21:02:04.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.095+0000 7fe0c803d640 1 -- 10.20.193.68:0/1168072474 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0c0069ef0 con 0x7fe0c0073680 2026-02-18T21:02:04.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.095+0000 7fe0ae7fc640 1 -- 10.20.193.68:0/1168072474 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+8618 (secure 0 0 0) 0x7fe0b4063180 con 0x7fe0c0073680 2026-02-18T21:02:04.097 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:04.097 INFO:teuthology.orchestra.run.trial068.stdout:{"epoch":18,"fsid":"73558818-cfd1-494a-84aa-56d128598ef4","created":"2026-02-18T21:01:11.071818+0000","modified":"2026-02-18T21:01:35.860597+0000","last_up_change":"2026-02-18T21:01:19.437203+0000","last_in_change":"2026-02-18T21:01:11.803245+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-18T21:01:20.913845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-18T21:01:25.650381+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5f8e54-3a43-41d6-b266-aa412a7f170e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6809","nonce":25183}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6811","nonce":25183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6814","nonce":25183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6812","nonce":25183}]},"public_addr":"10.20.193.68:6809/25183","cluster_addr":"10.20.193.68:6811/25183","heartbeat_back_addr":"10.20.193.68:6814/25183","heartbeat_front_addr":"10.20.193.68:6812/25183","state":["exists","up"]},{"osd":1,"uuid":"e26d8762-250e-42e7-8768-23caa22edb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6808","nonce":25184}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6810","nonce":25184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6815","nonce":25184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6813","nonce":25184}]},"public_addr":"10.20.193.68:6808/25184","cluster_addr":"10.20.193.68:6810/25184","heartbeat_back_addr":"10.20.193.68:6815/25184","heartbeat_front_addr":"10.20.193.68:6813/25184","state":["exists","up"]},{"osd":2,"uuid":"568ee96d-39ac-4d79-92bb-d1f3f12601b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6800","nonce":25185}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6801","nonce":25185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6803","nonce":25185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6802","nonce":25185}]},"public_addr":"10.20.193.68:6800/25185","cluster_addr":"10.20.193.68:6801/25185","heartbeat_back_addr":"10.20.193.68:6803/25185","heartbeat_front_addr":"10.20.193.68:6802/25185","state":["exists","up"]},{"osd":3,"uuid":"765a38cd-f526-4aba-b94e-c57076ca6c72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6804","nonce":25186}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6805","nonce":25186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6807","nonce":25186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6806","nonce":25186}]},"public_addr":"10.20.193.68:6804/25186","cluster_addr":"10.20.193.68:6805/25186","heartbeat_back_addr":"10.20.193.68:6807/25186","heartbeat_front_addr":"10.20.193.68:6806/25186","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T21:02:04.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.097+0000 7fe0c803d640 1 -- 10.20.193.68:0/1168072474 >> v1:10.20.193.68:6816/24610 conn(0x7fe09004d6b0 legacy=0x7fe09004fb70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-18T21:02:04.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.097+0000 7fe0c803d640 1 -- 10.20.193.68:0/1168072474 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe0c0073680 msgr2=0x7fe0c0132430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.097+0000 7fe0c803d640 1 --2- 10.20.193.68:0/1168072474 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe0c0073680 0x7fe0c0132430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400ebe0 tx=0x7fe0b400c520 comp rx=0 tx=0).stop 2026-02-18T21:02:04.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.097+0000 7fe0c803d640 1 -- 10.20.193.68:0/1168072474 shutdown_connections 2026-02-18T21:02:04.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.097+0000 7fe0c803d640 1 --2- 10.20.193.68:0/1168072474 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe0c012e1b0 0x7fe0c0132970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.097+0000 7fe0c803d640 1 --2- 10.20.193.68:0/1168072474 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe0c0073680 0x7fe0c0132430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.097+0000 7fe0c803d640 1 --2- 10.20.193.68:0/1168072474 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fe0c0071940 0x7fe0c0131ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.097+0000 7fe0c803d640 1 -- 10.20.193.68:0/1168072474 >> 10.20.193.68:0/1168072474 conn(0x7fe0c009cee0 msgr2=0x7fe0c0127190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:04.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.097+0000 7fe0c803d640 1 -- 10.20.193.68:0/1168072474 shutdown_connections 2026-02-18T21:02:04.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.097+0000 7fe0c803d640 1 -- 10.20.193.68:0/1168072474 wait complete. 2026-02-18T21:02:04.100 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.098+0000 7f7b98017140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-18T21:02:04.108 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-18T21:02:04.108 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-18T21:02:04.135 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.134+0000 7f7b98017140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-18T21:02:04.159 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.158+0000 7f7b98017140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-18T21:02:04.167 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.166+0000 7f9f2700e140 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2026-02-18T21:02:04.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.178+0000 7f2404e04640 1 Processor -- start 2026-02-18T21:02:04.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.178+0000 7f2404e04640 1 -- start start 2026-02-18T21:02:04.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.178+0000 7f2404e04640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2400071400 0x7f24000717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.178+0000 7f2404e04640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f240012e510 0x7f240013ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.178+0000 7f2404e04640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24000731f0 con 0x7f2400071d20 2026-02-18T21:02:04.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.178+0000 7f2404e04640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f240009e090 con 0x7f240012e510 2026-02-18T21:02:04.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.178+0000 7f2404e04640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f2400073f90 con 0x7f2400071400 2026-02-18T21:02:04.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.178+0000 7f23fe575640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2400071400 0x7f24000717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.178+0000 7f23fed76640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f240012e510 0x7f240013ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.178+0000 7f23fdd74640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f2400071d20 0x7f240012de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:50592/0 (socket says 10.20.193.68:50592) 2026-02-18T21:02:04.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.178+0000 7f23fdd74640 1 -- 10.20.193.68:0/2911822040 learned_addr learned my addr 10.20.193.68:0/2911822040 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:04.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.178+0000 7f23fed76640 1 -- 10.20.193.68:0/2911822040 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2400071400 msgr2=0x7f24000717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:04.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.178+0000 7f23fed76640 1 --2- 10.20.193.68:0/2911822040 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2400071400 0x7f24000717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.178+0000 7f23fed76640 1 -- 10.20.193.68:0/2911822040 >> v1:10.20.193.68:6789/0 conn(0x7f2400071d20 legacy=0x7f240012de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.178+0000 7f23fed76640 1 -- 10.20.193.68:0/2911822040 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2400072900 con 0x7f240012e510 2026-02-18T21:02:04.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.179+0000 7f23fed76640 1 --2- 10.20.193.68:0/2911822040 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f240012e510 0x7f240013ca40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009dc0 tx=0x7f23f002f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89aa07624cefa114 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:04.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.179+0000 7f23fd573640 1 -- 10.20.193.68:0/2911822040 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f003c070 con 0x7f240012e510 2026-02-18T21:02:04.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.179+0000 7f23fd573640 1 -- 10.20.193.68:0/2911822040 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f0037440 con 0x7f240012e510 2026-02-18T21:02:04.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.179+0000 7f23fd573640 1 -- 10.20.193.68:0/2911822040 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0037810 con 0x7f240012e510 2026-02-18T21:02:04.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.179+0000 7f2404e04640 1 -- 10.20.193.68:0/2911822040 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f240012e510 msgr2=0x7f240013ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.179+0000 7f2404e04640 1 --2- 10.20.193.68:0/2911822040 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f240012e510 0x7f240013ca40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009dc0 tx=0x7f23f002f230 comp rx=0 tx=0).stop 2026-02-18T21:02:04.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.179+0000 7f2404e04640 1 -- 10.20.193.68:0/2911822040 shutdown_connections 2026-02-18T21:02:04.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.179+0000 7f2404e04640 1 --2- 10.20.193.68:0/2911822040 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f240012e510 0x7f240013ca40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.179+0000 7f2404e04640 1 --2- 10.20.193.68:0/2911822040 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2400071400 0x7f24000717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.179+0000 7f2404e04640 1 -- 10.20.193.68:0/2911822040 >> 10.20.193.68:0/2911822040 conn(0x7f240009cee0 msgr2=0x7f240009d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:04.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.179+0000 7f2404e04640 1 -- 10.20.193.68:0/2911822040 shutdown_connections 2026-02-18T21:02:04.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.179+0000 7f2404e04640 1 -- 10.20.193.68:0/2911822040 wait complete. 2026-02-18T21:02:04.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f2404e04640 1 Processor -- start 2026-02-18T21:02:04.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f2404e04640 1 -- start start 2026-02-18T21:02:04.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f2404e04640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2400071400 0x7f2400135a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f2404e04640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2400071d20 0x7f2400135f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f2404e04640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f240012e510 0x7f2400136480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f2404e04640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f240012e990 con 0x7f2400071400 2026-02-18T21:02:04.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f2404e04640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f240012eb10 con 0x7f240012e510 2026-02-18T21:02:04.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f2404e04640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f240012ec90 con 0x7f2400071d20 2026-02-18T21:02:04.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f23fdd74640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2400071d20 0x7f2400135f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f23fe575640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2400071400 0x7f2400135a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f23fed76640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f240012e510 0x7f2400136480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f23fe575640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2400071400 0x7f2400135a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:47262/0 (socket says 10.20.193.68:47262) 2026-02-18T21:02:04.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f23fdd74640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2400071d20 0x7f2400135f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:39586/0 (socket says 10.20.193.68:39586) 2026-02-18T21:02:04.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f23fe575640 1 -- 10.20.193.68:0/3096634842 learned_addr learned my addr 10.20.193.68:0/3096634842 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:04.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f23fed76640 1 -- 10.20.193.68:0/3096634842 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2400071d20 msgr2=0x7f2400135f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f23fed76640 1 --2- 10.20.193.68:0/3096634842 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2400071d20 0x7f2400135f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f23fed76640 1 -- 10.20.193.68:0/3096634842 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2400071400 msgr2=0x7f2400135a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f23fed76640 1 --2- 10.20.193.68:0/3096634842 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2400071400 0x7f2400135a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f23fed76640 1 -- 10.20.193.68:0/3096634842 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2400137800 con 0x7f240012e510 2026-02-18T21:02:04.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f23fed76640 1 --2- 10.20.193.68:0/3096634842 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f240012e510 0x7f2400136480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f23f0036000 tx=0x7f23f0004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:04.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.180+0000 7f23e6ffd640 1 -- 10.20.193.68:0/3096634842 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f003c050 con 0x7f240012e510 2026-02-18T21:02:04.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.181+0000 7f23e6ffd640 1 -- 10.20.193.68:0/3096634842 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f0048070 con 0x7f240012e510 2026-02-18T21:02:04.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.181+0000 7f2404e04640 1 -- 10.20.193.68:0/3096634842 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240011a150 con 0x7f240012e510 2026-02-18T21:02:04.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.181+0000 7f23e6ffd640 1 -- 10.20.193.68:0/3096634842 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0041a30 con 0x7f240012e510 2026-02-18T21:02:04.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.181+0000 7f2404e04640 1 -- 10.20.193.68:0/3096634842 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2400136ed0 con 0x7f240012e510 2026-02-18T21:02:04.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.181+0000 7f2404e04640 1 -- 10.20.193.68:0/3096634842 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24001382b0 con 0x7f240012e510 2026-02-18T21:02:04.188 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.181+0000 7f23e6ffd640 1 -- 10.20.193.68:0/3096634842 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 6) ==== 59491+0+0 (secure 0 0 0) 0x7f23f0041bd0 con 0x7f240012e510 2026-02-18T21:02:04.188 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.182+0000 7f23fe575640 1 -- 10.20.193.68:0/3096634842 >> v1:10.20.193.68:6816/24610 conn(0x7f23cc04d6b0 legacy=0x7f23cc04fb70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.68:6816/24610 2026-02-18T21:02:04.188 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.182+0000 7f23e6ffd640 1 -- 10.20.193.68:0/3096634842 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 2834+0+0 (secure 0 0 0) 0x7f23f0089f00 con 0x7f240012e510 2026-02-18T21:02:04.188 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.184+0000 7f23e6ffd640 1 -- 10.20.193.68:0/3096634842 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+144236 (secure 0 0 0) 0x7f24001382b0 con 0x7f240012e510 2026-02-18T21:02:04.188 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.185+0000 7f7b98017140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-18T21:02:04.189 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.188+0000 7f9f2700e140 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2026-02-18T21:02:04.216 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.215+0000 7f9f2700e140 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2026-02-18T21:02:04.238 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.237+0000 7f9f2700e140 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2026-02-18T21:02:04.246 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.245+0000 7f7b98017140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-18T21:02:04.249 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.248+0000 7f2404e04640 1 -- 10.20.193.68:0/3096634842 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f24000717e0 con 0x7f240012e510 2026-02-18T21:02:04.249 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.248+0000 7f23e6ffd640 1 -- 10.20.193.68:0/3096634842 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+8618 (secure 0 0 0) 0x7f2400137800 con 0x7f240012e510 2026-02-18T21:02:04.250 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:04.250 INFO:teuthology.orchestra.run.trial068.stdout:{"epoch":18,"fsid":"73558818-cfd1-494a-84aa-56d128598ef4","created":"2026-02-18T21:01:11.071818+0000","modified":"2026-02-18T21:01:35.860597+0000","last_up_change":"2026-02-18T21:01:19.437203+0000","last_in_change":"2026-02-18T21:01:11.803245+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-18T21:01:20.913845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-18T21:01:25.650381+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5f8e54-3a43-41d6-b266-aa412a7f170e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6809","nonce":25183}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6811","nonce":25183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6814","nonce":25183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6812","nonce":25183}]},"public_addr":"10.20.193.68:6809/25183","cluster_addr":"10.20.193.68:6811/25183","heartbeat_back_addr":"10.20.193.68:6814/25183","heartbeat_front_addr":"10.20.193.68:6812/25183","state":["exists","up"]},{"osd":1,"uuid":"e26d8762-250e-42e7-8768-23caa22edb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6808","nonce":25184}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6810","nonce":25184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6815","nonce":25184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6813","nonce":25184}]},"public_addr":"10.20.193.68:6808/25184","cluster_addr":"10.20.193.68:6810/25184","heartbeat_back_addr":"10.20.193.68:6815/25184","heartbeat_front_addr":"10.20.193.68:6813/25184","state":["exists","up"]},{"osd":2,"uuid":"568ee96d-39ac-4d79-92bb-d1f3f12601b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6800","nonce":25185}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6801","nonce":25185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6803","nonce":25185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6802","nonce":25185}]},"public_addr":"10.20.193.68:6800/25185","cluster_addr":"10.20.193.68:6801/25185","heartbeat_back_addr":"10.20.193.68:6803/25185","heartbeat_front_addr":"10.20.193.68:6802/25185","state":["exists","up"]},{"osd":3,"uuid":"765a38cd-f526-4aba-b94e-c57076ca6c72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6804","nonce":25186}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6805","nonce":25186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6807","nonce":25186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6806","nonce":25186}]},"public_addr":"10.20.193.68:6804/25186","cluster_addr":"10.20.193.68:6805/25186","heartbeat_back_addr":"10.20.193.68:6807/25186","heartbeat_front_addr":"10.20.193.68:6806/25186","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T21:02:04.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.249+0000 7f2404e04640 1 -- 10.20.193.68:0/3096634842 >> v1:10.20.193.68:6816/24610 conn(0x7f23cc04d6b0 legacy=0x7f23cc04fb70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-18T21:02:04.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.249+0000 7f2404e04640 1 -- 10.20.193.68:0/3096634842 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f240012e510 msgr2=0x7f2400136480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.249+0000 7f2404e04640 1 --2- 10.20.193.68:0/3096634842 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f240012e510 0x7f2400136480 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f23f0036000 tx=0x7f23f0004b40 comp rx=0 tx=0).stop 2026-02-18T21:02:04.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.249+0000 7f2404e04640 1 -- 10.20.193.68:0/3096634842 shutdown_connections 2026-02-18T21:02:04.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.249+0000 7f2404e04640 1 --2- 10.20.193.68:0/3096634842 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f240012e510 0x7f2400136480 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.249+0000 7f2404e04640 1 --2- 10.20.193.68:0/3096634842 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2400071d20 0x7f2400135f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.249+0000 7f2404e04640 1 --2- 10.20.193.68:0/3096634842 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2400071400 0x7f2400135a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.250+0000 7f2404e04640 1 -- 10.20.193.68:0/3096634842 >> 10.20.193.68:0/3096634842 conn(0x7f240009cee0 msgr2=0x7f24001342e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:04.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.250+0000 7f2404e04640 1 -- 10.20.193.68:0/3096634842 shutdown_connections 2026-02-18T21:02:04.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.250+0000 7f2404e04640 1 -- 10.20.193.68:0/3096634842 wait complete. 2026-02-18T21:02:04.260 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-18T21:02:04.260 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-18T21:02:04.261 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-18T21:02:04.261 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-18T21:02:04.264 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.263+0000 7f9f2700e140 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2026-02-18T21:02:04.273 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.272+0000 7f7b98017140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-18T21:02:04.319 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.318+0000 7f9f2700e140 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2026-02-18T21:02:04.326 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.325+0000 7f7b98017140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-18T21:02:04.335 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7f2d881fd640 1 Processor -- start 2026-02-18T21:02:04.335 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7fd7dfe04640 1 Processor -- start 2026-02-18T21:02:04.336 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7f2d881fd640 1 -- start start 2026-02-18T21:02:04.336 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7fd7dfe04640 1 -- start start 2026-02-18T21:02:04.336 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7fd7dfe04640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fd7d8137850 0x7fd7d8139c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.336 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7fd7dfe04640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd7d813a180 0x7fd7d813c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.336 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7fd7dfe04640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7d809e050 con 0x7fd7d8134a00 2026-02-18T21:02:04.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7fd7dfe04640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7fd7d8134540 con 0x7fd7d8137850 2026-02-18T21:02:04.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7fd7dfe04640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fd7d8073e60 con 0x7fd7d813a180 2026-02-18T21:02:04.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7f54f3fa5640 1 Processor -- start 2026-02-18T21:02:04.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7f54f3fa5640 1 -- start start 2026-02-18T21:02:04.338 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7f2d881fd640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2d80073680 0x7f2d80133050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.338 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7f2d881fd640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f2d80133590 0x7f2d80135980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.338 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7f2d881fd640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d8012a7b0 con 0x7f2d8012ac90 2026-02-18T21:02:04.338 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7f2d881fd640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f2d80073e60 con 0x7f2d80133590 2026-02-18T21:02:04.338 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7f2d881fd640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f2d80072d10 con 0x7f2d80073680 2026-02-18T21:02:04.339 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7fd7dd378640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fd7d8137850 0x7fd7d8139c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.339 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7fd7de37a640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd7d813a180 0x7fd7d813c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.339 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7fd7dd378640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fd7d8137850 0x7fd7d8139c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:47266/0 (socket says 10.20.193.68:47266) 2026-02-18T21:02:04.339 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7fd7dd378640 1 -- 10.20.193.68:0/3754900104 learned_addr learned my addr 10.20.193.68:0/3754900104 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:04.339 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7f2d85f72640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f2d8012ac90 0x7f2d8012b070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:50618/0 (socket says 10.20.193.68:50618) 2026-02-18T21:02:04.340 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7f2d85f72640 1 -- 10.20.193.68:0/927504383 learned_addr learned my addr 10.20.193.68:0/927504383 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:04.340 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7f2d85771640 1 --2- 10.20.193.68:0/927504383 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2d80073680 0x7f2d80133050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.340 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.334+0000 7f2d86773640 1 --2- 10.20.193.68:0/927504383 >> v2:10.20.193.68:3300/0 conn(0x7f2d80133590 0x7f2d80135980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.340 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7fd7dd378640 1 -- 10.20.193.68:0/3754900104 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd7d813a180 msgr2=0x7fd7d813c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:04.340 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7fd7dd378640 1 --2- 10.20.193.68:0/3754900104 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd7d813a180 0x7fd7d813c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.341 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7fd7dd378640 1 -- 10.20.193.68:0/3754900104 >> v1:10.20.193.68:6789/0 conn(0x7fd7d8134a00 legacy=0x7fd7d8134de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.341 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7fd7dd378640 1 -- 10.20.193.68:0/3754900104 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d8073060 con 0x7fd7d8137850 2026-02-18T21:02:04.341 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f2d84f70640 1 -- 10.20.193.68:0/927504383 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2282492297 0 0) 0x7f2d8012a7b0 con 0x7f2d8012ac90 2026-02-18T21:02:04.341 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f2d84f70640 1 -- 10.20.193.68:0/927504383 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d68003620 con 0x7f2d8012ac90 2026-02-18T21:02:04.341 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f2d85771640 1 -- 10.20.193.68:0/927504383 >> v2:10.20.193.68:3300/0 conn(0x7f2d80133590 msgr2=0x7f2d80135980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:04.341 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f2d85771640 1 --2- 10.20.193.68:0/927504383 >> v2:10.20.193.68:3300/0 conn(0x7f2d80133590 0x7f2d80135980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.342 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f2d85771640 1 -- 10.20.193.68:0/927504383 >> v1:10.20.193.68:6789/0 conn(0x7f2d8012ac90 legacy=0x7f2d8012b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.342 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f2d85771640 1 -- 10.20.193.68:0/927504383 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d80136ed0 con 0x7f2d80073680 2026-02-18T21:02:04.343 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f54f3fa5640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f54ec12d090 0x7f54ec12d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.343 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f54f3fa5640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f54ec130060 0x7f54ec1304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.343 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f54f3fa5640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f54ec1309e0 0x7f54ec1373f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.343 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f54f3fa5640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f54ec0730a0 con 0x7f54ec1309e0 2026-02-18T21:02:04.343 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f54f3fa5640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f54ec130e90 con 0x7f54ec130060 2026-02-18T21:02:04.343 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f54f3fa5640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f54ec0726d0 con 0x7f54ec12d090 2026-02-18T21:02:04.343 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f54f1d1a640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f54ec12d090 0x7f54ec12d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.344 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f54f251b640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f54ec1309e0 0x7f54ec1373f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.344 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f54f1d1a640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f54ec12d090 0x7f54ec12d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:39608/0 (socket says 10.20.193.68:39608) 2026-02-18T21:02:04.344 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f54f1d1a640 1 -- 10.20.193.68:0/3123065218 learned_addr learned my addr 10.20.193.68:0/3123065218 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:04.344 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f54f1519640 1 --2- 10.20.193.68:0/3123065218 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f54ec130060 0x7f54ec1304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.344 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f54f1d1a640 1 -- 10.20.193.68:0/3123065218 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f54ec130060 msgr2=0x7f54ec1304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:04.344 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f54f1d1a640 1 --2- 10.20.193.68:0/3123065218 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f54ec130060 0x7f54ec1304a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.344 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f54f1d1a640 1 -- 10.20.193.68:0/3123065218 >> v2:10.20.193.68:3300/0 conn(0x7f54ec1309e0 msgr2=0x7f54ec1373f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:04.344 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f54f1d1a640 1 --2- 10.20.193.68:0/3123065218 >> v2:10.20.193.68:3300/0 conn(0x7f54ec1309e0 0x7f54ec1373f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.344 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f54f1d1a640 1 -- 10.20.193.68:0/3123065218 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ec074190 con 0x7f54ec12d090 2026-02-18T21:02:04.345 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7fd7714a2640 1 Processor -- start 2026-02-18T21:02:04.345 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7fd7dd378640 1 --2- 10.20.193.68:0/3754900104 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd7d8137850 0x7fd7d8139c40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc009970 tx=0x7fd7cc02ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcc3cd8942fc5b8 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:04.345 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7fd7714a2640 1 -- start start 2026-02-18T21:02:04.346 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f2d85771640 1 --2- 10.20.193.68:0/927504383 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2d80073680 0x7f2d80133050 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2d740098a0 tx=0x7f2d7402ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=180cad72706c14eb server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:04.346 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7fd7dcb77640 1 -- 10.20.193.68:0/3754900104 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc03c070 con 0x7fd7d8137850 2026-02-18T21:02:04.346 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7fd7dcb77640 1 -- 10.20.193.68:0/3754900104 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7cc02fb10 con 0x7fd7d8137850 2026-02-18T21:02:04.346 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7fd7dcb77640 1 -- 10.20.193.68:0/3754900104 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc037440 con 0x7fd7d8137850 2026-02-18T21:02:04.347 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f2d84f70640 1 -- 10.20.193.68:0/927504383 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7403c070 con 0x7f2d80073680 2026-02-18T21:02:04.347 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f2d84f70640 1 -- 10.20.193.68:0/927504383 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d7402fa40 con 0x7f2d80073680 2026-02-18T21:02:04.347 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f2d84f70640 1 -- 10.20.193.68:0/927504383 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7402fe10 con 0x7f2d80073680 2026-02-18T21:02:04.347 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f54f1d1a640 1 --2- 10.20.193.68:0/3123065218 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f54ec12d090 0x7f54ec12d470 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0099a0 tx=0x7f54dc02eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee9de90dc7eb4ef2 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:04.348 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7fd7714a2640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fd76c12ac90 0x7fd76c12b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.348 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7fd7714a2640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd76c073680 0x7fd76c071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.348 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7fd7714a2640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd76c12a7b0 con 0x7fd76c071960 2026-02-18T21:02:04.348 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7fd7714a2640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7fd76c073e60 con 0x7fd76c12ac90 2026-02-18T21:02:04.348 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7fd7dfe04640 1 -- 10.20.193.68:0/3754900104 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd7d8137850 msgr2=0x7fd7d8139c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.349 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7fd7dfe04640 1 --2- 10.20.193.68:0/3754900104 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd7d8137850 0x7fd7d8139c40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc009970 tx=0x7fd7cc02ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:04.349 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7fd7714a2640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fd76c072d10 con 0x7fd76c073680 2026-02-18T21:02:04.349 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f2d881fd640 1 -- 10.20.193.68:0/927504383 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2d80073680 msgr2=0x7f2d80133050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.349 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f2d881fd640 1 --2- 10.20.193.68:0/927504383 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2d80073680 0x7f2d80133050 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2d740098a0 tx=0x7f2d7402ed80 comp rx=0 tx=0).stop 2026-02-18T21:02:04.350 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7f54f0d18640 1 -- 10.20.193.68:0/3123065218 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc03c070 con 0x7f54ec12d090 2026-02-18T21:02:04.350 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7fd76affd640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fd76c12ac90 0x7fd76c12b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.350 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f54f0d18640 1 -- 10.20.193.68:0/3123065218 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54dc02fb20 con 0x7f54ec12d090 2026-02-18T21:02:04.350 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f54f0d18640 1 -- 10.20.193.68:0/3123065218 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc037440 con 0x7f54ec12d090 2026-02-18T21:02:04.351 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7fd76b7fe640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fd76c071960 0x7fd76c135060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:50632/0 (socket says 10.20.193.68:50632) 2026-02-18T21:02:04.351 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd76b7fe640 1 -- 10.20.193.68:0/948967882 learned_addr learned my addr 10.20.193.68:0/948967882 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:04.351 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.335+0000 7fd7dfe04640 1 -- 10.20.193.68:0/3754900104 shutdown_connections 2026-02-18T21:02:04.351 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd7dfe04640 1 --2- 10.20.193.68:0/3754900104 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd7d813a180 0x7fd7d813c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.351 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd7dfe04640 1 --2- 10.20.193.68:0/3754900104 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd7d8137850 0x7fd7d8139c40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.352 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f2d881fd640 1 -- 10.20.193.68:0/927504383 shutdown_connections 2026-02-18T21:02:04.352 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd7dfe04640 1 -- 10.20.193.68:0/3754900104 >> 10.20.193.68:0/3754900104 conn(0x7fd7d809cea0 msgr2=0x7fd7d809d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:04.352 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f2d881fd640 1 --2- 10.20.193.68:0/927504383 >> v2:10.20.193.68:3300/0 conn(0x7f2d80133590 0x7f2d80135980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.352 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f2d881fd640 1 --2- 10.20.193.68:0/927504383 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2d80073680 0x7f2d80133050 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.352 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f2d881fd640 1 -- 10.20.193.68:0/927504383 >> 10.20.193.68:0/927504383 conn(0x7f2d8009cea0 msgr2=0x7f2d8009d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:04.353 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd76a7fc640 1 --2- 10.20.193.68:0/948967882 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd76c073680 0x7fd76c071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.353 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd7dfe04640 1 -- 10.20.193.68:0/3754900104 shutdown_connections 2026-02-18T21:02:04.353 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd7dfe04640 1 -- 10.20.193.68:0/3754900104 wait complete. 2026-02-18T21:02:04.354 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f2d881fd640 1 -- 10.20.193.68:0/927504383 shutdown_connections 2026-02-18T21:02:04.354 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f2d881fd640 1 -- 10.20.193.68:0/927504383 wait complete. 2026-02-18T21:02:04.355 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd76affd640 1 -- 10.20.193.68:0/948967882 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd76c073680 msgr2=0x7fd76c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:04.355 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd769ffb640 1 -- 10.20.193.68:0/948967882 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3447852277 0 0) 0x7fd76c12a7b0 con 0x7fd76c071960 2026-02-18T21:02:04.355 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd76affd640 1 --2- 10.20.193.68:0/948967882 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd76c073680 0x7fd76c071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.355 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd76affd640 1 -- 10.20.193.68:0/948967882 >> v1:10.20.193.68:6789/0 conn(0x7fd76c071960 legacy=0x7fd76c135060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.355 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd76affd640 1 -- 10.20.193.68:0/948967882 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76c12b5b0 con 0x7fd76c12ac90 2026-02-18T21:02:04.356 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f54f3fa5640 1 -- 10.20.193.68:0/3123065218 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f54ec12d090 msgr2=0x7f54ec12d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.356 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f54f3fa5640 1 --2- 10.20.193.68:0/3123065218 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f54ec12d090 0x7f54ec12d470 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0099a0 tx=0x7f54dc02eef0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.356 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f54f3fa5640 1 -- 10.20.193.68:0/3123065218 shutdown_connections 2026-02-18T21:02:04.356 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f54f3fa5640 1 --2- 10.20.193.68:0/3123065218 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f54ec130060 0x7f54ec1304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.356 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f54f3fa5640 1 --2- 10.20.193.68:0/3123065218 >> v2:10.20.193.68:3300/0 conn(0x7f54ec1309e0 0x7f54ec1373f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.356 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f54f3fa5640 1 --2- 10.20.193.68:0/3123065218 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f54ec12d090 0x7f54ec12d470 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.356 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f54f3fa5640 1 -- 10.20.193.68:0/3123065218 >> 10.20.193.68:0/3123065218 conn(0x7f54ec0a1c00 msgr2=0x7f54ec0a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:04.357 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f54f3fa5640 1 -- 10.20.193.68:0/3123065218 shutdown_connections 2026-02-18T21:02:04.357 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f54f3fa5640 1 -- 10.20.193.68:0/3123065218 wait complete. 2026-02-18T21:02:04.357 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd76affd640 1 --2- 10.20.193.68:0/948967882 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd76c12ac90 0x7fd76c12b070 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd7600098a0 tx=0x7fd76002ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254d072a32ef39b3 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:04.357 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd7dfe04640 1 Processor -- start 2026-02-18T21:02:04.358 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f2d881fd640 1 Processor -- start 2026-02-18T21:02:04.358 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f2d881fd640 1 -- start start 2026-02-18T21:02:04.358 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd7dfe04640 1 -- start start 2026-02-18T21:02:04.359 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd769ffb640 1 -- 10.20.193.68:0/948967882 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76003c070 con 0x7fd76c12ac90 2026-02-18T21:02:04.359 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd769ffb640 1 -- 10.20.193.68:0/948967882 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd76002fa40 con 0x7fd76c12ac90 2026-02-18T21:02:04.359 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd769ffb640 1 -- 10.20.193.68:0/948967882 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76002fe10 con 0x7fd76c12ac90 2026-02-18T21:02:04.359 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f2d881fd640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2d80073680 0x7f2d8006fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.359 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f2d881fd640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2d8012ac90 0x7f2d8006ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.360 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7f2d881fd640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2d80133590 0x7f2d801c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.360 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd7dfe04640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd7d8134a00 0x7fd7d8070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.360 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd7dfe04640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd7d8137850 0x7fd7d8071220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.360 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.336+0000 7fd7dfe04640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd7d813a180 0x7fd7d8071760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.361 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7fd7dfe04640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d813cc30 con 0x7fd7d8137850 2026-02-18T21:02:04.361 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7fd7dfe04640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d813cab0 con 0x7fd7d8134a00 2026-02-18T21:02:04.361 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f2d85771640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2d8012ac90 0x7f2d8006ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.361 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7fd7dfe04640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fd7d813cdb0 con 0x7fd7d813a180 2026-02-18T21:02:04.362 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f54f3fa5640 1 Processor -- start 2026-02-18T21:02:04.362 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f2d85771640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2d8012ac90 0x7f2d8006ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:47310/0 (socket says 10.20.193.68:47310) 2026-02-18T21:02:04.362 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f2d881fd640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f2d80136250 con 0x7f2d8012ac90 2026-02-18T21:02:04.362 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f2d881fd640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f2d801360d0 con 0x7f2d80133590 2026-02-18T21:02:04.362 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f2d85771640 1 -- 10.20.193.68:0/1905257236 learned_addr learned my addr 10.20.193.68:0/1905257236 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:04.362 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f2d881fd640 1 -- 10.20.193.68:0/1905257236 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f2d801363d0 con 0x7f2d80073680 2026-02-18T21:02:04.363 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f2d85f72640 1 --2- 10.20.193.68:0/1905257236 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2d80073680 0x7f2d8006fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.363 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f2d86773640 1 --2- 10.20.193.68:0/1905257236 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2d80133590 0x7f2d801c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.363 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7fd7ddb79640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd7d8134a00 0x7fd7d8070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.363 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7fd7714a2640 1 -- 10.20.193.68:0/948967882 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd76c12ac90 msgr2=0x7fd76c12b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.363 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7fd7714a2640 1 --2- 10.20.193.68:0/948967882 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd76c12ac90 0x7fd76c12b070 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd7600098a0 tx=0x7fd76002ed80 comp rx=0 tx=0).stop 2026-02-18T21:02:04.364 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7fd7ddb79640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd7d8134a00 0x7fd7d8070ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:39030/0 (socket says 10.20.193.68:39030) 2026-02-18T21:02:04.364 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7fd7ddb79640 1 -- 10.20.193.68:0/771916951 learned_addr learned my addr 10.20.193.68:0/771916951 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:04.364 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7fd7de37a640 1 --2- 10.20.193.68:0/771916951 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd7d813a180 0x7fd7d8071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.364 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7fd7dd378640 1 --2- 10.20.193.68:0/771916951 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd7d8137850 0x7fd7d8071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.365 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7fd7714a2640 1 -- 10.20.193.68:0/948967882 shutdown_connections 2026-02-18T21:02:04.365 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7fd7714a2640 1 --2- 10.20.193.68:0/948967882 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd76c073680 0x7fd76c071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.365 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7fd7714a2640 1 --2- 10.20.193.68:0/948967882 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd76c12ac90 0x7fd76c12b070 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.365 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7fd7714a2640 1 -- 10.20.193.68:0/948967882 >> 10.20.193.68:0/948967882 conn(0x7fd76c09cea0 msgr2=0x7fd76c09d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:04.365 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7fd7714a2640 1 -- 10.20.193.68:0/948967882 shutdown_connections 2026-02-18T21:02:04.365 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7fd7714a2640 1 -- 10.20.193.68:0/948967882 wait complete. 2026-02-18T21:02:04.366 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f54f3fa5640 1 -- start start 2026-02-18T21:02:04.366 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f2d85771640 1 -- 10.20.193.68:0/1905257236 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2d80073680 msgr2=0x7f2d8006fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.366 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f2d85771640 1 --2- 10.20.193.68:0/1905257236 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2d80073680 0x7f2d8006fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.366 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f2d85771640 1 -- 10.20.193.68:0/1905257236 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2d80133590 msgr2=0x7f2d801c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.366 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f2d85771640 1 --2- 10.20.193.68:0/1905257236 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2d80133590 0x7f2d801c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.366 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f2d85771640 1 -- 10.20.193.68:0/1905257236 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d80124e10 con 0x7f2d8012ac90 2026-02-18T21:02:04.366 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f2d86773640 1 --2- 10.20.193.68:0/1905257236 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2d80133590 0x7f2d801c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:04.367 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7fd7de37a640 1 -- 10.20.193.68:0/771916951 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd7d8134a00 msgr2=0x7fd7d8070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.367 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f2d85771640 1 --2- 10.20.193.68:0/1905257236 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2d8012ac90 0x7f2d8006ff70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2d74009130 tx=0x7f2d740047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:04.368 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f2d6e7fc640 1 -- 10.20.193.68:0/1905257236 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7403c040 con 0x7f2d8012ac90 2026-02-18T21:02:04.368 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f2d6e7fc640 1 -- 10.20.193.68:0/1905257236 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d74042450 con 0x7f2d8012ac90 2026-02-18T21:02:04.368 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f2d881fd640 1 -- 10.20.193.68:0/1905257236 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d80071140 con 0x7f2d8012ac90 2026-02-18T21:02:04.368 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f2d6e7fc640 1 -- 10.20.193.68:0/1905257236 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d74042820 con 0x7f2d8012ac90 2026-02-18T21:02:04.368 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f2d881fd640 1 -- 10.20.193.68:0/1905257236 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d800704b0 con 0x7f2d8012ac90 2026-02-18T21:02:04.368 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7fd7714a2640 1 Processor -- start 2026-02-18T21:02:04.368 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7fd7714a2640 1 -- start start 2026-02-18T21:02:04.369 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f54f3fa5640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f54ec12d090 0x7f54ec11c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.369 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f54f3fa5640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f54ec130060 0x7f54ec11ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.369 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f54f1d1a640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f54ec12d090 0x7f54ec11c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.369 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f54f1d1a640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f54ec12d090 0x7f54ec11c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:39634/0 (socket says 10.20.193.68:39634) 2026-02-18T21:02:04.369 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f54f1d1a640 1 -- 10.20.193.68:0/2134071392 learned_addr learned my addr 10.20.193.68:0/2134071392 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:04.370 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.337+0000 7f54f1519640 1 --2- 10.20.193.68:0/2134071392 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f54ec130060 0x7f54ec11ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.370 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f54f3fa5640 1 --2- 10.20.193.68:0/2134071392 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f54ec1309e0 0x7f54ec11cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.370 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f54f3fa5640 1 -- 10.20.193.68:0/2134071392 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec12cdb0 con 0x7f54ec130060 2026-02-18T21:02:04.370 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f54f3fa5640 1 -- 10.20.193.68:0/2134071392 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f54ec073f40 con 0x7f54ec1309e0 2026-02-18T21:02:04.370 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7714a2640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd76c071960 0x7fd76c123d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.370 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7714a2640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd76c073680 0x7fd76c124250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.370 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7714a2640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd76c12ac90 0x7fd76c124790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.371 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f54f3fa5640 1 -- 10.20.193.68:0/2134071392 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f54ec072aa0 con 0x7f54ec12d090 2026-02-18T21:02:04.371 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7714a2640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fd76c072180 con 0x7fd76c071960 2026-02-18T21:02:04.371 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7714a2640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fd76c072000 con 0x7fd76c073680 2026-02-18T21:02:04.371 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7714a2640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fd76c136780 con 0x7fd76c12ac90 2026-02-18T21:02:04.371 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f2d47fff640 1 -- 10.20.193.68:0/1905257236 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2d40001030 con 0x7f2d8012ac90 2026-02-18T21:02:04.372 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7de37a640 1 --2- 10.20.193.68:0/771916951 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd7d8134a00 0x7fd7d8070ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.372 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7de37a640 1 -- 10.20.193.68:0/771916951 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd7d8137850 msgr2=0x7fd7d8071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.372 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd76a7fc640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd76c073680 0x7fd76c124250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.372 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7de37a640 1 --2- 10.20.193.68:0/771916951 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd7d8137850 0x7fd7d8071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.372 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7de37a640 1 -- 10.20.193.68:0/771916951 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d8116b40 con 0x7fd7d813a180 2026-02-18T21:02:04.373 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f54f251b640 1 --2- 10.20.193.68:0/2134071392 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f54ec1309e0 0x7f54ec11cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.373 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd76affd640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd76c071960 0x7fd76c123d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.373 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd76a7fc640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd76c073680 0x7fd76c124250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:39056/0 (socket says 10.20.193.68:39056) 2026-02-18T21:02:04.373 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd76a7fc640 1 -- 10.20.193.68:0/3645818092 learned_addr learned my addr 10.20.193.68:0/3645818092 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:04.373 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7dd378640 1 --2- 10.20.193.68:0/771916951 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd7d8137850 0x7fd7d8071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:04.373 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7ddb79640 1 --2- 10.20.193.68:0/771916951 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd7d8134a00 0x7fd7d8070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:04.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f54f1d1a640 1 -- 10.20.193.68:0/2134071392 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f54ec1309e0 msgr2=0x7f54ec11cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f54f1d1a640 1 --2- 10.20.193.68:0/2134071392 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f54ec1309e0 0x7f54ec11cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f54f1d1a640 1 -- 10.20.193.68:0/2134071392 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f54ec130060 msgr2=0x7f54ec11ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f54f1d1a640 1 --2- 10.20.193.68:0/2134071392 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f54ec130060 0x7f54ec11ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f2d6e7fc640 1 -- 10.20.193.68:0/1905257236 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 6) ==== 59491+0+0 (secure 0 0 0) 0x7f2d7404b410 con 0x7f2d8012ac90 2026-02-18T21:02:04.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd76b7fe640 1 --2- 10.20.193.68:0/3645818092 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd76c12ac90 0x7fd76c124790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f54f1d1a640 1 -- 10.20.193.68:0/2134071392 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ec11eb60 con 0x7f54ec12d090 2026-02-18T21:02:04.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f54f251b640 1 --2- 10.20.193.68:0/2134071392 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f54ec1309e0 0x7f54ec11cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-18T21:02:04.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7de37a640 1 --2- 10.20.193.68:0/771916951 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd7d813a180 0x7fd7d8071760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400ef90 tx=0x7fd7d400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:04.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f54f1d1a640 1 --2- 10.20.193.68:0/2134071392 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f54ec12d090 0x7f54ec11c4f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f54dc02ef30 tx=0x7f54dc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:04.376 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7c67fc640 1 -- 10.20.193.68:0/771916951 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4018020 con 0x7fd7d813a180 2026-02-18T21:02:04.376 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd76a7fc640 1 -- 10.20.193.68:0/3645818092 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd76c12ac90 msgr2=0x7fd76c124790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.376 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd76a7fc640 1 --2- 10.20.193.68:0/3645818092 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd76c12ac90 0x7fd76c124790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.376 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd76a7fc640 1 -- 10.20.193.68:0/3645818092 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd76c071960 msgr2=0x7fd76c123d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.376 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd76a7fc640 1 --2- 10.20.193.68:0/3645818092 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd76c071960 0x7fd76c123d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.376 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7dfe04640 1 -- 10.20.193.68:0/771916951 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d8116830 con 0x7fd7d813a180 2026-02-18T21:02:04.376 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd76a7fc640 1 -- 10.20.193.68:0/3645818092 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76c11dd60 con 0x7fd76c073680 2026-02-18T21:02:04.377 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd76affd640 1 --2- 10.20.193.68:0/3645818092 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd76c071960 0x7fd76c123d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-18T21:02:04.377 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7c67fc640 1 -- 10.20.193.68:0/771916951 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d4014480 con 0x7fd7d813a180 2026-02-18T21:02:04.377 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7c67fc640 1 -- 10.20.193.68:0/771916951 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4014830 con 0x7fd7d813a180 2026-02-18T21:02:04.377 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f2d85f72640 1 -- 10.20.193.68:0/1905257236 >> v1:10.20.193.68:6816/24610 conn(0x7f2d5004d6b0 legacy=0x7f2d5004fb70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.68:6816/24610 2026-02-18T21:02:04.377 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7dfe04640 1 -- 10.20.193.68:0/771916951 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d811a8d0 con 0x7fd7d813a180 2026-02-18T21:02:04.378 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f54da7fc640 1 -- 10.20.193.68:0/2134071392 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc047070 con 0x7f54ec12d090 2026-02-18T21:02:04.378 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f2d6e7fc640 1 -- 10.20.193.68:0/1905257236 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2834+0+0 (secure 0 0 0) 0x7f2d74088db0 con 0x7f2d8012ac90 2026-02-18T21:02:04.378 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd76a7fc640 1 --2- 10.20.193.68:0/3645818092 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd76c073680 0x7fd76c124250 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd75400e8c0 tx=0x7fd75400ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:04.378 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f2d6e7fc640 1 -- 10.20.193.68:0/1905257236 --> v1:10.20.193.68:6808/25184 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d74048e70 con 0x7f2d50053d30 2026-02-18T21:02:04.378 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f2d6e7fc640 1 -- 10.20.193.68:0/1905257236 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f2d7408b4b0 con 0x7f2d8012ac90 2026-02-18T21:02:04.379 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f54f3fa5640 1 -- 10.20.193.68:0/2134071392 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ec12a830 con 0x7f54ec12d090 2026-02-18T21:02:04.379 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f54da7fc640 1 -- 10.20.193.68:0/2134071392 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54dc004030 con 0x7f54ec12d090 2026-02-18T21:02:04.379 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f54da7fc640 1 -- 10.20.193.68:0/2134071392 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc03c040 con 0x7f54ec12d090 2026-02-18T21:02:04.379 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd74b7fe640 1 -- 10.20.193.68:0/3645818092 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754017070 con 0x7fd76c073680 2026-02-18T21:02:04.379 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd74b7fe640 1 -- 10.20.193.68:0/3645818092 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd75400c8e0 con 0x7fd76c073680 2026-02-18T21:02:04.379 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7714a2640 1 -- 10.20.193.68:0/3645818092 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd76c124cd0 con 0x7fd76c073680 2026-02-18T21:02:04.379 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7f54f3fa5640 1 -- 10.20.193.68:0/2134071392 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ec1c71a0 con 0x7f54ec12d090 2026-02-18T21:02:04.380 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7714a2640 1 -- 10.20.193.68:0/3645818092 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd76c118650 con 0x7fd76c073680 2026-02-18T21:02:04.380 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.338+0000 7fd7dfe04640 1 -- 10.20.193.68:0/771916951 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd7d811ab60 con 0x7fd7d813a180 2026-02-18T21:02:04.380 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.339+0000 7fd74b7fe640 1 -- 10.20.193.68:0/3645818092 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75400ccd0 con 0x7fd76c073680 2026-02-18T21:02:04.380 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.339+0000 7f54f3fa5640 1 -- 10.20.193.68:0/2134071392 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f54ec11fcb0 con 0x7f54ec12d090 2026-02-18T21:02:04.381 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.339+0000 7fd7714a2640 1 -- 10.20.193.68:0/3645818092 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd76c070b20 con 0x7fd76c073680 2026-02-18T21:02:04.381 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.339+0000 7fd7c67fc640 1 -- 10.20.193.68:0/771916951 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 6) ==== 59491+0+0 (secure 0 0 0) 0x7fd7d40149d0 con 0x7fd7d813a180 2026-02-18T21:02:04.381 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.339+0000 7f2d6e7fc640 1 -- 10.20.193.68:0/1905257236 <== osd.1 v1:10.20.193.68:6808/25184 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25011 (unknown 0 0 1028417783) 0x7f2d74048e70 con 0x7f2d50053d30 2026-02-18T21:02:04.381 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.339+0000 7fd7c67fc640 1 -- 10.20.193.68:0/771916951 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(18..18 src has 1..18) ==== 2834+0+0 (secure 0 0 0) 0x7fd7d4064cb0 con 0x7fd7d813a180 2026-02-18T21:02:04.381 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.339+0000 7fd74b7fe640 1 -- 10.20.193.68:0/3645818092 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 6) ==== 59491+0+0 (secure 0 0 0) 0x7fd754024060 con 0x7fd76c073680 2026-02-18T21:02:04.382 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.339+0000 7fd7c67fc640 1 -- 10.20.193.68:0/771916951 --> v1:10.20.193.68:6804/25186 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd7d4021ec0 con 0x7fd7a8053da0 2026-02-18T21:02:04.382 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.339+0000 7fd7c67fc640 1 -- 10.20.193.68:0/771916951 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fd7d4067250 con 0x7fd7d813a180 2026-02-18T21:02:04.382 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.339+0000 7fd76affd640 1 -- 10.20.193.68:0/3645818092 >> v1:10.20.193.68:6816/24610 conn(0x7fd73804d700 legacy=0x7fd73804fbc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.68:6816/24610 2026-02-18T21:02:04.382 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.339+0000 7fd74b7fe640 1 -- 10.20.193.68:0/3645818092 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 2834+0+0 (secure 0 0 0) 0x7fd754063d10 con 0x7fd76c073680 2026-02-18T21:02:04.382 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.339+0000 7fd74b7fe640 1 -- 10.20.193.68:0/3645818092 --> v1:10.20.193.68:6800/25185 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd75400be50 con 0x7fd738053df0 2026-02-18T21:02:04.382 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.340+0000 7fd74b7fe640 1 -- 10.20.193.68:0/3645818092 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fd754066460 con 0x7fd76c073680 2026-02-18T21:02:04.382 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.340+0000 7fd7ddb79640 1 -- 10.20.193.68:0/771916951 >> v1:10.20.193.68:6816/24610 conn(0x7fd7a804d6b0 legacy=0x7fd7a804fb70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.68:6816/24610 2026-02-18T21:02:04.382 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.340+0000 7fd7c67fc640 1 -- 10.20.193.68:0/771916951 <== osd.3 v1:10.20.193.68:6804/25186 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25011 (unknown 0 0 1028417783) 0x7fd7d4021ec0 con 0x7fd7a8053da0 2026-02-18T21:02:04.383 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.340+0000 7fd74b7fe640 1 -- 10.20.193.68:0/3645818092 <== osd.2 v1:10.20.193.68:6800/25185 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25011 (unknown 0 0 1028417783) 0x7fd75400be50 con 0x7fd738053df0 2026-02-18T21:02:04.383 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.339+0000 7f54da7fc640 1 -- 10.20.193.68:0/2134071392 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 6) ==== 59491+0+0 (secure 0 0 0) 0x7f54dc004400 con 0x7f54ec12d090 2026-02-18T21:02:04.383 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.339+0000 7f54f1519640 1 -- 10.20.193.68:0/2134071392 >> v1:10.20.193.68:6816/24610 conn(0x7f54bc04d6b0 legacy=0x7f54bc04fb70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.68:6816/24610 2026-02-18T21:02:04.383 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.339+0000 7f54da7fc640 1 -- 10.20.193.68:0/2134071392 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(18..18 src has 1..18) ==== 2834+0+0 (secure 0 0 0) 0x7f54dc089070 con 0x7f54ec12d090 2026-02-18T21:02:04.383 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.340+0000 7f54da7fc640 1 -- 10.20.193.68:0/2134071392 --> v1:10.20.193.68:6809/25183 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54bc057a00 con 0x7f54bc053d30 2026-02-18T21:02:04.383 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.340+0000 7f54da7fc640 1 -- 10.20.193.68:0/2134071392 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f54dc089500 con 0x7f54ec12d090 2026-02-18T21:02:04.383 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.340+0000 7f54da7fc640 1 -- 10.20.193.68:0/2134071392 <== osd.0 v1:10.20.193.68:6809/25183 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25011 (unknown 0 0 1028417783) 0x7f54bc057a00 con 0x7f54bc053d30 2026-02-18T21:02:04.383 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.346+0000 7f9f2700e140 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2026-02-18T21:02:04.384 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7f54f3fa5640 1 -- 10.20.193.68:0/2134071392 --> v1:10.20.193.68:6809/25183 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f54ec1c7650 con 0x7f54bc053d30 2026-02-18T21:02:04.384 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7fd7714a2640 1 -- 10.20.193.68:0/3645818092 --> v1:10.20.193.68:6800/25185 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd76c11e9e0 con 0x7fd738053df0 2026-02-18T21:02:04.384 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7f54da7fc640 1 -- 10.20.193.68:0/2134071392 <== osd.0 v1:10.20.193.68:6809/25183 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1990790089) 0x7f54ec1c7650 con 0x7f54bc053d30 2026-02-18T21:02:04.384 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7fd74b7fe640 1 -- 10.20.193.68:0/3645818092 <== osd.2 v1:10.20.193.68:6800/25185 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1710880829) 0x7fd76c11e9e0 con 0x7fd738053df0 2026-02-18T21:02:04.385 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7f54f3fa5640 1 -- 10.20.193.68:0/2134071392 >> v1:10.20.193.68:6809/25183 conn(0x7f54bc053d30 legacy=0x7f54bc056190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.385 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7f54f3fa5640 1 -- 10.20.193.68:0/2134071392 >> v1:10.20.193.68:6816/24610 conn(0x7f54bc04d6b0 legacy=0x7f54bc04fb70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-18T21:02:04.385 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7f54f3fa5640 1 -- 10.20.193.68:0/2134071392 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f54ec12d090 msgr2=0x7f54ec11c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.385 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7f54f3fa5640 1 --2- 10.20.193.68:0/2134071392 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f54ec12d090 0x7f54ec11c4f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f54dc02ef30 tx=0x7f54dc0047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.385 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7f54f251b640 1 -- 10.20.193.68:0/2134071392 reap_dead start 2026-02-18T21:02:04.385 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7f54f3fa5640 1 -- 10.20.193.68:0/2134071392 shutdown_connections 2026-02-18T21:02:04.385 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7f54f3fa5640 1 -- 10.20.193.68:0/2134071392 >> 10.20.193.68:0/2134071392 conn(0x7f54ec0a1c00 msgr2=0x7f54ec06e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:04.385 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7fd7714a2640 1 -- 10.20.193.68:0/3645818092 >> v1:10.20.193.68:6800/25185 conn(0x7fd738053df0 legacy=0x7fd738056250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.386 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7f54f3fa5640 1 -- 10.20.193.68:0/2134071392 shutdown_connections 2026-02-18T21:02:04.386 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7f54f3fa5640 1 -- 10.20.193.68:0/2134071392 wait complete. 2026-02-18T21:02:04.386 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7fd7714a2640 1 -- 10.20.193.68:0/3645818092 >> v1:10.20.193.68:6816/24610 conn(0x7fd73804d700 legacy=0x7fd73804fbc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-18T21:02:04.386 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7fd7714a2640 1 -- 10.20.193.68:0/3645818092 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd76c073680 msgr2=0x7fd76c124250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.386 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7fd7714a2640 1 --2- 10.20.193.68:0/3645818092 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd76c073680 0x7fd76c124250 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd75400e8c0 tx=0x7fd75400ed90 comp rx=0 tx=0).stop 2026-02-18T21:02:04.386 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7fd76b7fe640 1 -- 10.20.193.68:0/3645818092 reap_dead start 2026-02-18T21:02:04.386 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7fd7714a2640 1 -- 10.20.193.68:0/3645818092 shutdown_connections 2026-02-18T21:02:04.386 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7fd7714a2640 1 -- 10.20.193.68:0/3645818092 >> 10.20.193.68:0/3645818092 conn(0x7fd76c09cea0 msgr2=0x7fd76c11e050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:04.386 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7fd7714a2640 1 -- 10.20.193.68:0/3645818092 shutdown_connections 2026-02-18T21:02:04.386 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.347+0000 7fd7714a2640 1 -- 10.20.193.68:0/3645818092 wait complete. 2026-02-18T21:02:04.387 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.348+0000 7f2d47fff640 1 -- 10.20.193.68:0/1905257236 --> v1:10.20.193.68:6808/25184 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2d40002ed0 con 0x7f2d50053d30 2026-02-18T21:02:04.387 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.348+0000 7f2d6e7fc640 1 -- 10.20.193.68:0/1905257236 <== osd.1 v1:10.20.193.68:6808/25184 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2227341514) 0x7f2d40002ed0 con 0x7f2d50053d30 2026-02-18T21:02:04.387 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.348+0000 7f2d47fff640 1 -- 10.20.193.68:0/1905257236 >> v1:10.20.193.68:6808/25184 conn(0x7f2d50053d30 legacy=0x7f2d50056190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.388 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.348+0000 7f2d47fff640 1 -- 10.20.193.68:0/1905257236 >> v1:10.20.193.68:6816/24610 conn(0x7f2d5004d6b0 legacy=0x7f2d5004fb70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-18T21:02:04.388 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.348+0000 7f2d47fff640 1 -- 10.20.193.68:0/1905257236 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2d8012ac90 msgr2=0x7f2d8006ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.388 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.348+0000 7f2d47fff640 1 --2- 10.20.193.68:0/1905257236 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f2d8012ac90 0x7f2d8006ff70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2d74009130 tx=0x7f2d740047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.388 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.348+0000 7f2d86773640 1 -- 10.20.193.68:0/1905257236 reap_dead start 2026-02-18T21:02:04.388 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.348+0000 7f2d47fff640 1 -- 10.20.193.68:0/1905257236 shutdown_connections 2026-02-18T21:02:04.388 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.348+0000 7f2d47fff640 1 -- 10.20.193.68:0/1905257236 >> 10.20.193.68:0/1905257236 conn(0x7f2d8009cea0 msgr2=0x7f2d8012ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:04.388 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.348+0000 7f2d47fff640 1 -- 10.20.193.68:0/1905257236 shutdown_connections 2026-02-18T21:02:04.388 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.348+0000 7f2d47fff640 1 -- 10.20.193.68:0/1905257236 wait complete. 2026-02-18T21:02:04.388 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.348+0000 7fd7dfe04640 1 -- 10.20.193.68:0/771916951 --> v1:10.20.193.68:6804/25186 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd7d8134de0 con 0x7fd7a8053da0 2026-02-18T21:02:04.388 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.348+0000 7fd7c67fc640 1 -- 10.20.193.68:0/771916951 <== osd.3 v1:10.20.193.68:6804/25186 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1710880829) 0x7fd7d8134de0 con 0x7fd7a8053da0 2026-02-18T21:02:04.389 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.348+0000 7fd7dfe04640 1 -- 10.20.193.68:0/771916951 >> v1:10.20.193.68:6804/25186 conn(0x7fd7a8053da0 legacy=0x7fd7a8056200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.389 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.349+0000 7fd7dfe04640 1 -- 10.20.193.68:0/771916951 >> v1:10.20.193.68:6816/24610 conn(0x7fd7a804d6b0 legacy=0x7fd7a804fb70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-18T21:02:04.389 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.349+0000 7fd7dfe04640 1 -- 10.20.193.68:0/771916951 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd7d813a180 msgr2=0x7fd7d8071760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.389 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.349+0000 7fd7dfe04640 1 --2- 10.20.193.68:0/771916951 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd7d813a180 0x7fd7d8071760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400ef90 tx=0x7fd7d400c490 comp rx=0 tx=0).stop 2026-02-18T21:02:04.389 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.349+0000 7fd7de37a640 1 -- 10.20.193.68:0/771916951 reap_dead start 2026-02-18T21:02:04.389 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.349+0000 7fd7dfe04640 1 -- 10.20.193.68:0/771916951 shutdown_connections 2026-02-18T21:02:04.389 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.349+0000 7fd7dfe04640 1 -- 10.20.193.68:0/771916951 >> 10.20.193.68:0/771916951 conn(0x7fd7d809cea0 msgr2=0x7fd7d81398b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:04.389 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.349+0000 7fd7dfe04640 1 -- 10.20.193.68:0/771916951 shutdown_connections 2026-02-18T21:02:04.389 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.349+0000 7fd7dfe04640 1 -- 10.20.193.68:0/771916951 wait complete. 2026-02-18T21:02:04.390 INFO:teuthology.orchestra.run.trial068.stdout:38654705675 2026-02-18T21:02:04.390 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-18T21:02:04.390 INFO:teuthology.orchestra.run.trial068.stdout:38654705676 2026-02-18T21:02:04.391 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-18T21:02:04.391 INFO:teuthology.orchestra.run.trial068.stdout:38654705676 2026-02-18T21:02:04.391 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-18T21:02:04.392 INFO:teuthology.orchestra.run.trial068.stdout:38654705674 2026-02-18T21:02:04.392 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-18T21:02:04.392 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.373+0000 7f7b98017140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-18T21:02:04.398 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.397+0000 7f9f2700e140 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2026-02-18T21:02:04.402 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.400+0000 7f7b98017140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-18T21:02:04.427 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.426+0000 7f7b98017140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-18T21:02:04.443 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.442+0000 7f9f2700e140 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2026-02-18T21:02:04.456 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.455+0000 7f7b98017140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-18T21:02:04.467 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.466+0000 7f0c1279b640 1 Processor -- start 2026-02-18T21:02:04.467 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.466+0000 7f0c1279b640 1 -- start start 2026-02-18T21:02:04.468 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.466+0000 7f817804e640 1 Processor -- start 2026-02-18T21:02:04.468 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.466+0000 7f817804e640 1 -- start start 2026-02-18T21:02:04.469 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.466+0000 7f0c1279b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0c0c12ac90 0x7f0c0c12b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.469 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.466+0000 7f0c1279b640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f0c0c071b30 0x7f0c0c136070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.469 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.466+0000 7f0c1279b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c0c12a7b0 con 0x7f0c0c073680 2026-02-18T21:02:04.469 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f0c1279b640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f0c0c073e60 con 0x7f0c0c071b30 2026-02-18T21:02:04.469 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f0c1279b640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f0c0c072d10 con 0x7f0c0c12ac90 2026-02-18T21:02:04.470 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f0c0bfff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0c0c12ac90 0x7f0c0c12b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.470 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f0c10d11640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f0c0c071b30 0x7f0c0c136070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.470 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f0c10d11640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f0c0c071b30 0x7f0c0c136070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:47338/0 (socket says 10.20.193.68:47338) 2026-02-18T21:02:04.470 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f0c0bfff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0c0c12ac90 0x7f0c0c12b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:39662/0 (socket says 10.20.193.68:39662) 2026-02-18T21:02:04.470 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f0c0bfff640 1 -- 10.20.193.68:0/296217727 learned_addr learned my addr 10.20.193.68:0/296217727 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:04.470 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f0c0b7fe640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f0c0c073680 0x7f0c0c071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:50644/0 (socket says 10.20.193.68:50644) 2026-02-18T21:02:04.470 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f57e2d1d640 1 Processor -- start 2026-02-18T21:02:04.471 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f817804e640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f817012d090 0x7f817012d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.471 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f817804e640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8170130060 0x7f81701304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.471 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f817804e640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81700726d0 con 0x7f81701309e0 2026-02-18T21:02:04.471 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f817804e640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f81700730a0 con 0x7f817012d090 2026-02-18T21:02:04.471 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f817804e640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f8170074190 con 0x7f8170130060 2026-02-18T21:02:04.472 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f57e2d1d640 1 -- start start 2026-02-18T21:02:04.472 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f81765c4640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f81701309e0 0x7f81701373f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:50648/0 (socket says 10.20.193.68:50648) 2026-02-18T21:02:04.472 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f8175dc3640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f817012d090 0x7f817012d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.472 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f81765c4640 1 -- 10.20.193.68:0/2130397093 learned_addr learned my addr 10.20.193.68:0/2130397093 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:04.472 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f81755c2640 1 --2- 10.20.193.68:0/2130397093 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8170130060 0x7f81701304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.473 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f0c10d11640 1 -- 10.20.193.68:0/296217727 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0c0c12ac90 msgr2=0x7f0c0c12b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:04.473 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f0c10d11640 1 --2- 10.20.193.68:0/296217727 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0c0c12ac90 0x7f0c0c12b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.473 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f0c10d11640 1 -- 10.20.193.68:0/296217727 >> v1:10.20.193.68:6789/0 conn(0x7f0c0c073680 legacy=0x7f0c0c071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.473 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f0c10d11640 1 -- 10.20.193.68:0/296217727 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c0c12b5b0 con 0x7f0c0c071b30 2026-02-18T21:02:04.473 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f0c0bfff640 1 --2- 10.20.193.68:0/296217727 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0c0c12ac90 0x7f0c0c12b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:04.474 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f57e2d1d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f57dc12d090 0x7f57dc12d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.474 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f57e2d1d640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f57dc130060 0x7f57dc1304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.475 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f8175dc3640 1 -- 10.20.193.68:0/2130397093 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8170130060 msgr2=0x7f81701304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:04.475 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f8175dc3640 1 --2- 10.20.193.68:0/2130397093 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8170130060 0x7f81701304a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.475 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f8175dc3640 1 -- 10.20.193.68:0/2130397093 >> v1:10.20.193.68:6789/0 conn(0x7f81701309e0 legacy=0x7f81701373f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.475 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f57e2d1d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f57dc1309e0 0x7f57dc1373f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.475 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f57e2d1d640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f57dc0730a0 con 0x7f57dc130060 2026-02-18T21:02:04.475 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f57e2d1d640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f57dc0726d0 con 0x7f57dc12d090 2026-02-18T21:02:04.476 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f57e2d1d640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f57dc074190 con 0x7f57dc1309e0 2026-02-18T21:02:04.476 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f8174dc1640 1 -- 10.20.193.68:0/2130397093 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1420834167 0 0) 0x7f81700726d0 con 0x7f81701309e0 2026-02-18T21:02:04.476 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f8175dc3640 1 -- 10.20.193.68:0/2130397093 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8170130e50 con 0x7f817012d090 2026-02-18T21:02:04.477 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f57d3fff640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f57dc130060 0x7f57dc1304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.477 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f57e1293640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f57dc1309e0 0x7f57dc1373f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.477 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f57e1293640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f57dc1309e0 0x7f57dc1373f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:39678/0 (socket says 10.20.193.68:39678) 2026-02-18T21:02:04.477 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f57e1293640 1 -- 10.20.193.68:0/2014595996 learned_addr learned my addr 10.20.193.68:0/2014595996 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:04.477 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f57e0a92640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f57dc12d090 0x7f57dc12d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.477 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7fdf3047c640 1 Processor -- start 2026-02-18T21:02:04.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7fdf3047c640 1 -- start start 2026-02-18T21:02:04.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f57e0a92640 1 -- 10.20.193.68:0/2014595996 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f57dc1309e0 msgr2=0x7f57dc1373f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:04.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f57e0a92640 1 --2- 10.20.193.68:0/2014595996 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f57dc1309e0 0x7f57dc1373f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f57e0a92640 1 -- 10.20.193.68:0/2014595996 >> v2:10.20.193.68:3300/0 conn(0x7f57dc130060 msgr2=0x7f57dc1304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:04.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f57e0a92640 1 --2- 10.20.193.68:0/2014595996 >> v2:10.20.193.68:3300/0 conn(0x7f57dc130060 0x7f57dc1304a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f57e0a92640 1 -- 10.20.193.68:0/2014595996 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57dc130e50 con 0x7f57dc12d090 2026-02-18T21:02:04.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.467+0000 7f0c10d11640 1 --2- 10.20.193.68:0/296217727 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f0c0c071b30 0x7f0c0c136070 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0c00009d90 tx=0x7f0c0002f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439ebc5f46485c6b server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:04.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7fdf3047c640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fdf2812d090 0x7fdf2812d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.480 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f0c0affd640 1 -- 10.20.193.68:0/296217727 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c0003c070 con 0x7f0c0c071b30 2026-02-18T21:02:04.480 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f0c0affd640 1 -- 10.20.193.68:0/296217727 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c0002fe10 con 0x7f0c0c071b30 2026-02-18T21:02:04.480 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f0c0affd640 1 -- 10.20.193.68:0/296217727 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c00037660 con 0x7f0c0c071b30 2026-02-18T21:02:04.480 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f8175dc3640 1 --2- 10.20.193.68:0/2130397093 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f817012d090 0x7f817012d470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f81600098a0 tx=0x7f816002ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f403ce5f7bb8528a server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:04.481 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7fdf3047c640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdf28130be0 0x7fdf28138400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.481 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7fdf3047c640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf280726d0 con 0x7fdf28130060 2026-02-18T21:02:04.481 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7fdf3047c640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7fdf280730a0 con 0x7fdf2812d090 2026-02-18T21:02:04.481 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7fdf3047c640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fdf28074190 con 0x7fdf28130be0 2026-02-18T21:02:04.481 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7fdf2e1f1640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fdf2812d090 0x7fdf2812d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.481 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7fdf2e1f1640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fdf2812d090 0x7fdf2812d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:47366/0 (socket says 10.20.193.68:47366) 2026-02-18T21:02:04.481 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7fdf2e1f1640 1 -- 10.20.193.68:0/3188212351 learned_addr learned my addr 10.20.193.68:0/3188212351 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:04.482 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7fdf2e9f2640 1 --2- 10.20.193.68:0/3188212351 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdf28130be0 0x7fdf28138400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.482 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f8174dc1640 1 -- 10.20.193.68:0/2130397093 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816003c070 con 0x7f817012d090 2026-02-18T21:02:04.482 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f57e0a92640 1 --2- 10.20.193.68:0/2014595996 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f57dc12d090 0x7f57dc12d470 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0098d0 tx=0x7f57cc02ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40b324e3dfaa5d39 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:04.483 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f8174dc1640 1 -- 10.20.193.68:0/2130397093 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f816002fad0 con 0x7f817012d090 2026-02-18T21:02:04.483 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f8174dc1640 1 -- 10.20.193.68:0/2130397093 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8160037440 con 0x7f817012d090 2026-02-18T21:02:04.483 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7fdf2e1f1640 1 -- 10.20.193.68:0/3188212351 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdf28130be0 msgr2=0x7fdf28138400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:04.483 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7fdf2e1f1640 1 --2- 10.20.193.68:0/3188212351 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdf28130be0 0x7fdf28138400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.484 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7fdf2e1f1640 1 -- 10.20.193.68:0/3188212351 >> v1:10.20.193.68:6789/0 conn(0x7fdf28130060 legacy=0x7fdf281304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.484 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7fdf2e1f1640 1 -- 10.20.193.68:0/3188212351 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf28073e80 con 0x7fdf2812d090 2026-02-18T21:02:04.484 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f0c1279b640 1 -- 10.20.193.68:0/296217727 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f0c0c071b30 msgr2=0x7f0c0c136070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.484 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f0c1279b640 1 --2- 10.20.193.68:0/296217727 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f0c0c071b30 0x7f0c0c136070 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0c00009d90 tx=0x7f0c0002f150 comp rx=0 tx=0).stop 2026-02-18T21:02:04.485 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f57d37fe640 1 -- 10.20.193.68:0/2014595996 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57cc03c070 con 0x7f57dc12d090 2026-02-18T21:02:04.485 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f57d37fe640 1 -- 10.20.193.68:0/2014595996 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57cc02fab0 con 0x7f57dc12d090 2026-02-18T21:02:04.485 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f57d37fe640 1 -- 10.20.193.68:0/2014595996 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57cc037440 con 0x7f57dc12d090 2026-02-18T21:02:04.485 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f0c1279b640 1 -- 10.20.193.68:0/296217727 shutdown_connections 2026-02-18T21:02:04.486 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f0c1279b640 1 --2- 10.20.193.68:0/296217727 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f0c0c071b30 0x7f0c0c136070 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.486 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f0c1279b640 1 --2- 10.20.193.68:0/296217727 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0c0c12ac90 0x7f0c0c12b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.486 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f0c1279b640 1 -- 10.20.193.68:0/296217727 >> 10.20.193.68:0/296217727 conn(0x7f0c0c09cea0 msgr2=0x7f0c0c09d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:04.486 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f0c1279b640 1 -- 10.20.193.68:0/296217727 shutdown_connections 2026-02-18T21:02:04.486 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f0c1279b640 1 -- 10.20.193.68:0/296217727 wait complete. 2026-02-18T21:02:04.487 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f817804e640 1 -- 10.20.193.68:0/2130397093 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f817012d090 msgr2=0x7f817012d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.487 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f817804e640 1 --2- 10.20.193.68:0/2130397093 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f817012d090 0x7f817012d470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f81600098a0 tx=0x7f816002ee10 comp rx=0 tx=0).stop 2026-02-18T21:02:04.487 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f817804e640 1 -- 10.20.193.68:0/2130397093 shutdown_connections 2026-02-18T21:02:04.487 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f817804e640 1 --2- 10.20.193.68:0/2130397093 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8170130060 0x7f81701304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.487 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f817804e640 1 --2- 10.20.193.68:0/2130397093 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f817012d090 0x7f817012d470 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.487 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f817804e640 1 -- 10.20.193.68:0/2130397093 >> 10.20.193.68:0/2130397093 conn(0x7f81700a1c00 msgr2=0x7f81700a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:04.487 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f817804e640 1 -- 10.20.193.68:0/2130397093 shutdown_connections 2026-02-18T21:02:04.487 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f817804e640 1 -- 10.20.193.68:0/2130397093 wait complete. 2026-02-18T21:02:04.488 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f57e2d1d640 1 -- 10.20.193.68:0/2014595996 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f57dc12d090 msgr2=0x7f57dc12d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.488 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f57e2d1d640 1 --2- 10.20.193.68:0/2014595996 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f57dc12d090 0x7f57dc12d470 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0098d0 tx=0x7f57cc02ee80 comp rx=0 tx=0).stop 2026-02-18T21:02:04.488 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f57e2d1d640 1 -- 10.20.193.68:0/2014595996 shutdown_connections 2026-02-18T21:02:04.488 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f57e2d1d640 1 --2- 10.20.193.68:0/2014595996 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f57dc1309e0 0x7f57dc1373f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.488 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f57e2d1d640 1 --2- 10.20.193.68:0/2014595996 >> v2:10.20.193.68:3300/0 conn(0x7f57dc130060 0x7f57dc1304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.489 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f57e2d1d640 1 --2- 10.20.193.68:0/2014595996 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f57dc12d090 0x7f57dc12d470 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.489 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f57e2d1d640 1 -- 10.20.193.68:0/2014595996 >> 10.20.193.68:0/2014595996 conn(0x7f57dc0a1c00 msgr2=0x7f57dc0a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:04.489 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7fdf2e1f1640 1 --2- 10.20.193.68:0/3188212351 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdf2812d090 0x7fdf2812d470 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009970 tx=0x7fdf1802eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80a8a52b7d79107 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:04.489 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f57e2d1d640 1 -- 10.20.193.68:0/2014595996 shutdown_connections 2026-02-18T21:02:04.489 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7f57e2d1d640 1 -- 10.20.193.68:0/2014595996 wait complete. 2026-02-18T21:02:04.490 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.468+0000 7f9f2700e140 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2026-02-18T21:02:04.490 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.468+0000 7fdf2d1ef640 1 -- 10.20.193.68:0/3188212351 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1803c070 con 0x7fdf2812d090 2026-02-18T21:02:04.490 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7fdf2d1ef640 1 -- 10.20.193.68:0/3188212351 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf1802fbb0 con 0x7fdf2812d090 2026-02-18T21:02:04.490 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7fdf2d1ef640 1 -- 10.20.193.68:0/3188212351 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf18037440 con 0x7fdf2812d090 2026-02-18T21:02:04.491 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f817804e640 1 Processor -- start 2026-02-18T21:02:04.491 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f817804e640 1 -- start start 2026-02-18T21:02:04.491 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f0c1279b640 1 Processor -- start 2026-02-18T21:02:04.492 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f0c1279b640 1 -- start start 2026-02-18T21:02:04.492 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7fdf3047c640 1 -- 10.20.193.68:0/3188212351 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdf2812d090 msgr2=0x7fdf2812d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.492 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7fdf3047c640 1 --2- 10.20.193.68:0/3188212351 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdf2812d090 0x7fdf2812d470 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009970 tx=0x7fdf1802eef0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.492 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7fdf3047c640 1 -- 10.20.193.68:0/3188212351 shutdown_connections 2026-02-18T21:02:04.492 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7fdf3047c640 1 --2- 10.20.193.68:0/3188212351 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdf28130be0 0x7fdf28138400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.493 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7fdf3047c640 1 --2- 10.20.193.68:0/3188212351 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdf2812d090 0x7fdf2812d470 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.493 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7fdf3047c640 1 -- 10.20.193.68:0/3188212351 >> 10.20.193.68:0/3188212351 conn(0x7fdf280a1c00 msgr2=0x7fdf280a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:04.493 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f57e2d1d640 1 Processor -- start 2026-02-18T21:02:04.493 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7fdf3047c640 1 -- 10.20.193.68:0/3188212351 shutdown_connections 2026-02-18T21:02:04.494 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f817804e640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f817012d090 0x7f817011c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.494 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f817804e640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8170130060 0x7f817011cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.494 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7fdf3047c640 1 -- 10.20.193.68:0/3188212351 wait complete. 2026-02-18T21:02:04.495 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f817804e640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f81701309e0 0x7f81701c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.495 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f817804e640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f817012cdb0 con 0x7f817012d090 2026-02-18T21:02:04.495 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f817804e640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f817012d9b0 con 0x7f8170130060 2026-02-18T21:02:04.495 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f817804e640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f8170072aa0 con 0x7f81701309e0 2026-02-18T21:02:04.495 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f57e2d1d640 1 -- start start 2026-02-18T21:02:04.496 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f8175dc3640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f817012d090 0x7f817011c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.496 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f81755c2640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8170130060 0x7f817011cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.496 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f8175dc3640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f817012d090 0x7f817011c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:47370/0 (socket says 10.20.193.68:47370) 2026-02-18T21:02:04.496 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f8175dc3640 1 -- 10.20.193.68:0/1797481596 learned_addr learned my addr 10.20.193.68:0/1797481596 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:04.496 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f0c1279b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f0c0c071b30 0x7f0c0c116ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.496 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f81765c4640 1 --2- 10.20.193.68:0/1797481596 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f81701309e0 0x7f81701c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.497 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f0c1279b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0c0c073680 0x7f0c0c117420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.497 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f0c1279b640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f0c0c12ac90 0x7f0c0c117960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.497 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f0c1279b640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f0c0c1365b0 con 0x7f0c0c12ac90 2026-02-18T21:02:04.497 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f0c1279b640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f0c0c0721d0 con 0x7f0c0c071b30 2026-02-18T21:02:04.498 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f0c1279b640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f0c0c136730 con 0x7f0c0c073680 2026-02-18T21:02:04.498 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f0c0bfff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f0c0c071b30 0x7f0c0c116ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.498 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f0c0bfff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f0c0c071b30 0x7f0c0c116ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:39106/0 (socket says 10.20.193.68:39106) 2026-02-18T21:02:04.498 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f0c0bfff640 1 -- 10.20.193.68:0/3159465751 learned_addr learned my addr 10.20.193.68:0/3159465751 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:04.498 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f0c0b7fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0c0c073680 0x7f0c0c117420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.498 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f8175dc3640 1 -- 10.20.193.68:0/1797481596 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f81701309e0 msgr2=0x7f81701c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.498 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f8175dc3640 1 --2- 10.20.193.68:0/1797481596 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f81701309e0 0x7f81701c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.498 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f8175dc3640 1 -- 10.20.193.68:0/1797481596 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8170130060 msgr2=0x7f817011cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.499 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f8175dc3640 1 --2- 10.20.193.68:0/1797481596 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8170130060 0x7f817011cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.499 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f8175dc3640 1 -- 10.20.193.68:0/1797481596 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817011ed70 con 0x7f817012d090 2026-02-18T21:02:04.499 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f81755c2640 1 --2- 10.20.193.68:0/1797481596 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8170130060 0x7f817011cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:04.499 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f0c10d11640 1 --2- 10.20.193.68:0/3159465751 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f0c0c12ac90 0x7f0c0c117960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.500 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f57e2d1d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f57dc12d090 0x7f57dc1c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.500 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f57e2d1d640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f57dc130060 0x7f57dc1c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.500 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f57e2d1d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f57dc1309e0 0x7f57dc1c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.500 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f57e2d1d640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc12cdb0 con 0x7f57dc130060 2026-02-18T21:02:04.500 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f57e2d1d640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f57dc12d9f0 con 0x7f57dc12d090 2026-02-18T21:02:04.500 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f57e2d1d640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f57dc072aa0 con 0x7f57dc1309e0 2026-02-18T21:02:04.500 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f0c0bfff640 1 -- 10.20.193.68:0/3159465751 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0c0c073680 msgr2=0x7f0c0c117420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.500 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f0c0bfff640 1 --2- 10.20.193.68:0/3159465751 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0c0c073680 0x7f0c0c117420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.500 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f0c0bfff640 1 -- 10.20.193.68:0/3159465751 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f0c0c12ac90 msgr2=0x7f0c0c117960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.500 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f0c0bfff640 1 --2- 10.20.193.68:0/3159465751 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f0c0c12ac90 0x7f0c0c117960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.501 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f57d3fff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f57dc130060 0x7f57dc1c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.501 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f0c0bfff640 1 -- 10.20.193.68:0/3159465751 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c0c124ac0 con 0x7f0c0c071b30 2026-02-18T21:02:04.501 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f57d3fff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f57dc130060 0x7f57dc1c4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:47396/0 (socket says 10.20.193.68:47396) 2026-02-18T21:02:04.501 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f57d3fff640 1 -- 10.20.193.68:0/2923083063 learned_addr learned my addr 10.20.193.68:0/2923083063 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:04.502 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.469+0000 7f57e0a92640 1 --2- 10.20.193.68:0/2923083063 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f57dc12d090 0x7f57dc1c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.502 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f57e1293640 1 --2- 10.20.193.68:0/2923083063 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f57dc1309e0 0x7f57dc1c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.502 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f8175dc3640 1 --2- 10.20.193.68:0/1797481596 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f817012d090 0x7f817011c650 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8160009130 tx=0x7f81600047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:04.502 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f0c0bfff640 1 --2- 10.20.193.68:0/3159465751 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f0c0c071b30 0x7f0c0c116ee0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800ebe0 tx=0x7f0bf800c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:04.502 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f57d3fff640 1 -- 10.20.193.68:0/2923083063 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f57dc1309e0 msgr2=0x7f57dc1c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.502 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f57d3fff640 1 --2- 10.20.193.68:0/2923083063 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f57dc1309e0 0x7f57dc1c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.503 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f57d3fff640 1 -- 10.20.193.68:0/2923083063 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f57dc12d090 msgr2=0x7f57dc1c3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.503 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f57d3fff640 1 --2- 10.20.193.68:0/2923083063 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f57dc12d090 0x7f57dc1c3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.503 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf3047c640 1 Processor -- start 2026-02-18T21:02:04.503 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f57d3fff640 1 -- 10.20.193.68:0/2923083063 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57dc11fcf0 con 0x7f57dc130060 2026-02-18T21:02:04.503 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f815e7fc640 1 -- 10.20.193.68:0/1797481596 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f816003c040 con 0x7f817012d090 2026-02-18T21:02:04.504 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f57e0a92640 1 --2- 10.20.193.68:0/2923083063 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f57dc12d090 0x7f57dc1c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:04.504 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f815e7fc640 1 -- 10.20.193.68:0/1797481596 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8160042450 con 0x7f817012d090 2026-02-18T21:02:04.504 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f817804e640 1 -- 10.20.193.68:0/1797481596 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f817011fb90 con 0x7f817012d090 2026-02-18T21:02:04.504 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f0c08ff9640 1 -- 10.20.193.68:0/3159465751 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8017070 con 0x7f0c0c071b30 2026-02-18T21:02:04.504 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf3047c640 1 -- start start 2026-02-18T21:02:04.505 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f815e7fc640 1 -- 10.20.193.68:0/1797481596 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8160042820 con 0x7f817012d090 2026-02-18T21:02:04.505 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f0c08ff9640 1 -- 10.20.193.68:0/3159465751 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bf800cc40 con 0x7f0c0c071b30 2026-02-18T21:02:04.505 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f0c1279b640 1 -- 10.20.193.68:0/3159465751 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c0c123e00 con 0x7f0c0c071b30 2026-02-18T21:02:04.505 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f817804e640 1 -- 10.20.193.68:0/1797481596 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f817011f7c0 con 0x7f817012d090 2026-02-18T21:02:04.505 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f57d3fff640 1 --2- 10.20.193.68:0/2923083063 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f57dc130060 0x7f57dc1c4310 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f57c400ec10 tx=0x7f57c400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:04.506 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f0c08ff9640 1 -- 10.20.193.68:0/3159465751 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8013470 con 0x7f0c0c071b30 2026-02-18T21:02:04.506 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f0c1279b640 1 -- 10.20.193.68:0/3159465751 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c0c11de00 con 0x7f0c0c071b30 2026-02-18T21:02:04.506 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf3047c640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdf2812d090 0x7fdf28133f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.506 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf3047c640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdf28130060 0x7fdf281344b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.506 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf3047c640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fdf28130be0 0x7fdf281349f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:04.506 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf3047c640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fdf28072aa0 con 0x7fdf2812d090 2026-02-18T21:02:04.506 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf3047c640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fdf2812cdb0 con 0x7fdf28130060 2026-02-18T21:02:04.507 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf3047c640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fdf28072c20 con 0x7fdf28130be0 2026-02-18T21:02:04.507 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f57d17fa640 1 -- 10.20.193.68:0/2923083063 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c4017070 con 0x7f57dc130060 2026-02-18T21:02:04.507 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf2d9f0640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdf28130060 0x7fdf281344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.507 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f57d17fa640 1 -- 10.20.193.68:0/2923083063 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c400cbe0 con 0x7f57dc130060 2026-02-18T21:02:04.507 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf2e9f2640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fdf28130be0 0x7fdf281349f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.508 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f57e2d1d640 1 -- 10.20.193.68:0/2923083063 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57dc11e940 con 0x7f57dc130060 2026-02-18T21:02:04.508 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf2d9f0640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdf28130060 0x7fdf281344b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:39128/0 (socket says 10.20.193.68:39128) 2026-02-18T21:02:04.508 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f57d17fa640 1 -- 10.20.193.68:0/2923083063 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c4013470 con 0x7f57dc130060 2026-02-18T21:02:04.508 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf2e9f2640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fdf28130be0 0x7fdf281349f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:39722/0 (socket says 10.20.193.68:39722) 2026-02-18T21:02:04.508 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf2d9f0640 1 -- 10.20.193.68:0/3562024232 learned_addr learned my addr 10.20.193.68:0/3562024232 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:04.509 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f57e2d1d640 1 -- 10.20.193.68:0/2923083063 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57dc1c74b0 con 0x7f57dc130060 2026-02-18T21:02:04.509 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf2e1f1640 1 --2- 10.20.193.68:0/3562024232 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdf2812d090 0x7fdf28133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:04.509 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf2e9f2640 1 -- 10.20.193.68:0/3562024232 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdf28130060 msgr2=0x7fdf281344b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.509 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf2e9f2640 1 --2- 10.20.193.68:0/3562024232 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdf28130060 0x7fdf281344b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.509 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf2e9f2640 1 -- 10.20.193.68:0/3562024232 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdf2812d090 msgr2=0x7fdf28133f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.509 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf2e9f2640 1 --2- 10.20.193.68:0/3562024232 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdf2812d090 0x7fdf28133f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf2e9f2640 1 -- 10.20.193.68:0/3562024232 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf28136470 con 0x7fdf28130be0 2026-02-18T21:02:04.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf2e1f1640 1 --2- 10.20.193.68:0/3562024232 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdf2812d090 0x7fdf28133f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-18T21:02:04.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf2e9f2640 1 --2- 10.20.193.68:0/3562024232 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fdf28130be0 0x7fdf281349f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdf2400efc0 tx=0x7fdf2400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:04.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf0effd640 1 -- 10.20.193.68:0/3562024232 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf24018020 con 0x7fdf28130be0 2026-02-18T21:02:04.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf0effd640 1 -- 10.20.193.68:0/3562024232 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf24014480 con 0x7fdf28130be0 2026-02-18T21:02:04.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf3047c640 1 -- 10.20.193.68:0/3562024232 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf28134f30 con 0x7fdf28130be0 2026-02-18T21:02:04.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f815e7fc640 1 -- 10.20.193.68:0/1797481596 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 6) ==== 59491+0+0 (secure 0 0 0) 0x7f816004b410 con 0x7f817012d090 2026-02-18T21:02:04.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f817804e640 1 -- 10.20.193.68:0/1797481596 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81700687c0 con 0x7f817012d090 2026-02-18T21:02:04.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7fdf0effd640 1 -- 10.20.193.68:0/3562024232 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf24014870 con 0x7fdf28130be0 2026-02-18T21:02:04.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.470+0000 7f0c1279b640 1 -- 10.20.193.68:0/3159465751 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c0c12b070 con 0x7f0c0c071b30 2026-02-18T21:02:04.511 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.471+0000 7fdf3047c640 1 -- 10.20.193.68:0/3562024232 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf281cd7b0 con 0x7fdf28130be0 2026-02-18T21:02:04.511 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.471+0000 7f57e2d1d640 1 -- 10.20.193.68:0/2923083063 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57dc0687c0 con 0x7f57dc130060 2026-02-18T21:02:04.511 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.471+0000 7f0c08ff9640 1 -- 10.20.193.68:0/3159465751 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 6) ==== 59491+0+0 (secure 0 0 0) 0x7f0bf8024060 con 0x7f0c0c071b30 2026-02-18T21:02:04.511 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.471+0000 7f815e7fc640 1 -- 10.20.193.68:0/1797481596 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2834+0+0 (secure 0 0 0) 0x7f8160088ef0 con 0x7f817012d090 2026-02-18T21:02:04.511 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.471+0000 7f57d17fa640 1 -- 10.20.193.68:0/2923083063 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 6) ==== 59491+0+0 (secure 0 0 0) 0x7f57c4024060 con 0x7f57dc130060 2026-02-18T21:02:04.512 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.471+0000 7f0c0b7fe640 1 -- 10.20.193.68:0/3159465751 >> v1:10.20.193.68:6816/24610 conn(0x7f0bdc04d6b0 legacy=0x7f0bdc04fb70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.68:6816/24610 2026-02-18T21:02:04.512 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.471+0000 7f0c08ff9640 1 -- 10.20.193.68:0/3159465751 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 2834+0+0 (secure 0 0 0) 0x7f0bf8063f50 con 0x7f0c0c071b30 2026-02-18T21:02:04.512 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.471+0000 7fdf3047c640 1 -- 10.20.193.68:0/3562024232 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf2812ed70 con 0x7fdf28130be0 2026-02-18T21:02:04.512 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.471+0000 7fdf0effd640 1 -- 10.20.193.68:0/3562024232 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 6) ==== 59491+0+0 (secure 0 0 0) 0x7fdf24014a10 con 0x7fdf28130be0 2026-02-18T21:02:04.512 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.471+0000 7f57e0a92640 1 -- 10.20.193.68:0/2923083063 >> v1:10.20.193.68:6816/24610 conn(0x7f57ac04d6b0 legacy=0x7f57ac04fb70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.68:6816/24610 2026-02-18T21:02:04.513 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.471+0000 7f57d17fa640 1 -- 10.20.193.68:0/2923083063 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2834+0+0 (secure 0 0 0) 0x7f57c4064090 con 0x7f57dc130060 2026-02-18T21:02:04.513 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.471+0000 7fdf0effd640 1 -- 10.20.193.68:0/3562024232 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(18..18 src has 1..18) ==== 2834+0+0 (secure 0 0 0) 0x7fdf24065000 con 0x7fdf28130be0 2026-02-18T21:02:04.513 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.471+0000 7fdf2e1f1640 1 -- 10.20.193.68:0/3562024232 >> v1:10.20.193.68:6816/24610 conn(0x7fdef804d6b0 legacy=0x7fdef804fb70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.68:6816/24610 2026-02-18T21:02:04.513 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.471+0000 7f81755c2640 1 -- 10.20.193.68:0/1797481596 >> v1:10.20.193.68:6816/24610 conn(0x7f814404d6b0 legacy=0x7f814404fb70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.68:6816/24610 2026-02-18T21:02:04.513 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.473+0000 7f0c08ff9640 1 -- 10.20.193.68:0/3159465751 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+144236 (secure 0 0 0) 0x7f0bf803eeb0 con 0x7f0c0c071b30 2026-02-18T21:02:04.513 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.473+0000 7f815e7fc640 1 -- 10.20.193.68:0/1797481596 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+144236 (secure 0 0 0) 0x7f8160050020 con 0x7f817012d090 2026-02-18T21:02:04.514 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.474+0000 7fdf0effd640 1 -- 10.20.193.68:0/3562024232 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+144236 (secure 0 0 0) 0x7fdf2812ed70 con 0x7fdf28130be0 2026-02-18T21:02:04.514 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.476+0000 7f57d17fa640 1 -- 10.20.193.68:0/2923083063 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+144236 (secure 0 0 0) 0x7f57c403eed0 con 0x7f57dc130060 2026-02-18T21:02:04.514 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.484+0000 7f7b98017140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-18T21:02:04.514 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.495+0000 7f9f2700e140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2026-02-18T21:02:04.523 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.523+0000 7f9f2700e140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2026-02-18T21:02:04.541 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.540+0000 7f0c1279b640 1 -- 10.20.193.68:0/3159465751 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f0c0c069ef0 con 0x7f0c0c071b30 2026-02-18T21:02:04.542 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.540+0000 7f0c08ff9640 1 -- 10.20.193.68:0/3159465751 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0bf80630c0 con 0x7f0c0c071b30 2026-02-18T21:02:04.542 INFO:teuthology.orchestra.run.trial068.stdout:38654705675 2026-02-18T21:02:04.543 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.542+0000 7fdf3047c640 1 -- 10.20.193.68:0/3562024232 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fdf28135870 con 0x7fdf28130be0 2026-02-18T21:02:04.543 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.542+0000 7f0c1279b640 1 -- 10.20.193.68:0/3159465751 >> v1:10.20.193.68:6816/24610 conn(0x7f0bdc04d6b0 legacy=0x7f0bdc04fb70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-18T21:02:04.543 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.542+0000 7f0c1279b640 1 -- 10.20.193.68:0/3159465751 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f0c0c071b30 msgr2=0x7f0c0c116ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.543 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.542+0000 7f0c1279b640 1 --2- 10.20.193.68:0/3159465751 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f0c0c071b30 0x7f0c0c116ee0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800ebe0 tx=0x7f0bf800c520 comp rx=0 tx=0).stop 2026-02-18T21:02:04.544 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.542+0000 7fdf0effd640 1 -- 10.20.193.68:0/3562024232 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdf24022030 con 0x7fdf28130be0 2026-02-18T21:02:04.544 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.542+0000 7f0c1279b640 1 -- 10.20.193.68:0/3159465751 shutdown_connections 2026-02-18T21:02:04.544 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.542+0000 7f0c1279b640 1 --2- 10.20.193.68:0/3159465751 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f0c0c12ac90 0x7f0c0c117960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.544 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.542+0000 7f0c1279b640 1 --2- 10.20.193.68:0/3159465751 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f0c0c073680 0x7f0c0c117420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.544 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.542+0000 7f0c1279b640 1 --2- 10.20.193.68:0/3159465751 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f0c0c071b30 0x7f0c0c116ee0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.544 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.542+0000 7f0c1279b640 1 -- 10.20.193.68:0/3159465751 >> 10.20.193.68:0/3159465751 conn(0x7f0c0c09cea0 msgr2=0x7f0c0c125180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:04.545 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.542+0000 7f0c1279b640 1 -- 10.20.193.68:0/3159465751 shutdown_connections 2026-02-18T21:02:04.545 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.542+0000 7f0c1279b640 1 -- 10.20.193.68:0/3159465751 wait complete. 2026-02-18T21:02:04.545 INFO:teuthology.orchestra.run.trial068.stdout:38654705675 2026-02-18T21:02:04.545 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.543+0000 7f57e2d1d640 1 -- 10.20.193.68:0/2923083063 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f57dc12d470 con 0x7f57dc130060 2026-02-18T21:02:04.545 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.543+0000 7f57d17fa640 1 -- 10.20.193.68:0/2923083063 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f57c40630e0 con 0x7f57dc130060 2026-02-18T21:02:04.546 INFO:teuthology.orchestra.run.trial068.stdout:38654705674 2026-02-18T21:02:04.546 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.543+0000 7fdf3047c640 1 -- 10.20.193.68:0/3562024232 >> v1:10.20.193.68:6816/24610 conn(0x7fdef804d6b0 legacy=0x7fdef804fb70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-18T21:02:04.547 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.543+0000 7fdf3047c640 1 -- 10.20.193.68:0/3562024232 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fdf28130be0 msgr2=0x7fdf281349f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.547 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.543+0000 7fdf3047c640 1 --2- 10.20.193.68:0/3562024232 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fdf28130be0 0x7fdf281349f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdf2400efc0 tx=0x7fdf2400c490 comp rx=0 tx=0).stop 2026-02-18T21:02:04.547 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.543+0000 7fdf3047c640 1 -- 10.20.193.68:0/3562024232 shutdown_connections 2026-02-18T21:02:04.547 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.543+0000 7fdf3047c640 1 --2- 10.20.193.68:0/3562024232 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fdf28130be0 0x7fdf281349f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.547 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.543+0000 7fdf3047c640 1 --2- 10.20.193.68:0/3562024232 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdf28130060 0x7fdf281344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.547 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.543+0000 7fdf3047c640 1 --2- 10.20.193.68:0/3562024232 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdf2812d090 0x7fdf28133f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.547 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.543+0000 7fdf3047c640 1 -- 10.20.193.68:0/3562024232 >> 10.20.193.68:0/3562024232 conn(0x7fdf280a1c00 msgr2=0x7fdf2812e660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:04.547 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.543+0000 7fdf3047c640 1 -- 10.20.193.68:0/3562024232 shutdown_connections 2026-02-18T21:02:04.547 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.544+0000 7fdf3047c640 1 -- 10.20.193.68:0/3562024232 wait complete. 2026-02-18T21:02:04.548 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.544+0000 7f817804e640 1 -- 10.20.193.68:0/1797481596 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f817012d470 con 0x7f817012d090 2026-02-18T21:02:04.548 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.544+0000 7f815e7fc640 1 -- 10.20.193.68:0/1797481596 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8160063de0 con 0x7f817012d090 2026-02-18T21:02:04.548 INFO:teuthology.orchestra.run.trial068.stdout:38654705674 2026-02-18T21:02:04.548 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.544+0000 7f7b98017140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-18T21:02:04.549 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.544+0000 7f57e2d1d640 1 -- 10.20.193.68:0/2923083063 >> v1:10.20.193.68:6816/24610 conn(0x7f57ac04d6b0 legacy=0x7f57ac04fb70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-18T21:02:04.549 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.544+0000 7f57e2d1d640 1 -- 10.20.193.68:0/2923083063 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f57dc130060 msgr2=0x7f57dc1c4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.549 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.544+0000 7f57e2d1d640 1 --2- 10.20.193.68:0/2923083063 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f57dc130060 0x7f57dc1c4310 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f57c400ec10 tx=0x7f57c400c520 comp rx=0 tx=0).stop 2026-02-18T21:02:04.549 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.545+0000 7f57e2d1d640 1 -- 10.20.193.68:0/2923083063 shutdown_connections 2026-02-18T21:02:04.549 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.545+0000 7f57e2d1d640 1 --2- 10.20.193.68:0/2923083063 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f57dc1309e0 0x7f57dc1c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.550 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.545+0000 7f57e2d1d640 1 --2- 10.20.193.68:0/2923083063 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f57dc130060 0x7f57dc1c4310 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.550 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.545+0000 7f57e2d1d640 1 --2- 10.20.193.68:0/2923083063 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f57dc12d090 0x7f57dc1c3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.550 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.545+0000 7f57e2d1d640 1 -- 10.20.193.68:0/2923083063 >> 10.20.193.68:0/2923083063 conn(0x7f57dc0a1c00 msgr2=0x7f57dc06e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:04.550 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.545+0000 7f57e2d1d640 1 -- 10.20.193.68:0/2923083063 shutdown_connections 2026-02-18T21:02:04.550 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.545+0000 7f57e2d1d640 1 -- 10.20.193.68:0/2923083063 wait complete. 2026-02-18T21:02:04.551 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.545+0000 7f817804e640 1 -- 10.20.193.68:0/1797481596 >> v1:10.20.193.68:6816/24610 conn(0x7f814404d6b0 legacy=0x7f814404fb70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-18T21:02:04.551 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.545+0000 7f817804e640 1 -- 10.20.193.68:0/1797481596 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f817012d090 msgr2=0x7f817011c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:04.551 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.545+0000 7f817804e640 1 --2- 10.20.193.68:0/1797481596 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f817012d090 0x7f817011c650 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8160009130 tx=0x7f81600047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.551 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.546+0000 7f817804e640 1 -- 10.20.193.68:0/1797481596 shutdown_connections 2026-02-18T21:02:04.551 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.546+0000 7f817804e640 1 --2- 10.20.193.68:0/1797481596 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f81701309e0 0x7f81701c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.551 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.546+0000 7f817804e640 1 --2- 10.20.193.68:0/1797481596 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8170130060 0x7f817011cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.551 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.546+0000 7f817804e640 1 --2- 10.20.193.68:0/1797481596 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f817012d090 0x7f817011c650 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:04.551 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.546+0000 7f817804e640 1 -- 10.20.193.68:0/1797481596 >> 10.20.193.68:0/1797481596 conn(0x7f81700a1c00 msgr2=0x7f817006e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:04.551 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.546+0000 7f817804e640 1 -- 10.20.193.68:0/1797481596 shutdown_connections 2026-02-18T21:02:04.551 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:04.546+0000 7f817804e640 1 -- 10.20.193.68:0/1797481596 wait complete. 2026-02-18T21:02:04.552 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.546+0000 7f9f2700e140 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2026-02-18T21:02:04.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705676 got 38654705675 for osd.2 2026-02-18T21:02:04.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705676 got 38654705675 for osd.3 2026-02-18T21:02:04.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705674 got 38654705674 for osd.1 2026-02-18T21:02:04.555 DEBUG:teuthology.parallel:result is None 2026-02-18T21:02:04.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705675 got 38654705674 for osd.0 2026-02-18T21:02:04.570 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.569+0000 7f7b98017140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-18T21:02:04.594 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.593+0000 7f7b98017140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-18T21:02:04.598 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.597+0000 7f9f2700e140 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2026-02-18T21:02:04.619 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.618+0000 7f9f2700e140 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2026-02-18T21:02:04.641 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.640+0000 7f9f2700e140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2026-02-18T21:02:04.642 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.641+0000 7f7b98017140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-18T21:02:04.663 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.662+0000 7f7b98017140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-18T21:02:04.688 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.687+0000 7f9f2700e140 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2026-02-18T21:02:04.709 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.708+0000 7f9f2700e140 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2026-02-18T21:02:04.709 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.708+0000 7f7b98017140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-18T21:02:04.755 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.754+0000 7f9f2700e140 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2026-02-18T21:02:04.782 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.781+0000 7f7b98017140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-18T21:02:04.805 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.804+0000 7f7b98017140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-18T21:02:04.808 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.807+0000 7f9f2700e140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2026-02-18T21:02:04.830 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.829+0000 7f9f2700e140 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2026-02-18T21:02:04.974 INFO:tasks.ceph.mgr.y.trial068.stderr:2026-02-18T21:02:04.973+0000 7f7b98017140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-18T21:02:04.994 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:04.993+0000 7f9f2700e140 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2026-02-18T21:02:05.554 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-18T21:02:05.555 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-18T21:02:05.557 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-18T21:02:05.626 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.625+0000 7fea8c7e8640 1 Processor -- start 2026-02-18T21:02:05.626 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.625+0000 7fea8c7e8640 1 -- start start 2026-02-18T21:02:05.627 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.625+0000 7f58ec105640 1 Processor -- start 2026-02-18T21:02:05.627 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.625+0000 7fea8c7e8640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea8412d090 0x7fea8412d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:05.627 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.625+0000 7fea8c7e8640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea84130060 0x7fea841304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:05.627 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.625+0000 7fea8c7e8640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fea841309e0 0x7fea841373f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:05.628 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.625+0000 7fea8c7e8640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7fea840730a0 con 0x7fea841309e0 2026-02-18T21:02:05.628 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.625+0000 7fea8c7e8640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fea84130e90 con 0x7fea84130060 2026-02-18T21:02:05.628 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.625+0000 7fea8c7e8640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fea840726d0 con 0x7fea8412d090 2026-02-18T21:02:05.628 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.625+0000 7f58ec105640 1 -- start start 2026-02-18T21:02:05.629 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.625+0000 7fea8a55d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea8412d090 0x7fea8412d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:05.629 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.625+0000 7fea89d5c640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea84130060 0x7fea841304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:05.629 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.625+0000 7fea8a55d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea8412d090 0x7fea8412d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:39802/0 (socket says 10.20.193.68:39802) 2026-02-18T21:02:05.629 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.625+0000 7fea8a55d640 1 -- 10.20.193.68:0/1986752309 learned_addr learned my addr 10.20.193.68:0/1986752309 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:05.629 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.625+0000 7fea8ad5e640 1 --2- 10.20.193.68:0/1986752309 >> v2:10.20.193.68:3300/0 conn(0x7fea841309e0 0x7fea841373f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:05.630 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.625+0000 7fea8a55d640 1 -- 10.20.193.68:0/1986752309 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea84130060 msgr2=0x7fea841304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:05.630 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.625+0000 7fea8a55d640 1 --2- 10.20.193.68:0/1986752309 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea84130060 0x7fea841304a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.630 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.625+0000 7fea8a55d640 1 -- 10.20.193.68:0/1986752309 >> v2:10.20.193.68:3300/0 conn(0x7fea841309e0 msgr2=0x7fea841373f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:05.630 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.625+0000 7fea8a55d640 1 --2- 10.20.193.68:0/1986752309 >> v2:10.20.193.68:3300/0 conn(0x7fea841309e0 0x7fea841373f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.630 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.625+0000 7fea8a55d640 1 -- 10.20.193.68:0/1986752309 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea84074190 con 0x7fea8412d090 2026-02-18T21:02:05.631 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7f58ec105640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f58e412d970 0x7f58e4072790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:05.631 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7f58ec105640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f58e4073730 0x7f58e4130210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:05.631 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7f58ec105640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f58e412cf60 0x7f58e4130750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:05.631 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7f58ec105640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f58e4073fa0 con 0x7f58e4073730 2026-02-18T21:02:05.632 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7f58ec105640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f58e412d490 con 0x7f58e412cf60 2026-02-18T21:02:05.632 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7f58ec105640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f58e4072cd0 con 0x7f58e412d970 2026-02-18T21:02:05.632 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7f58e9e7a640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f58e412d970 0x7f58e4072790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:05.632 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7f58ea67b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f58e412cf60 0x7f58e4130750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:05.632 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7f58e9679640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f58e4073730 0x7f58e4130210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:05.632 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7f58e9e7a640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f58e412d970 0x7f58e4072790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:39814/0 (socket says 10.20.193.68:39814) 2026-02-18T21:02:05.632 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7f58e9e7a640 1 -- 10.20.193.68:0/787564801 learned_addr learned my addr 10.20.193.68:0/787564801 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:05.632 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7f58e9e7a640 1 -- 10.20.193.68:0/787564801 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f58e412cf60 msgr2=0x7f58e4130750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:05.632 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7f58e9e7a640 1 --2- 10.20.193.68:0/787564801 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f58e412cf60 0x7f58e4130750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.632 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7f58e9e7a640 1 -- 10.20.193.68:0/787564801 >> v2:10.20.193.68:3300/0 conn(0x7f58e4073730 msgr2=0x7f58e4130210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:05.632 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7f58e9e7a640 1 --2- 10.20.193.68:0/787564801 >> v2:10.20.193.68:3300/0 conn(0x7f58e4073730 0x7f58e4130210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.633 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7f58e9e7a640 1 -- 10.20.193.68:0/787564801 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e4130c90 con 0x7f58e412d970 2026-02-18T21:02:05.633 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7fea8a55d640 1 --2- 10.20.193.68:0/1986752309 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea8412d090 0x7fea8412d470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fea740099a0 tx=0x7fea7402eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57d75404143db5db server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:05.633 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7fea8955b640 1 -- 10.20.193.68:0/1986752309 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7403c070 con 0x7fea8412d090 2026-02-18T21:02:05.633 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7fea8955b640 1 -- 10.20.193.68:0/1986752309 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea7402fb20 con 0x7fea8412d090 2026-02-18T21:02:05.634 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7fea8955b640 1 -- 10.20.193.68:0/1986752309 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea74037440 con 0x7fea8412d090 2026-02-18T21:02:05.634 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7f58e9e7a640 1 --2- 10.20.193.68:0/787564801 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f58e412d970 0x7f58e4072790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f58d40099a0 tx=0x7f58d402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f62cee5627109c0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:05.634 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7fea8c7e8640 1 -- 10.20.193.68:0/1986752309 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea8412d090 msgr2=0x7fea8412d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:05.635 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7fea8c7e8640 1 --2- 10.20.193.68:0/1986752309 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea8412d090 0x7fea8412d470 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fea740099a0 tx=0x7fea7402eef0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.635 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7fea8c7e8640 1 -- 10.20.193.68:0/1986752309 shutdown_connections 2026-02-18T21:02:05.635 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7fea8c7e8640 1 --2- 10.20.193.68:0/1986752309 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea84130060 0x7fea841304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.635 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7fea8c7e8640 1 --2- 10.20.193.68:0/1986752309 >> v2:10.20.193.68:3300/0 conn(0x7fea841309e0 0x7fea841373f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.635 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7fea8c7e8640 1 --2- 10.20.193.68:0/1986752309 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea8412d090 0x7fea8412d470 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.635 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7fea8c7e8640 1 -- 10.20.193.68:0/1986752309 >> 10.20.193.68:0/1986752309 conn(0x7fea840a1c00 msgr2=0x7fea840a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:05.635 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7fea8c7e8640 1 -- 10.20.193.68:0/1986752309 shutdown_connections 2026-02-18T21:02:05.635 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7f58e8e78640 1 -- 10.20.193.68:0/787564801 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d403c070 con 0x7f58e412d970 2026-02-18T21:02:05.636 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7fea8c7e8640 1 -- 10.20.193.68:0/1986752309 wait complete. 2026-02-18T21:02:05.637 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7f58e8e78640 1 -- 10.20.193.68:0/787564801 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58d402fac0 con 0x7f58e412d970 2026-02-18T21:02:05.637 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.626+0000 7f58e8e78640 1 -- 10.20.193.68:0/787564801 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d4037440 con 0x7f58e412d970 2026-02-18T21:02:05.637 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7f58ec105640 1 -- 10.20.193.68:0/787564801 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f58e412d970 msgr2=0x7f58e4072790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:05.637 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7f58ec105640 1 --2- 10.20.193.68:0/787564801 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f58e412d970 0x7f58e4072790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f58d40099a0 tx=0x7f58d402ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:05.637 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7f58ec105640 1 -- 10.20.193.68:0/787564801 shutdown_connections 2026-02-18T21:02:05.637 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7f58ec105640 1 --2- 10.20.193.68:0/787564801 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f58e412cf60 0x7f58e4130750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.637 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7f58ec105640 1 --2- 10.20.193.68:0/787564801 >> v2:10.20.193.68:3300/0 conn(0x7f58e4073730 0x7f58e4130210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.637 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7f58ec105640 1 --2- 10.20.193.68:0/787564801 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f58e412d970 0x7f58e4072790 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.637 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7f58ec105640 1 -- 10.20.193.68:0/787564801 >> 10.20.193.68:0/787564801 conn(0x7f58e40a1d10 msgr2=0x7f58e40a2120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:05.637 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7f58ec105640 1 -- 10.20.193.68:0/787564801 shutdown_connections 2026-02-18T21:02:05.638 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7f58ec105640 1 -- 10.20.193.68:0/787564801 wait complete. 2026-02-18T21:02:05.639 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7fea8c7e8640 1 Processor -- start 2026-02-18T21:02:05.639 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7fea8c7e8640 1 -- start start 2026-02-18T21:02:05.639 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7fea8c7e8640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea8412d090 0x7fea8411c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:05.639 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7fea8c7e8640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea84130060 0x7fea8411cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:05.639 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7fea8c7e8640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fea841309e0 0x7fea8411d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:05.639 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7fea8c7e8640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fea8412cdb0 con 0x7fea841309e0 2026-02-18T21:02:05.639 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7fea8c7e8640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fea84073f40 con 0x7fea84130060 2026-02-18T21:02:05.640 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7fea8c7e8640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fea84072aa0 con 0x7fea8412d090 2026-02-18T21:02:05.640 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7fea8a55d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea8412d090 0x7fea8411c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:05.640 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7fea8a55d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea8412d090 0x7fea8411c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:39828/0 (socket says 10.20.193.68:39828) 2026-02-18T21:02:05.640 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7fea8a55d640 1 -- 10.20.193.68:0/2163843159 learned_addr learned my addr 10.20.193.68:0/2163843159 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:05.640 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7fea89d5c640 1 --2- 10.20.193.68:0/2163843159 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea84130060 0x7fea8411cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:05.640 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.627+0000 7fea8ad5e640 1 --2- 10.20.193.68:0/2163843159 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fea841309e0 0x7fea8411d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:05.640 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58ec105640 1 Processor -- start 2026-02-18T21:02:05.641 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7fea8a55d640 1 -- 10.20.193.68:0/2163843159 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea84130060 msgr2=0x7fea8411cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:05.641 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7fea8a55d640 1 --2- 10.20.193.68:0/2163843159 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea84130060 0x7fea8411cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.641 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7fea8a55d640 1 -- 10.20.193.68:0/2163843159 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fea841309e0 msgr2=0x7fea8411d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:05.641 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7fea8a55d640 1 --2- 10.20.193.68:0/2163843159 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fea841309e0 0x7fea8411d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.641 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7fea8a55d640 1 -- 10.20.193.68:0/2163843159 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8411f700 con 0x7fea8412d090 2026-02-18T21:02:05.641 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58ec105640 1 -- start start 2026-02-18T21:02:05.642 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7fea8a55d640 1 --2- 10.20.193.68:0/2163843159 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea8412d090 0x7fea8411c580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fea74009ad0 tx=0x7fea740047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:05.642 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7fea6affd640 1 -- 10.20.193.68:0/2163843159 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea74047070 con 0x7fea8412d090 2026-02-18T21:02:05.642 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f751a4a5640 1 Processor -- start 2026-02-18T21:02:05.643 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7fea6affd640 1 -- 10.20.193.68:0/2163843159 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea74004030 con 0x7fea8412d090 2026-02-18T21:02:05.643 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7fea8c7e8640 1 -- 10.20.193.68:0/2163843159 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea8411e720 con 0x7fea8412d090 2026-02-18T21:02:05.643 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7fea6affd640 1 -- 10.20.193.68:0/2163843159 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7403c040 con 0x7fea8412d090 2026-02-18T21:02:05.643 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f751a4a5640 1 -- start start 2026-02-18T21:02:05.644 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7fea8c7e8640 1 -- 10.20.193.68:0/2163843159 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fea841c70a0 con 0x7fea8412d090 2026-02-18T21:02:05.645 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58ec105640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f58e4073730 0x7f58e4125d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:05.645 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58ec105640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f58e412cf60 0x7f58e41262b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:05.645 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58ec105640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f58e412d970 0x7f58e41342f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:05.645 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58ec105640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f58e4137720 con 0x7f58e412d970 2026-02-18T21:02:05.645 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58ec105640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f58e41375a0 con 0x7f58e4073730 2026-02-18T21:02:05.645 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58ec105640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f58e41378a0 con 0x7f58e412cf60 2026-02-18T21:02:05.645 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58e9e7a640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f58e4073730 0x7f58e4125d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:05.645 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58e9679640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f58e412cf60 0x7f58e41262b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:05.645 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58e9e7a640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f58e4073730 0x7f58e4125d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:39250/0 (socket says 10.20.193.68:39250) 2026-02-18T21:02:05.646 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58e9e7a640 1 -- 10.20.193.68:0/4074664859 learned_addr learned my addr 10.20.193.68:0/4074664859 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:05.646 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58ea67b640 1 --2- 10.20.193.68:0/4074664859 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f58e412d970 0x7f58e41342f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:05.646 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f751a4a5640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f751412d090 0x7f751412d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:05.646 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f751a4a5640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f7514130060 0x7f75141304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:05.646 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f751a4a5640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75140726d0 con 0x7f75141309e0 2026-02-18T21:02:05.646 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f751a4a5640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f75140730a0 con 0x7f7514130060 2026-02-18T21:02:05.646 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f751a4a5640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f7514074190 con 0x7f751412d090 2026-02-18T21:02:05.647 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58e9e7a640 1 -- 10.20.193.68:0/4074664859 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f58e412cf60 msgr2=0x7f58e41262b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:05.647 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58e9e7a640 1 --2- 10.20.193.68:0/4074664859 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f58e412cf60 0x7f58e41262b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.647 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58e9e7a640 1 -- 10.20.193.68:0/4074664859 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f58e412d970 msgr2=0x7f58e41342f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:05.647 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58e9e7a640 1 --2- 10.20.193.68:0/4074664859 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f58e412d970 0x7f58e41342f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.647 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58e9e7a640 1 -- 10.20.193.68:0/4074664859 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e4136910 con 0x7f58e4073730 2026-02-18T21:02:05.648 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f7513fff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f751412d090 0x7f751412d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:05.648 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f75137fe640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f7514130060 0x7f75141304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:05.648 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f7518a1b640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f75141309e0 0x7f75141373f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:50664/0 (socket says 10.20.193.68:50664) 2026-02-18T21:02:05.648 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f7518a1b640 1 -- 10.20.193.68:0/1418608905 learned_addr learned my addr 10.20.193.68:0/1418608905 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:05.648 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58e9e7a640 1 --2- 10.20.193.68:0/4074664859 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f58e4073730 0x7f58e4125d70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f58d402f3a0 tx=0x7f58d40047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:05.649 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7fea8c7e8640 1 -- 10.20.193.68:0/2163843159 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea840687c0 con 0x7fea8412d090 2026-02-18T21:02:05.649 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f75137fe640 1 -- 10.20.193.68:0/1418608905 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f751412d090 msgr2=0x7f751412d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:05.649 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f75137fe640 1 --2- 10.20.193.68:0/1418608905 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f751412d090 0x7f751412d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.649 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f75137fe640 1 -- 10.20.193.68:0/1418608905 >> v1:10.20.193.68:6789/0 conn(0x7f75141309e0 legacy=0x7f75141373f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:05.649 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f75137fe640 1 -- 10.20.193.68:0/1418608905 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7514130e50 con 0x7f7514130060 2026-02-18T21:02:05.650 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58d27fc640 1 -- 10.20.193.68:0/4074664859 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d403c040 con 0x7f58e4073730 2026-02-18T21:02:05.650 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.628+0000 7f58d27fc640 1 -- 10.20.193.68:0/4074664859 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58d4045070 con 0x7f58e4073730 2026-02-18T21:02:05.650 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.629+0000 7f58ec105640 1 -- 10.20.193.68:0/4074664859 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e4136540 con 0x7f58e4073730 2026-02-18T21:02:05.650 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.629+0000 7f58d27fc640 1 -- 10.20.193.68:0/4074664859 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d4040850 con 0x7f58e4073730 2026-02-18T21:02:05.651 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.629+0000 7fea6affd640 1 -- 10.20.193.68:0/2163843159 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 7) ==== 61803+0+0 (secure 0 0 0) 0x7fea74004400 con 0x7fea8412d090 2026-02-18T21:02:05.651 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.629+0000 7f58ec105640 1 -- 10.20.193.68:0/4074664859 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e4136d80 con 0x7f58e4073730 2026-02-18T21:02:05.651 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.629+0000 7fea6affd640 1 -- 10.20.193.68:0/2163843159 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(20..20 src has 1..20) ==== 3021+0+0 (secure 0 0 0) 0x7fea7408b330 con 0x7fea8412d090 2026-02-18T21:02:05.652 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.629+0000 7f75137fe640 1 --2- 10.20.193.68:0/1418608905 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7514130060 0x7f75141304a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f75040098a0 tx=0x7f750402ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a95742aa9c434e server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:05.652 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.629+0000 7f7512ffd640 1 -- 10.20.193.68:0/1418608905 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750403c070 con 0x7f7514130060 2026-02-18T21:02:05.652 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.629+0000 7f7512ffd640 1 -- 10.20.193.68:0/1418608905 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f750402fad0 con 0x7f7514130060 2026-02-18T21:02:05.652 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.629+0000 7f7512ffd640 1 -- 10.20.193.68:0/1418608905 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7504037440 con 0x7f7514130060 2026-02-18T21:02:05.653 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.629+0000 7f58ec105640 1 -- 10.20.193.68:0/4074664859 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e4136fb0 con 0x7f58e4073730 2026-02-18T21:02:05.653 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.629+0000 7f58d27fc640 1 -- 10.20.193.68:0/4074664859 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 7) ==== 61803+0+0 (secure 0 0 0) 0x7f58d403f070 con 0x7f58e4073730 2026-02-18T21:02:05.653 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.629+0000 7f751a4a5640 1 -- 10.20.193.68:0/1418608905 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7514130060 msgr2=0x7f75141304a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:05.654 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.629+0000 7f751a4a5640 1 --2- 10.20.193.68:0/1418608905 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7514130060 0x7f75141304a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f75040098a0 tx=0x7f750402ee10 comp rx=0 tx=0).stop 2026-02-18T21:02:05.654 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.629+0000 7f751a4a5640 1 -- 10.20.193.68:0/1418608905 shutdown_connections 2026-02-18T21:02:05.654 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.629+0000 7f751a4a5640 1 --2- 10.20.193.68:0/1418608905 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7514130060 0x7f75141304a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.654 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.629+0000 7f751a4a5640 1 --2- 10.20.193.68:0/1418608905 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f751412d090 0x7f751412d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.654 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.629+0000 7f751a4a5640 1 -- 10.20.193.68:0/1418608905 >> 10.20.193.68:0/1418608905 conn(0x7f75140a1c00 msgr2=0x7f75140a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:05.654 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.629+0000 7f751a4a5640 1 -- 10.20.193.68:0/1418608905 shutdown_connections 2026-02-18T21:02:05.654 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.629+0000 7f751a4a5640 1 -- 10.20.193.68:0/1418608905 wait complete. 2026-02-18T21:02:05.654 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.630+0000 7f58d27fc640 1 -- 10.20.193.68:0/4074664859 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3021+0+0 (secure 0 0 0) 0x7f58d408b1d0 con 0x7f58e4073730 2026-02-18T21:02:05.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.630+0000 7f751a4a5640 1 Processor -- start 2026-02-18T21:02:05.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.630+0000 7f751a4a5640 1 -- start start 2026-02-18T21:02:05.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.630+0000 7f751a4a5640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f751412d090 0x7f751411c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:05.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.630+0000 7f751a4a5640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7514130060 0x7f751411c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:05.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.630+0000 7f751a4a5640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f75141309e0 0x7f751411cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:05.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.630+0000 7f751a4a5640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f751412cdb0 con 0x7f751412d090 2026-02-18T21:02:05.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.630+0000 7f751a4a5640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f751412d9b0 con 0x7f75141309e0 2026-02-18T21:02:05.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.630+0000 7f751a4a5640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f7514072aa0 con 0x7f7514130060 2026-02-18T21:02:05.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.630+0000 7f7513fff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f751412d090 0x7f751411c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:05.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.630+0000 7f7513fff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f751412d090 0x7f751411c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:47524/0 (socket says 10.20.193.68:47524) 2026-02-18T21:02:05.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.630+0000 7f7513fff640 1 -- 10.20.193.68:0/4146405202 learned_addr learned my addr 10.20.193.68:0/4146405202 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:05.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.630+0000 7f7518a1b640 1 --2- 10.20.193.68:0/4146405202 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f75141309e0 0x7f751411cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:05.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.630+0000 7f75137fe640 1 --2- 10.20.193.68:0/4146405202 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7514130060 0x7f751411c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:05.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.630+0000 7f7513fff640 1 -- 10.20.193.68:0/4146405202 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7514130060 msgr2=0x7f751411c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:05.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.630+0000 7f7513fff640 1 --2- 10.20.193.68:0/4146405202 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7514130060 0x7f751411c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.630+0000 7f7513fff640 1 -- 10.20.193.68:0/4146405202 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f75141309e0 msgr2=0x7f751411cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:05.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.630+0000 7f7513fff640 1 --2- 10.20.193.68:0/4146405202 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f75141309e0 0x7f751411cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.630+0000 7f7513fff640 1 -- 10.20.193.68:0/4146405202 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751411df90 con 0x7f751412d090 2026-02-18T21:02:05.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.631+0000 7f7513fff640 1 --2- 10.20.193.68:0/4146405202 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f751412d090 0x7f751411c420 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f750000ebe0 tx=0x7f750000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:05.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.631+0000 7f7510ff9640 1 -- 10.20.193.68:0/4146405202 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7500017070 con 0x7f751412d090 2026-02-18T21:02:05.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.631+0000 7f7510ff9640 1 -- 10.20.193.68:0/4146405202 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f750000cc40 con 0x7f751412d090 2026-02-18T21:02:05.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.631+0000 7f751a4a5640 1 -- 10.20.193.68:0/4146405202 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751411f350 con 0x7f751412d090 2026-02-18T21:02:05.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.631+0000 7f7510ff9640 1 -- 10.20.193.68:0/4146405202 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7500013470 con 0x7f751412d090 2026-02-18T21:02:05.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.631+0000 7f751a4a5640 1 -- 10.20.193.68:0/4146405202 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75141c73d0 con 0x7f751412d090 2026-02-18T21:02:05.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.631+0000 7fea6affd640 1 -- 10.20.193.68:0/2163843159 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+144236 (secure 0 0 0) 0x7fea7408a190 con 0x7fea8412d090 2026-02-18T21:02:05.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.631+0000 7f751a4a5640 1 -- 10.20.193.68:0/4146405202 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75140687c0 con 0x7f751412d090 2026-02-18T21:02:05.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.631+0000 7f7510ff9640 1 -- 10.20.193.68:0/4146405202 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 7) ==== 61803+0+0 (secure 0 0 0) 0x7f7500024060 con 0x7f751412d090 2026-02-18T21:02:05.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.631+0000 7f58d27fc640 1 -- 10.20.193.68:0/4074664859 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+144236 (secure 0 0 0) 0x7f58d40080a0 con 0x7f58e4073730 2026-02-18T21:02:05.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.632+0000 7f7510ff9640 1 -- 10.20.193.68:0/4146405202 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3021+0+0 (secure 0 0 0) 0x7f7500066710 con 0x7f751412d090 2026-02-18T21:02:05.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.634+0000 7f7510ff9640 1 -- 10.20.193.68:0/4146405202 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+144236 (secure 0 0 0) 0x7f7500065660 con 0x7f751412d090 2026-02-18T21:02:05.694 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.693+0000 7fea8c7e8640 1 -- 10.20.193.68:0/2163843159 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fea8411f100 con 0x7fea8412d090 2026-02-18T21:02:05.694 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.693+0000 7fea6affd640 1 -- 10.20.193.68:0/2163843159 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fea74064820 con 0x7fea8412d090 2026-02-18T21:02:05.694 INFO:teuthology.orchestra.run.trial068.stdout:38654705675 2026-02-18T21:02:05.695 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.694+0000 7fea8c7e8640 1 -- 10.20.193.68:0/2163843159 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea8412d090 msgr2=0x7fea8411c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:05.696 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.694+0000 7fea8c7e8640 1 --2- 10.20.193.68:0/2163843159 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea8412d090 0x7fea8411c580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fea74009ad0 tx=0x7fea740047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.696 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.694+0000 7fea8c7e8640 1 -- 10.20.193.68:0/2163843159 shutdown_connections 2026-02-18T21:02:05.696 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.694+0000 7fea8c7e8640 1 --2- 10.20.193.68:0/2163843159 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fea841309e0 0x7fea8411d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.696 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.694+0000 7fea8c7e8640 1 --2- 10.20.193.68:0/2163843159 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea84130060 0x7fea8411cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.696 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.694+0000 7fea8c7e8640 1 --2- 10.20.193.68:0/2163843159 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea8412d090 0x7fea8411c580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.696 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.694+0000 7fea8c7e8640 1 -- 10.20.193.68:0/2163843159 >> 10.20.193.68:0/2163843159 conn(0x7fea840a1c00 msgr2=0x7fea8406e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:05.696 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.694+0000 7fea8c7e8640 1 -- 10.20.193.68:0/2163843159 shutdown_connections 2026-02-18T21:02:05.696 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.694+0000 7fea8c7e8640 1 -- 10.20.193.68:0/2163843159 wait complete. 2026-02-18T21:02:05.697 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.696+0000 7f58ec105640 1 -- 10.20.193.68:0/4074664859 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f58e4072790 con 0x7f58e4073730 2026-02-18T21:02:05.697 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.696+0000 7f58d27fc640 1 -- 10.20.193.68:0/4074664859 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f58d402f980 con 0x7f58e4073730 2026-02-18T21:02:05.697 INFO:teuthology.orchestra.run.trial068.stdout:38654705675 2026-02-18T21:02:05.698 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.697+0000 7f58ec105640 1 -- 10.20.193.68:0/4074664859 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f58e4073730 msgr2=0x7f58e4125d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:05.698 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.697+0000 7f58ec105640 1 --2- 10.20.193.68:0/4074664859 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f58e4073730 0x7f58e4125d70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f58d402f3a0 tx=0x7f58d40047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.698 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.697+0000 7f58ec105640 1 -- 10.20.193.68:0/4074664859 shutdown_connections 2026-02-18T21:02:05.699 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.697+0000 7f58ec105640 1 --2- 10.20.193.68:0/4074664859 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f58e412d970 0x7f58e41342f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.699 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.697+0000 7f58ec105640 1 --2- 10.20.193.68:0/4074664859 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f58e412cf60 0x7f58e41262b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.699 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.697+0000 7f58ec105640 1 --2- 10.20.193.68:0/4074664859 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f58e4073730 0x7f58e4125d70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.699 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.697+0000 7f58ec105640 1 -- 10.20.193.68:0/4074664859 >> 10.20.193.68:0/4074664859 conn(0x7f58e40a1d10 msgr2=0x7f58e40703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:05.699 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.697+0000 7f58ec105640 1 -- 10.20.193.68:0/4074664859 shutdown_connections 2026-02-18T21:02:05.699 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.697+0000 7f58ec105640 1 -- 10.20.193.68:0/4074664859 wait complete. 2026-02-18T21:02:05.699 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.697+0000 7f751a4a5640 1 -- 10.20.193.68:0/4146405202 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f751412d470 con 0x7f751412d090 2026-02-18T21:02:05.700 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.697+0000 7f7510ff9640 1 -- 10.20.193.68:0/4146405202 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f750003fbe0 con 0x7f751412d090 2026-02-18T21:02:05.700 INFO:teuthology.orchestra.run.trial068.stdout:38654705674 2026-02-18T21:02:05.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.699+0000 7f751a4a5640 1 -- 10.20.193.68:0/4146405202 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f751412d090 msgr2=0x7f751411c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:05.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.699+0000 7f751a4a5640 1 --2- 10.20.193.68:0/4146405202 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f751412d090 0x7f751411c420 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f750000ebe0 tx=0x7f750000c520 comp rx=0 tx=0).stop 2026-02-18T21:02:05.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.699+0000 7f751a4a5640 1 -- 10.20.193.68:0/4146405202 shutdown_connections 2026-02-18T21:02:05.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.699+0000 7f751a4a5640 1 --2- 10.20.193.68:0/4146405202 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f75141309e0 0x7f751411cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.699+0000 7f751a4a5640 1 --2- 10.20.193.68:0/4146405202 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7514130060 0x7f751411c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.699+0000 7f751a4a5640 1 --2- 10.20.193.68:0/4146405202 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f751412d090 0x7f751411c420 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:05.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.699+0000 7f751a4a5640 1 -- 10.20.193.68:0/4146405202 >> 10.20.193.68:0/4146405202 conn(0x7f75140a1c00 msgr2=0x7f751406e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:05.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.699+0000 7f751a4a5640 1 -- 10.20.193.68:0/4146405202 shutdown_connections 2026-02-18T21:02:05.701 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:05.699+0000 7f751a4a5640 1 -- 10.20.193.68:0/4146405202 wait complete. 2026-02-18T21:02:05.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705676 got 38654705675 for osd.3 2026-02-18T21:02:05.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705676 got 38654705675 for osd.2 2026-02-18T21:02:05.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705675 got 38654705674 for osd.0 2026-02-18T21:02:05.999 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:05.998+0000 7f9f0f192640 -1 mgr.server handle_report got status from non-daemon mon.a 2026-02-18T21:02:06.001 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:06.000+0000 7f9f0f192640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-18T21:02:06.001 INFO:tasks.ceph.mgr.x.trial068.stderr:2026-02-18T21:02:06.000+0000 7f9f0f192640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-18T21:02:06.704 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-18T21:02:06.708 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-18T21:02:06.709 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-18T21:02:06.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.770+0000 7fa379fe1640 1 Processor -- start 2026-02-18T21:02:06.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.770+0000 7fa379fe1640 1 -- start start 2026-02-18T21:02:06.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.770+0000 7fa379fe1640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa374072e20 0x7fa374073200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:06.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.770+0000 7fa379fe1640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fa374123600 0x7fa374135100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:06.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.770+0000 7fa379fe1640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa37409e050 con 0x7fa374073740 2026-02-18T21:02:06.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.770+0000 7fa379fe1640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7fa374071520 con 0x7fa374123600 2026-02-18T21:02:06.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.770+0000 7fa379fe1640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fa374115730 con 0x7fa374072e20 2026-02-18T21:02:06.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.770+0000 7fa3737fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa374072e20 0x7fa374073200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:06.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.770+0000 7fa3737fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa374072e20 0x7fa374073200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:39862/0 (socket says 10.20.193.68:39862) 2026-02-18T21:02:06.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.770+0000 7fa3737fe640 1 -- 10.20.193.68:0/2374544496 learned_addr learned my addr 10.20.193.68:0/2374544496 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:06.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.770+0000 7fa373fff640 1 --2- 10.20.193.68:0/2374544496 >> v2:10.20.193.68:3300/0 conn(0x7fa374123600 0x7fa374135100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:06.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.771+0000 7fa3737fe640 1 -- 10.20.193.68:0/2374544496 >> v2:10.20.193.68:3300/0 conn(0x7fa374123600 msgr2=0x7fa374135100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:06.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.771+0000 7fa3737fe640 1 --2- 10.20.193.68:0/2374544496 >> v2:10.20.193.68:3300/0 conn(0x7fa374123600 0x7fa374135100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.771+0000 7fa3737fe640 1 -- 10.20.193.68:0/2374544496 >> v1:10.20.193.68:6789/0 conn(0x7fa374073740 legacy=0x7fa374122ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:06.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.771+0000 7fa3737fe640 1 -- 10.20.193.68:0/2374544496 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3741159f0 con 0x7fa374072e20 2026-02-18T21:02:06.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.771+0000 7fa3727fc640 1 -- 10.20.193.68:0/2374544496 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3397956334 0 0) 0x7fa37409e050 con 0x7fa374073740 2026-02-18T21:02:06.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.771+0000 7fa3737fe640 1 --2- 10.20.193.68:0/2374544496 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa374072e20 0x7fa374073200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa374115900 tx=0x7fa36002ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9d9a8ba9a4542e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:06.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.771+0000 7fa3727fc640 1 -- 10.20.193.68:0/2374544496 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36003c070 con 0x7fa374072e20 2026-02-18T21:02:06.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.771+0000 7fa3727fc640 1 -- 10.20.193.68:0/2374544496 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36002fb00 con 0x7fa374072e20 2026-02-18T21:02:06.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.771+0000 7fa3727fc640 1 -- 10.20.193.68:0/2374544496 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa360037440 con 0x7fa374072e20 2026-02-18T21:02:06.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.771+0000 7fa379fe1640 1 -- 10.20.193.68:0/2374544496 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa374072e20 msgr2=0x7fa374073200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:06.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.771+0000 7fa379fe1640 1 --2- 10.20.193.68:0/2374544496 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa374072e20 0x7fa374073200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa374115900 tx=0x7fa36002ee80 comp rx=0 tx=0).stop 2026-02-18T21:02:06.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.772+0000 7fa379fe1640 1 -- 10.20.193.68:0/2374544496 shutdown_connections 2026-02-18T21:02:06.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.772+0000 7fa379fe1640 1 --2- 10.20.193.68:0/2374544496 >> v2:10.20.193.68:3300/0 conn(0x7fa374123600 0x7fa374135100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.772+0000 7fa379fe1640 1 --2- 10.20.193.68:0/2374544496 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa374072e20 0x7fa374073200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.772+0000 7fa379fe1640 1 -- 10.20.193.68:0/2374544496 >> 10.20.193.68:0/2374544496 conn(0x7fa37409cea0 msgr2=0x7fa37409d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:06.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.772+0000 7fa379fe1640 1 -- 10.20.193.68:0/2374544496 shutdown_connections 2026-02-18T21:02:06.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.772+0000 7fa379fe1640 1 -- 10.20.193.68:0/2374544496 wait complete. 2026-02-18T21:02:06.777 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.772+0000 7fa379fe1640 1 Processor -- start 2026-02-18T21:02:06.777 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.772+0000 7fa379fe1640 1 -- start start 2026-02-18T21:02:06.779 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.772+0000 7fa379fe1640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa374072e20 0x7fa3741c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:06.779 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.772+0000 7fa379fe1640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa374073740 0x7fa3741c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:06.779 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.772+0000 7fa379fe1640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa374123600 0x7fa3741241f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:06.779 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.772+0000 7fa379fe1640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fa374123a70 con 0x7fa374073740 2026-02-18T21:02:06.779 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.772+0000 7fa379fe1640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fa374073b40 con 0x7fa374072e20 2026-02-18T21:02:06.780 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.772+0000 7fa379fe1640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fa374123bf0 con 0x7fa374123600 2026-02-18T21:02:06.780 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.772+0000 7fa372ffd640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa374073740 0x7fa3741c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:06.780 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.772+0000 7fa373fff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa374123600 0x7fa3741241f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:06.780 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.772+0000 7fa372ffd640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa374073740 0x7fa3741c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:47532/0 (socket says 10.20.193.68:47532) 2026-02-18T21:02:06.780 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.772+0000 7fa3737fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa374072e20 0x7fa3741c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:06.780 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.773+0000 7fa372ffd640 1 -- 10.20.193.68:0/2975879965 learned_addr learned my addr 10.20.193.68:0/2975879965 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:06.780 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.773+0000 7fa372ffd640 1 -- 10.20.193.68:0/2975879965 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa374123600 msgr2=0x7fa3741241f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:06.780 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.773+0000 7fa372ffd640 1 --2- 10.20.193.68:0/2975879965 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa374123600 0x7fa3741241f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.780 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.773+0000 7fa372ffd640 1 -- 10.20.193.68:0/2975879965 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa374072e20 msgr2=0x7fa3741c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:06.780 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.773+0000 7fa372ffd640 1 --2- 10.20.193.68:0/2975879965 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa374072e20 0x7fa3741c70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.780 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.773+0000 7fa372ffd640 1 -- 10.20.193.68:0/2975879965 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37411e330 con 0x7fa374073740 2026-02-18T21:02:06.780 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.773+0000 7fa372ffd640 1 --2- 10.20.193.68:0/2975879965 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa374073740 0x7fa3741c75e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa36400c520 tx=0x7fa36400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:06.781 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.773+0000 7fa34ffff640 1 -- 10.20.193.68:0/2975879965 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa364005480 con 0x7fa374073740 2026-02-18T21:02:06.781 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.773+0000 7fa34ffff640 1 -- 10.20.193.68:0/2975879965 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3640036f0 con 0x7fa374073740 2026-02-18T21:02:06.781 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.773+0000 7fa34ffff640 1 -- 10.20.193.68:0/2975879965 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa364003b20 con 0x7fa374073740 2026-02-18T21:02:06.781 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.773+0000 7fa379fe1640 1 -- 10.20.193.68:0/2975879965 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3741c7b20 con 0x7fa374073740 2026-02-18T21:02:06.781 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.773+0000 7fa379fe1640 1 -- 10.20.193.68:0/2975879965 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa37411d960 con 0x7fa374073740 2026-02-18T21:02:06.781 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.773+0000 7fa379fe1640 1 -- 10.20.193.68:0/2975879965 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa374073200 con 0x7fa374073740 2026-02-18T21:02:06.781 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.774+0000 7fa34ffff640 1 -- 10.20.193.68:0/2975879965 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 8) ==== 61895+0+0 (secure 0 0 0) 0x7fa364003cc0 con 0x7fa374073740 2026-02-18T21:02:06.781 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.774+0000 7fa34ffff640 1 -- 10.20.193.68:0/2975879965 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3021+0+0 (secure 0 0 0) 0x7fa364066560 con 0x7fa374073740 2026-02-18T21:02:06.781 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.776+0000 7fa34ffff640 1 -- 10.20.193.68:0/2975879965 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fa3640404d0 con 0x7fa374073740 2026-02-18T21:02:06.817 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f254ac0c640 1 Processor -- start 2026-02-18T21:02:06.817 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f254ac0c640 1 -- start start 2026-02-18T21:02:06.818 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f7c2ef06640 1 Processor -- start 2026-02-18T21:02:06.818 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f7c2ef06640 1 -- start start 2026-02-18T21:02:06.819 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f254ac0c640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2544114bb0 0x7f2544114f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:06.819 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f254ac0c640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f25441154d0 0x7f2544137bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:06.819 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f254ac0c640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f254409e050 con 0x7f2544071420 2026-02-18T21:02:06.819 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f254ac0c640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f2544116910 con 0x7f2544114bb0 2026-02-18T21:02:06.819 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f254ac0c640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f2544116090 con 0x7f25441154d0 2026-02-18T21:02:06.819 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f2548981640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2544114bb0 0x7f2544114f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:06.819 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f2548981640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2544114bb0 0x7f2544114f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:39282/0 (socket says 10.20.193.68:39282) 2026-02-18T21:02:06.819 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f2548981640 1 -- 10.20.193.68:0/2470481073 learned_addr learned my addr 10.20.193.68:0/2470481073 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:06.819 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f2549182640 1 --2- 10.20.193.68:0/2470481073 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f25441154d0 0x7f2544137bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:06.820 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f7c2ef06640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7c28134a00 0x7f7c28134de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:06.821 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f7c2ef06640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7c28071420 0x7f7c28071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:06.821 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f7c2ef06640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f7c28071dc0 0x7f7c2813b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:06.821 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f7c2ef06640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f7c28134540 con 0x7f7c28071dc0 2026-02-18T21:02:06.821 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f7c2ef06640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f7c28073e60 con 0x7f7c28071420 2026-02-18T21:02:06.821 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f7c2ef06640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f7c28072270 con 0x7f7c28134a00 2026-02-18T21:02:06.821 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f7c2cc7b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7c28134a00 0x7f7c28134de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:06.821 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f7c1ffff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7c28071420 0x7f7c28071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:06.821 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f7c2cc7b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7c28134a00 0x7f7c28134de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:39876/0 (socket says 10.20.193.68:39876) 2026-02-18T21:02:06.821 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f7c2cc7b640 1 -- 10.20.193.68:0/127528840 learned_addr learned my addr 10.20.193.68:0/127528840 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:06.822 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f2548981640 1 -- 10.20.193.68:0/2470481073 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f25441154d0 msgr2=0x7f2544137bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:06.822 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f2548981640 1 --2- 10.20.193.68:0/2470481073 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f25441154d0 0x7f2544137bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.822 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f2548981640 1 -- 10.20.193.68:0/2470481073 >> v1:10.20.193.68:6789/0 conn(0x7f2544071420 legacy=0x7f25441344c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:06.822 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f2548981640 1 -- 10.20.193.68:0/2470481073 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2544115940 con 0x7f2544114bb0 2026-02-18T21:02:06.823 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.815+0000 7f7c2d47c640 1 --2- 10.20.193.68:0/127528840 >> v2:10.20.193.68:3300/0 conn(0x7f7c28071dc0 0x7f7c2813b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:06.823 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f7c2cc7b640 1 -- 10.20.193.68:0/127528840 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7c28071420 msgr2=0x7f7c28071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:06.823 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f7c2cc7b640 1 --2- 10.20.193.68:0/127528840 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7c28071420 0x7f7c28071880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.823 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f7c2cc7b640 1 -- 10.20.193.68:0/127528840 >> v2:10.20.193.68:3300/0 conn(0x7f7c28071dc0 msgr2=0x7f7c2813b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:06.823 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f7c2cc7b640 1 --2- 10.20.193.68:0/127528840 >> v2:10.20.193.68:3300/0 conn(0x7f7c28071dc0 0x7f7c2813b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.823 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f7c2cc7b640 1 -- 10.20.193.68:0/127528840 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2809e050 con 0x7f7c28134a00 2026-02-18T21:02:06.823 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f7c1ffff640 1 --2- 10.20.193.68:0/127528840 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7c28071420 0x7f7c28071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:06.824 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f2548981640 1 --2- 10.20.193.68:0/2470481073 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2544114bb0 0x7f2544114f90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f25340099a0 tx=0x7f253402ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31d4b3423f378f23 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:06.824 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f253b7fe640 1 -- 10.20.193.68:0/2470481073 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253403c070 con 0x7f2544114bb0 2026-02-18T21:02:06.824 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f253b7fe640 1 -- 10.20.193.68:0/2470481073 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f253402fb00 con 0x7f2544114bb0 2026-02-18T21:02:06.824 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f253b7fe640 1 -- 10.20.193.68:0/2470481073 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534037440 con 0x7f2544114bb0 2026-02-18T21:02:06.825 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f7c2cc7b640 1 --2- 10.20.193.68:0/127528840 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7c28134a00 0x7f7c28134de0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7c180099a0 tx=0x7f7c1802ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9eec2e08cc09604 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:06.825 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f7c1f7fe640 1 -- 10.20.193.68:0/127528840 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1803c070 con 0x7f7c28134a00 2026-02-18T21:02:06.825 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f7c1f7fe640 1 -- 10.20.193.68:0/127528840 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c1802fac0 con 0x7f7c28134a00 2026-02-18T21:02:06.825 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f7c1f7fe640 1 -- 10.20.193.68:0/127528840 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c18037440 con 0x7f7c28134a00 2026-02-18T21:02:06.826 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f254ac0c640 1 -- 10.20.193.68:0/2470481073 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2544114bb0 msgr2=0x7f2544114f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:06.826 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f254ac0c640 1 --2- 10.20.193.68:0/2470481073 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2544114bb0 0x7f2544114f90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f25340099a0 tx=0x7f253402ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:06.826 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f254ac0c640 1 -- 10.20.193.68:0/2470481073 shutdown_connections 2026-02-18T21:02:06.826 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f254ac0c640 1 --2- 10.20.193.68:0/2470481073 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f25441154d0 0x7f2544137bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.826 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f254ac0c640 1 --2- 10.20.193.68:0/2470481073 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2544114bb0 0x7f2544114f90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.826 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f254ac0c640 1 -- 10.20.193.68:0/2470481073 >> 10.20.193.68:0/2470481073 conn(0x7f254409cea0 msgr2=0x7f254409d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:06.826 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f254ac0c640 1 -- 10.20.193.68:0/2470481073 shutdown_connections 2026-02-18T21:02:06.827 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f254ac0c640 1 -- 10.20.193.68:0/2470481073 wait complete. 2026-02-18T21:02:06.827 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f7c2ef06640 1 -- 10.20.193.68:0/127528840 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7c28134a00 msgr2=0x7f7c28134de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:06.827 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f7c2ef06640 1 --2- 10.20.193.68:0/127528840 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7c28134a00 0x7f7c28134de0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7c180099a0 tx=0x7f7c1802ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:06.827 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f7c2ef06640 1 -- 10.20.193.68:0/127528840 shutdown_connections 2026-02-18T21:02:06.828 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f7c2ef06640 1 --2- 10.20.193.68:0/127528840 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7c28071420 0x7f7c28071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.828 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f7c2ef06640 1 --2- 10.20.193.68:0/127528840 >> v2:10.20.193.68:3300/0 conn(0x7f7c28071dc0 0x7f7c2813b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.828 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f7c2ef06640 1 --2- 10.20.193.68:0/127528840 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7c28134a00 0x7f7c28134de0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.828 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f7c2ef06640 1 -- 10.20.193.68:0/127528840 >> 10.20.193.68:0/127528840 conn(0x7f7c2809cea0 msgr2=0x7f7c2809d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:06.828 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f7c2ef06640 1 -- 10.20.193.68:0/127528840 shutdown_connections 2026-02-18T21:02:06.828 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.816+0000 7f7c2ef06640 1 -- 10.20.193.68:0/127528840 wait complete. 2026-02-18T21:02:06.828 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f254ac0c640 1 Processor -- start 2026-02-18T21:02:06.829 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f254ac0c640 1 -- start start 2026-02-18T21:02:06.829 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c2ef06640 1 Processor -- start 2026-02-18T21:02:06.829 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c2ef06640 1 -- start start 2026-02-18T21:02:06.830 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f254ac0c640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2544071420 0x7f254411fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:06.830 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f254ac0c640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2544114bb0 0x7f25441203b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:06.830 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f254ac0c640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f25441154d0 0x7f25441208f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:06.830 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f254ac0c640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f25441382b0 con 0x7f25441154d0 2026-02-18T21:02:06.830 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f254ac0c640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f2544138130 con 0x7f2544114bb0 2026-02-18T21:02:06.830 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f254ac0c640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f2544138430 con 0x7f2544071420 2026-02-18T21:02:06.830 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f2548981640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2544071420 0x7f254411fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:06.831 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f253bfff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2544114bb0 0x7f25441203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:06.831 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c2ef06640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7c28071420 0x7f7c2812e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:06.831 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c2ef06640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7c28071dc0 0x7f7c281241c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:06.832 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f2548981640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2544071420 0x7f254411fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:39886/0 (socket says 10.20.193.68:39886) 2026-02-18T21:02:06.832 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f2548981640 1 -- 10.20.193.68:0/3403424825 learned_addr learned my addr 10.20.193.68:0/3403424825 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:06.832 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f2549182640 1 --2- 10.20.193.68:0/3403424825 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f25441154d0 0x7f25441208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:06.833 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c2ef06640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7c28134a00 0x7f7c28124700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:06.833 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c2ef06640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f7c28135320 con 0x7f7c28134a00 2026-02-18T21:02:06.833 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c2ef06640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f7c28072d10 con 0x7f7c28071420 2026-02-18T21:02:06.833 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c2ef06640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f7c28127a30 con 0x7f7c28071dc0 2026-02-18T21:02:06.833 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c1ffff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7c28071dc0 0x7f7c281241c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:06.833 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c2cc7b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7c28071420 0x7f7c2812e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:06.833 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c2d47c640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7c28134a00 0x7f7c28124700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:06.833 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c2cc7b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7c28071420 0x7f7c2812e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:39300/0 (socket says 10.20.193.68:39300) 2026-02-18T21:02:06.833 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c1ffff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7c28071dc0 0x7f7c281241c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:39888/0 (socket says 10.20.193.68:39888) 2026-02-18T21:02:06.833 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c2cc7b640 1 -- 10.20.193.68:0/111263091 learned_addr learned my addr 10.20.193.68:0/111263091 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:06.834 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f2548981640 1 -- 10.20.193.68:0/3403424825 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2544114bb0 msgr2=0x7f25441203b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:06.834 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f2548981640 1 --2- 10.20.193.68:0/3403424825 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2544114bb0 0x7f25441203b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.834 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f2548981640 1 -- 10.20.193.68:0/3403424825 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f25441154d0 msgr2=0x7f25441208f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:06.835 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f2548981640 1 --2- 10.20.193.68:0/3403424825 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f25441154d0 0x7f25441208f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.835 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f2548981640 1 -- 10.20.193.68:0/3403424825 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2544121770 con 0x7f2544071420 2026-02-18T21:02:06.835 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f253bfff640 1 --2- 10.20.193.68:0/3403424825 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2544114bb0 0x7f25441203b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:06.835 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f2549182640 1 --2- 10.20.193.68:0/3403424825 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f25441154d0 0x7f25441208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:06.835 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c2cc7b640 1 -- 10.20.193.68:0/111263091 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7c28071dc0 msgr2=0x7f7c281241c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:06.836 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c2cc7b640 1 --2- 10.20.193.68:0/111263091 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7c28071dc0 0x7f7c281241c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.836 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c2cc7b640 1 -- 10.20.193.68:0/111263091 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7c28134a00 msgr2=0x7f7c28124700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:06.836 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c2cc7b640 1 --2- 10.20.193.68:0/111263091 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7c28134a00 0x7f7c28124700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.836 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c2cc7b640 1 -- 10.20.193.68:0/111263091 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c28125d30 con 0x7f7c28071420 2026-02-18T21:02:06.836 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f2548981640 1 --2- 10.20.193.68:0/3403424825 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2544071420 0x7f254411fe70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2534009ad0 tx=0x7f25340047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:06.836 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c1ffff640 1 --2- 10.20.193.68:0/111263091 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7c28071dc0 0x7f7c281241c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:06.837 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.817+0000 7f7c2d47c640 1 --2- 10.20.193.68:0/111263091 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7c28134a00 0x7f7c28124700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:06.837 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.818+0000 7f25397fa640 1 -- 10.20.193.68:0/3403424825 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253403c040 con 0x7f2544071420 2026-02-18T21:02:06.837 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.818+0000 7f7c2cc7b640 1 --2- 10.20.193.68:0/111263091 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7c28071420 0x7f7c2812e780 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7c18009ad0 tx=0x7f7c180047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:06.838 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.818+0000 7f25397fa640 1 -- 10.20.193.68:0/3403424825 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2534042650 con 0x7f2544071420 2026-02-18T21:02:06.838 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.818+0000 7f254ac0c640 1 -- 10.20.193.68:0/3403424825 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2544120e90 con 0x7f2544071420 2026-02-18T21:02:06.838 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.818+0000 7f25397fa640 1 -- 10.20.193.68:0/3403424825 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534042a40 con 0x7f2544071420 2026-02-18T21:02:06.838 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.818+0000 7f254ac0c640 1 -- 10.20.193.68:0/3403424825 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f2544122a50 con 0x7f2544071420 2026-02-18T21:02:06.839 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.818+0000 7f7c1d7fa640 1 -- 10.20.193.68:0/111263091 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c18046020 con 0x7f7c28071420 2026-02-18T21:02:06.839 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.818+0000 7f7c1d7fa640 1 -- 10.20.193.68:0/111263091 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c18042620 con 0x7f7c28071420 2026-02-18T21:02:06.839 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.818+0000 7f7c1d7fa640 1 -- 10.20.193.68:0/111263091 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1803c040 con 0x7f7c28071420 2026-02-18T21:02:06.839 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.818+0000 7f7c2ef06640 1 -- 10.20.193.68:0/111263091 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c281265c0 con 0x7f7c28071420 2026-02-18T21:02:06.839 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.818+0000 7f7c2ef06640 1 -- 10.20.193.68:0/111263091 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c28124e20 con 0x7f7c28071420 2026-02-18T21:02:06.839 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.818+0000 7f7c2ef06640 1 -- 10.20.193.68:0/111263091 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c2809d280 con 0x7f7c28071420 2026-02-18T21:02:06.840 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.818+0000 7f254ac0c640 1 -- 10.20.193.68:0/3403424825 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2544114f90 con 0x7f2544071420 2026-02-18T21:02:06.840 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.818+0000 7f25397fa640 1 -- 10.20.193.68:0/3403424825 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 8) ==== 61895+0+0 (secure 0 0 0) 0x7f2534042be0 con 0x7f2544071420 2026-02-18T21:02:06.840 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.818+0000 7f7c1d7fa640 1 -- 10.20.193.68:0/111263091 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 8) ==== 61895+0+0 (secure 0 0 0) 0x7f7c1803f030 con 0x7f7c28071420 2026-02-18T21:02:06.840 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.819+0000 7f7c1d7fa640 1 -- 10.20.193.68:0/111263091 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3021+0+0 (secure 0 0 0) 0x7f7c1808bb30 con 0x7f7c28071420 2026-02-18T21:02:06.841 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.819+0000 7f25397fa640 1 -- 10.20.193.68:0/3403424825 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(20..20 src has 1..20) ==== 3021+0+0 (secure 0 0 0) 0x7f253408bc60 con 0x7f2544071420 2026-02-18T21:02:06.841 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.821+0000 7f7c1d7fa640 1 -- 10.20.193.68:0/111263091 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f7c2809d280 con 0x7f7c28071420 2026-02-18T21:02:06.841 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.821+0000 7f25397fa640 1 -- 10.20.193.68:0/3403424825 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f2534065c60 con 0x7f2544071420 2026-02-18T21:02:06.856 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.854+0000 7fa379fe1640 1 -- 10.20.193.68:0/2975879965 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa374125c90 con 0x7fa374073740 2026-02-18T21:02:06.856 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.854+0000 7fa34ffff640 1 -- 10.20.193.68:0/2975879965 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa3640652d0 con 0x7fa374073740 2026-02-18T21:02:06.856 INFO:teuthology.orchestra.run.trial068.stdout:38654705675 2026-02-18T21:02:06.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.855+0000 7fa379fe1640 1 -- 10.20.193.68:0/2975879965 >> v1:10.20.193.68:6816/2904515774 conn(0x7fa34404f5e0 legacy=0x7fa344051aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:06.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.855+0000 7fa379fe1640 1 -- 10.20.193.68:0/2975879965 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa374073740 msgr2=0x7fa3741c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:06.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.855+0000 7fa379fe1640 1 --2- 10.20.193.68:0/2975879965 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa374073740 0x7fa3741c75e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa36400c520 tx=0x7fa36400c9f0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.855+0000 7fa379fe1640 1 -- 10.20.193.68:0/2975879965 shutdown_connections 2026-02-18T21:02:06.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.855+0000 7fa379fe1640 1 --2- 10.20.193.68:0/2975879965 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa374123600 0x7fa3741241f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.855+0000 7fa379fe1640 1 --2- 10.20.193.68:0/2975879965 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa374073740 0x7fa3741c75e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.855+0000 7fa379fe1640 1 --2- 10.20.193.68:0/2975879965 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa374072e20 0x7fa3741c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.855+0000 7fa379fe1640 1 -- 10.20.193.68:0/2975879965 >> 10.20.193.68:0/2975879965 conn(0x7fa37409cea0 msgr2=0x7fa37412c940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:06.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.855+0000 7fa379fe1640 1 -- 10.20.193.68:0/2975879965 shutdown_connections 2026-02-18T21:02:06.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.855+0000 7fa379fe1640 1 -- 10.20.193.68:0/2975879965 wait complete. 2026-02-18T21:02:06.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705676 got 38654705675 for osd.3 2026-02-18T21:02:06.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.891+0000 7f7c2ef06640 1 -- 10.20.193.68:0/111263091 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7c2806ef50 con 0x7f7c28071420 2026-02-18T21:02:06.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.891+0000 7f7c1d7fa640 1 -- 10.20.193.68:0/111263091 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7c2806ef50 con 0x7f7c28071420 2026-02-18T21:02:06.894 INFO:teuthology.orchestra.run.trial068.stdout:38654705675 2026-02-18T21:02:06.895 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.893+0000 7f7c2ef06640 1 -- 10.20.193.68:0/111263091 >> v1:10.20.193.68:6816/2904515774 conn(0x7f7bf804f5e0 legacy=0x7f7bf8051aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:06.895 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.893+0000 7f7c2ef06640 1 -- 10.20.193.68:0/111263091 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7c28071420 msgr2=0x7f7c2812e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:06.895 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.893+0000 7f7c2ef06640 1 --2- 10.20.193.68:0/111263091 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7c28071420 0x7f7c2812e780 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7c18009ad0 tx=0x7f7c180047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.895 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.893+0000 7f7c2ef06640 1 -- 10.20.193.68:0/111263091 shutdown_connections 2026-02-18T21:02:06.895 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.893+0000 7f7c2ef06640 1 --2- 10.20.193.68:0/111263091 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7c28134a00 0x7f7c28124700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.893+0000 7f7c2ef06640 1 --2- 10.20.193.68:0/111263091 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7c28071dc0 0x7f7c281241c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.893+0000 7f7c2ef06640 1 --2- 10.20.193.68:0/111263091 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7c28071420 0x7f7c2812e780 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.893+0000 7f7c2ef06640 1 -- 10.20.193.68:0/111263091 >> 10.20.193.68:0/111263091 conn(0x7f7c2809cea0 msgr2=0x7f7c28131030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:06.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.893+0000 7f7c2ef06640 1 -- 10.20.193.68:0/111263091 shutdown_connections 2026-02-18T21:02:06.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.893+0000 7f7c2ef06640 1 -- 10.20.193.68:0/111263091 wait complete. 2026-02-18T21:02:06.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.893+0000 7f254ac0c640 1 -- 10.20.193.68:0/3403424825 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2544069ef0 con 0x7f2544071420 2026-02-18T21:02:06.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.893+0000 7f25397fa640 1 -- 10.20.193.68:0/3403424825 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f253402fa40 con 0x7f2544071420 2026-02-18T21:02:06.897 INFO:teuthology.orchestra.run.trial068.stdout:38654705674 2026-02-18T21:02:06.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.895+0000 7f254ac0c640 1 -- 10.20.193.68:0/3403424825 >> v1:10.20.193.68:6816/2904515774 conn(0x7f251404f5e0 legacy=0x7f2514051aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:06.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.895+0000 7f254ac0c640 1 -- 10.20.193.68:0/3403424825 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2544071420 msgr2=0x7f254411fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:06.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.895+0000 7f254ac0c640 1 --2- 10.20.193.68:0/3403424825 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2544071420 0x7f254411fe70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2534009ad0 tx=0x7f25340047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.895+0000 7f254ac0c640 1 -- 10.20.193.68:0/3403424825 shutdown_connections 2026-02-18T21:02:06.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.895+0000 7f254ac0c640 1 --2- 10.20.193.68:0/3403424825 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f25441154d0 0x7f25441208f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.895+0000 7f254ac0c640 1 --2- 10.20.193.68:0/3403424825 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f2544114bb0 0x7f25441203b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.895+0000 7f254ac0c640 1 --2- 10.20.193.68:0/3403424825 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f2544071420 0x7f254411fe70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:06.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.895+0000 7f254ac0c640 1 -- 10.20.193.68:0/3403424825 >> 10.20.193.68:0/3403424825 conn(0x7f254409cea0 msgr2=0x7f25441345d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:06.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.895+0000 7f254ac0c640 1 -- 10.20.193.68:0/3403424825 shutdown_connections 2026-02-18T21:02:06.899 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:06.895+0000 7f254ac0c640 1 -- 10.20.193.68:0/3403424825 wait complete. 2026-02-18T21:02:06.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705676 got 38654705675 for osd.2 2026-02-18T21:02:06.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705675 got 38654705674 for osd.0 2026-02-18T21:02:07.867 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-18T21:02:07.904 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-18T21:02:07.905 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-18T21:02:07.941 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.936+0000 7ffa74d94640 1 Processor -- start 2026-02-18T21:02:07.942 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.936+0000 7ffa74d94640 1 -- start start 2026-02-18T21:02:07.942 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.936+0000 7ffa74d94640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ffa70070cb0 0x7ffa701356c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:07.942 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.936+0000 7ffa74d94640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7ffa70070040 0x7ffa70137c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:07.942 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.936+0000 7ffa74d94640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa70070a70 con 0x7ffa7006f550 2026-02-18T21:02:07.942 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.936+0000 7ffa74d94640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7ffa700717f0 con 0x7ffa70070040 2026-02-18T21:02:07.942 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.936+0000 7ffa74d94640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7ffa70071a30 con 0x7ffa70070cb0 2026-02-18T21:02:07.942 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.936+0000 7ffa6e575640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7ffa7006f550 0x7ffa7006f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:50704/0 (socket says 10.20.193.68:50704) 2026-02-18T21:02:07.942 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.936+0000 7ffa6e575640 1 -- 10.20.193.68:0/1306873552 learned_addr learned my addr 10.20.193.68:0/1306873552 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:07.942 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.936+0000 7ffa6dd74640 1 --2- 10.20.193.68:0/1306873552 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ffa70070cb0 0x7ffa701356c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:07.942 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.936+0000 7ffa6ed76640 1 --2- 10.20.193.68:0/1306873552 >> v2:10.20.193.68:3300/0 conn(0x7ffa70070040 0x7ffa70137c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:07.942 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.936+0000 7ffa6d573640 1 -- 10.20.193.68:0/1306873552 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2621207550 0 0) 0x7ffa70070a70 con 0x7ffa7006f550 2026-02-18T21:02:07.942 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.936+0000 7ffa6d573640 1 -- 10.20.193.68:0/1306873552 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa5c003620 con 0x7ffa7006f550 2026-02-18T21:02:07.942 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.936+0000 7ffa6dd74640 1 -- 10.20.193.68:0/1306873552 >> v2:10.20.193.68:3300/0 conn(0x7ffa70070040 msgr2=0x7ffa70137c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:07.942 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.936+0000 7ffa6dd74640 1 --2- 10.20.193.68:0/1306873552 >> v2:10.20.193.68:3300/0 conn(0x7ffa70070040 0x7ffa70137c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:07.942 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.936+0000 7ffa6dd74640 1 -- 10.20.193.68:0/1306873552 >> v1:10.20.193.68:6789/0 conn(0x7ffa7006f550 legacy=0x7ffa7006f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:07.942 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.936+0000 7ffa6dd74640 1 -- 10.20.193.68:0/1306873552 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa7009de30 con 0x7ffa70070cb0 2026-02-18T21:02:07.942 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.936+0000 7ffa6ed76640 1 --2- 10.20.193.68:0/1306873552 >> v2:10.20.193.68:3300/0 conn(0x7ffa70070040 0x7ffa70137c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:07.942 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.937+0000 7ffa6dd74640 1 --2- 10.20.193.68:0/1306873552 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ffa70070cb0 0x7ffa701356c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffa580098a0 tx=0x7ffa5802ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=396d602f91d6da6f server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:07.942 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.937+0000 7ffa6d573640 1 -- 10.20.193.68:0/1306873552 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5803c070 con 0x7ffa70070cb0 2026-02-18T21:02:07.942 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.937+0000 7ffa6d573640 1 -- 10.20.193.68:0/1306873552 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5802fa40 con 0x7ffa70070cb0 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.937+0000 7ffa6d573640 1 -- 10.20.193.68:0/1306873552 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5802fe10 con 0x7ffa70070cb0 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.937+0000 7ffa74d94640 1 -- 10.20.193.68:0/1306873552 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ffa70070cb0 msgr2=0x7ffa701356c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.937+0000 7ffa74d94640 1 --2- 10.20.193.68:0/1306873552 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ffa70070cb0 0x7ffa701356c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffa580098a0 tx=0x7ffa5802ed80 comp rx=0 tx=0).stop 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.937+0000 7ffa74d94640 1 -- 10.20.193.68:0/1306873552 shutdown_connections 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.937+0000 7ffa74d94640 1 --2- 10.20.193.68:0/1306873552 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ffa70070cb0 0x7ffa701356c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.937+0000 7ffa74d94640 1 --2- 10.20.193.68:0/1306873552 >> v2:10.20.193.68:3300/0 conn(0x7ffa70070040 0x7ffa70137c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.937+0000 7ffa74d94640 1 -- 10.20.193.68:0/1306873552 >> 10.20.193.68:0/1306873552 conn(0x7ffa700a16d0 msgr2=0x7ffa7009be50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.937+0000 7ffa74d94640 1 -- 10.20.193.68:0/1306873552 shutdown_connections 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.937+0000 7ffa74d94640 1 -- 10.20.193.68:0/1306873552 wait complete. 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa74d94640 1 Processor -- start 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa74d94640 1 -- start start 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa74d94640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ffa7006f550 0x7ffa7011d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa74d94640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ffa70070040 0x7ffa7011dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa74d94640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ffa70070cb0 0x7ffa7011e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa74d94640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7ffa701384e0 con 0x7ffa7006f550 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa74d94640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7ffa70138360 con 0x7ffa70070cb0 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa74d94640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7ffa70138660 con 0x7ffa70070040 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa6e575640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ffa7006f550 0x7ffa7011d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa6e575640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ffa7006f550 0x7ffa7011d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:47580/0 (socket says 10.20.193.68:47580) 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa6ed76640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ffa70070cb0 0x7ffa7011e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa6e575640 1 -- 10.20.193.68:0/3851502435 learned_addr learned my addr 10.20.193.68:0/3851502435 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa6dd74640 1 --2- 10.20.193.68:0/3851502435 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ffa70070040 0x7ffa7011dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa6e575640 1 -- 10.20.193.68:0/3851502435 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ffa70070040 msgr2=0x7ffa7011dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa6e575640 1 --2- 10.20.193.68:0/3851502435 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ffa70070040 0x7ffa7011dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa6e575640 1 -- 10.20.193.68:0/3851502435 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ffa70070cb0 msgr2=0x7ffa7011e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:07.943 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa6e575640 1 --2- 10.20.193.68:0/3851502435 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ffa70070cb0 0x7ffa7011e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:07.944 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa6e575640 1 -- 10.20.193.68:0/3851502435 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa70073be0 con 0x7ffa7006f550 2026-02-18T21:02:07.944 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa6e575640 1 --2- 10.20.193.68:0/3851502435 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ffa7006f550 0x7ffa7011d670 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400c730 tx=0x7ffa6400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:07.944 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa56ffd640 1 -- 10.20.193.68:0/3851502435 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa64017070 con 0x7ffa7006f550 2026-02-18T21:02:07.944 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa56ffd640 1 -- 10.20.193.68:0/3851502435 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa64005bb0 con 0x7ffa7006f550 2026-02-18T21:02:07.944 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa74d94640 1 -- 10.20.193.68:0/3851502435 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa70120500 con 0x7ffa7006f550 2026-02-18T21:02:07.944 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa56ffd640 1 -- 10.20.193.68:0/3851502435 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa64007070 con 0x7ffa7006f550 2026-02-18T21:02:07.944 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.938+0000 7ffa74d94640 1 -- 10.20.193.68:0/3851502435 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa7012fcb0 con 0x7ffa7006f550 2026-02-18T21:02:07.944 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.939+0000 7ffa74d94640 1 -- 10.20.193.68:0/3851502435 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa7006f930 con 0x7ffa7006f550 2026-02-18T21:02:07.944 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.939+0000 7ffa56ffd640 1 -- 10.20.193.68:0/3851502435 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 9) ==== 62001+0+0 (secure 0 0 0) 0x7ffa64007210 con 0x7ffa7006f550 2026-02-18T21:02:07.944 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.939+0000 7ffa56ffd640 1 -- 10.20.193.68:0/3851502435 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3021+0+0 (secure 0 0 0) 0x7ffa64066140 con 0x7ffa7006f550 2026-02-18T21:02:07.944 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.942+0000 7ffa56ffd640 1 -- 10.20.193.68:0/3851502435 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7ffa6403ff10 con 0x7ffa7006f550 2026-02-18T21:02:07.982 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f46f19b4640 1 Processor -- start 2026-02-18T21:02:07.982 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f46f19b4640 1 -- start start 2026-02-18T21:02:07.982 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f84f2a16640 1 Processor -- start 2026-02-18T21:02:07.982 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f84f2a16640 1 -- start start 2026-02-18T21:02:07.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f46f19b4640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f46ec073910 0x7f46ec1320e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:07.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f46f19b4640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f46ec132620 0x7f46ec134a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:07.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f46f19b4640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46ec09e050 con 0x7f46ec072e20 2026-02-18T21:02:07.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f46f19b4640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f46ec071520 con 0x7f46ec132620 2026-02-18T21:02:07.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f46f19b4640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f46ec115730 con 0x7f46ec073910 2026-02-18T21:02:07.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f46eaffd640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f46ec072e20 0x7f46ec073200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:50714/0 (socket says 10.20.193.68:50714) 2026-02-18T21:02:07.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f46eaffd640 1 -- 10.20.193.68:0/839202767 learned_addr learned my addr 10.20.193.68:0/839202767 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:07.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f46ea7fc640 1 --2- 10.20.193.68:0/839202767 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f46ec073910 0x7f46ec1320e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:07.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f46eb7fe640 1 --2- 10.20.193.68:0/839202767 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f46ec132620 0x7f46ec134a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:07.985 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f84f2a16640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f84ec137850 0x7f84ec139c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:07.985 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f84f2a16640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f84ec13a180 0x7f84ec13c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:07.985 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f84f2a16640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84ec09e050 con 0x7f84ec134a00 2026-02-18T21:02:07.985 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f84f2a16640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f84ec134540 con 0x7f84ec137850 2026-02-18T21:02:07.985 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f84f2a16640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f84ec073e60 con 0x7f84ec13a180 2026-02-18T21:02:07.985 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f46e9ffb640 1 -- 10.20.193.68:0/839202767 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 490849045 0 0) 0x7f46ec09e050 con 0x7f46ec072e20 2026-02-18T21:02:07.986 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f46e9ffb640 1 -- 10.20.193.68:0/839202767 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46d8003620 con 0x7f46ec072e20 2026-02-18T21:02:07.986 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f84ebfff640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f84ec134a00 0x7f84ec134de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:50726/0 (socket says 10.20.193.68:50726) 2026-02-18T21:02:07.986 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f84ebfff640 1 -- 10.20.193.68:0/1905857067 learned_addr learned my addr 10.20.193.68:0/1905857067 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:07.986 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f84eb7fe640 1 --2- 10.20.193.68:0/1905857067 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f84ec137850 0x7f84ec139c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:07.986 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f46ea7fc640 1 -- 10.20.193.68:0/839202767 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f46ec132620 msgr2=0x7f46ec134a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:07.987 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f46ea7fc640 1 --2- 10.20.193.68:0/839202767 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f46ec132620 0x7f46ec134a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:07.987 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f84f0f8c640 1 --2- 10.20.193.68:0/1905857067 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f84ec13a180 0x7f84ec13c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:07.987 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f46ea7fc640 1 -- 10.20.193.68:0/839202767 >> v1:10.20.193.68:6789/0 conn(0x7f46ec072e20 legacy=0x7f46ec073200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:07.987 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f46ea7fc640 1 -- 10.20.193.68:0/839202767 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ec1159f0 con 0x7f46ec073910 2026-02-18T21:02:07.988 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f84eaffd640 1 -- 10.20.193.68:0/1905857067 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2242873136 0 0) 0x7f84ec09e050 con 0x7f84ec134a00 2026-02-18T21:02:07.988 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f84eaffd640 1 -- 10.20.193.68:0/1905857067 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84d0003620 con 0x7f84ec134a00 2026-02-18T21:02:07.988 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f84eb7fe640 1 -- 10.20.193.68:0/1905857067 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f84ec13a180 msgr2=0x7f84ec13c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:07.988 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f84eb7fe640 1 --2- 10.20.193.68:0/1905857067 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f84ec13a180 0x7f84ec13c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:07.988 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.980+0000 7f84eb7fe640 1 -- 10.20.193.68:0/1905857067 >> v1:10.20.193.68:6789/0 conn(0x7f84ec134a00 legacy=0x7f84ec134de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:07.988 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f84eb7fe640 1 -- 10.20.193.68:0/1905857067 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ec073060 con 0x7f84ec137850 2026-02-18T21:02:07.989 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f46ea7fc640 1 --2- 10.20.193.68:0/839202767 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f46ec073910 0x7f46ec1320e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f46d40098d0 tx=0x7f46d402edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb50475939ba39b3 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:07.989 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f84eb7fe640 1 --2- 10.20.193.68:0/1905857067 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f84ec137850 0x7f84ec139c40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0098d0 tx=0x7f84dc02edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc3c6d4655657827 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:07.990 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f46e9ffb640 1 -- 10.20.193.68:0/839202767 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d403c070 con 0x7f46ec073910 2026-02-18T21:02:07.990 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f46e9ffb640 1 -- 10.20.193.68:0/839202767 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d402fa30 con 0x7f46ec073910 2026-02-18T21:02:07.990 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f46e9ffb640 1 -- 10.20.193.68:0/839202767 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d402fe00 con 0x7f46ec073910 2026-02-18T21:02:07.990 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f84eaffd640 1 -- 10.20.193.68:0/1905857067 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc03c070 con 0x7f84ec137850 2026-02-18T21:02:07.990 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f84eaffd640 1 -- 10.20.193.68:0/1905857067 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84dc02fa30 con 0x7f84ec137850 2026-02-18T21:02:07.990 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f84eaffd640 1 -- 10.20.193.68:0/1905857067 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc02fe00 con 0x7f84ec137850 2026-02-18T21:02:07.991 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f46f19b4640 1 -- 10.20.193.68:0/839202767 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f46ec073910 msgr2=0x7f46ec1320e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:07.991 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f46f19b4640 1 --2- 10.20.193.68:0/839202767 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f46ec073910 0x7f46ec1320e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f46d40098d0 tx=0x7f46d402edc0 comp rx=0 tx=0).stop 2026-02-18T21:02:07.991 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f84f2a16640 1 -- 10.20.193.68:0/1905857067 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f84ec137850 msgr2=0x7f84ec139c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:07.991 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f84f2a16640 1 --2- 10.20.193.68:0/1905857067 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f84ec137850 0x7f84ec139c40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0098d0 tx=0x7f84dc02edc0 comp rx=0 tx=0).stop 2026-02-18T21:02:07.991 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f46f19b4640 1 -- 10.20.193.68:0/839202767 shutdown_connections 2026-02-18T21:02:07.992 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f46f19b4640 1 --2- 10.20.193.68:0/839202767 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f46ec132620 0x7f46ec134a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:07.992 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f84f2a16640 1 -- 10.20.193.68:0/1905857067 shutdown_connections 2026-02-18T21:02:07.992 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f46f19b4640 1 --2- 10.20.193.68:0/839202767 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f46ec073910 0x7f46ec1320e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:07.992 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f46f19b4640 1 -- 10.20.193.68:0/839202767 >> 10.20.193.68:0/839202767 conn(0x7f46ec09cea0 msgr2=0x7f46ec09d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:07.993 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f84f2a16640 1 --2- 10.20.193.68:0/1905857067 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f84ec137850 0x7f84ec139c40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:07.993 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f84f2a16640 1 --2- 10.20.193.68:0/1905857067 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f84ec13a180 0x7f84ec13c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:07.993 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f84f2a16640 1 -- 10.20.193.68:0/1905857067 >> 10.20.193.68:0/1905857067 conn(0x7f84ec09cea0 msgr2=0x7f84ec09d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:07.993 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f46f19b4640 1 -- 10.20.193.68:0/839202767 shutdown_connections 2026-02-18T21:02:07.993 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f84f2a16640 1 -- 10.20.193.68:0/1905857067 shutdown_connections 2026-02-18T21:02:07.994 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f46f19b4640 1 -- 10.20.193.68:0/839202767 wait complete. 2026-02-18T21:02:07.994 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.981+0000 7f84f2a16640 1 -- 10.20.193.68:0/1905857067 wait complete. 2026-02-18T21:02:07.994 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f46f19b4640 1 Processor -- start 2026-02-18T21:02:07.994 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f84f2a16640 1 Processor -- start 2026-02-18T21:02:07.995 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f46f19b4640 1 -- start start 2026-02-18T21:02:07.995 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f84f2a16640 1 -- start start 2026-02-18T21:02:07.996 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f46f19b4640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f46ec072e20 0x7f46ec1c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:07.996 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f46f19b4640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f46ec073910 0x7f46ec1c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:07.996 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f46f19b4640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f46ec132620 0x7f46ec12e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:07.996 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f46f19b4640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec071df0 con 0x7f46ec073910 2026-02-18T21:02:07.996 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f46f19b4640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f46ec071c70 con 0x7f46ec132620 2026-02-18T21:02:07.996 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f46f19b4640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f46ec071f70 con 0x7f46ec072e20 2026-02-18T21:02:07.996 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f46eaffd640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f46ec072e20 0x7f46ec1c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:07.996 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f46eb7fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f46ec132620 0x7f46ec12e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:07.997 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f84f2a16640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f84ec134a00 0x7f84ec070e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:07.997 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f46ea7fc640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f46ec073910 0x7f46ec1c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:07.997 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f46eaffd640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f46ec072e20 0x7f46ec1c7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:39946/0 (socket says 10.20.193.68:39946) 2026-02-18T21:02:07.997 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f46eaffd640 1 -- 10.20.193.68:0/4172128483 learned_addr learned my addr 10.20.193.68:0/4172128483 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:07.998 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f84f2a16640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f84ec137850 0x7f84ec0713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:07.998 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f84f2a16640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f84ec13a180 0x7f84ec071900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:07.998 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f84f2a16640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f84ec13cc30 con 0x7f84ec13a180 2026-02-18T21:02:07.998 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f84f2a16640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f84ec13cab0 con 0x7f84ec134a00 2026-02-18T21:02:07.998 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f84f2a16640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f84ec13cdb0 con 0x7f84ec137850 2026-02-18T21:02:07.999 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f84ebfff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f84ec134a00 0x7f84ec070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:07.999 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f84eb7fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f84ec137850 0x7f84ec0713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:07.999 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f84f0f8c640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f84ec13a180 0x7f84ec071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:07.999 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f84ebfff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f84ec134a00 0x7f84ec070e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:39356/0 (socket says 10.20.193.68:39356) 2026-02-18T21:02:07.999 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f84ebfff640 1 -- 10.20.193.68:0/3558391967 learned_addr learned my addr 10.20.193.68:0/3558391967 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:07.999 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f46eaffd640 1 -- 10.20.193.68:0/4172128483 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f46ec132620 msgr2=0x7f46ec12e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.000 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f46eaffd640 1 --2- 10.20.193.68:0/4172128483 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f46ec132620 0x7f46ec12e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.000 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f46eaffd640 1 -- 10.20.193.68:0/4172128483 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f46ec073910 msgr2=0x7f46ec1c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.000 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f46eaffd640 1 --2- 10.20.193.68:0/4172128483 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f46ec073910 0x7f46ec1c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.000 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f46eaffd640 1 -- 10.20.193.68:0/4172128483 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ec130ae0 con 0x7f46ec072e20 2026-02-18T21:02:08.000 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f46ea7fc640 1 --2- 10.20.193.68:0/4172128483 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f46ec073910 0x7f46ec1c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:08.000 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.982+0000 7f46eb7fe640 1 --2- 10.20.193.68:0/4172128483 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f46ec132620 0x7f46ec12e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:08.000 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f84eb7fe640 1 -- 10.20.193.68:0/3558391967 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f84ec134a00 msgr2=0x7f84ec070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.001 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f84eb7fe640 1 --2- 10.20.193.68:0/3558391967 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f84ec134a00 0x7f84ec070e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.001 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f84eb7fe640 1 -- 10.20.193.68:0/3558391967 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f84ec13a180 msgr2=0x7f84ec071900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.001 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f84eb7fe640 1 --2- 10.20.193.68:0/3558391967 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f84ec13a180 0x7f84ec071900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.001 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f84eb7fe640 1 -- 10.20.193.68:0/3558391967 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ec11ab40 con 0x7f84ec137850 2026-02-18T21:02:08.001 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f84f0f8c640 1 --2- 10.20.193.68:0/3558391967 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f84ec13a180 0x7f84ec071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:08.001 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f46eaffd640 1 --2- 10.20.193.68:0/4172128483 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f46ec072e20 0x7f46ec1c7910 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f46e000c730 tx=0x7f46e000cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:08.001 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f84eb7fe640 1 --2- 10.20.193.68:0/3558391967 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f84ec137850 0x7f84ec0713c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f84dc036000 tx=0x7f84dc0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:08.002 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f46c3fff640 1 -- 10.20.193.68:0/4172128483 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0005bb0 con 0x7f46ec072e20 2026-02-18T21:02:08.002 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f46c3fff640 1 -- 10.20.193.68:0/4172128483 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e0005d50 con 0x7f46ec072e20 2026-02-18T21:02:08.002 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f46f19b4640 1 -- 10.20.193.68:0/4172128483 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46ec1c8390 con 0x7f46ec072e20 2026-02-18T21:02:08.002 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f46c3fff640 1 -- 10.20.193.68:0/4172128483 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0007290 con 0x7f46ec072e20 2026-02-18T21:02:08.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f84e8ff9640 1 -- 10.20.193.68:0/3558391967 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc03c040 con 0x7f84ec137850 2026-02-18T21:02:08.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f46f19b4640 1 -- 10.20.193.68:0/4172128483 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f46ec1316c0 con 0x7f46ec072e20 2026-02-18T21:02:08.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f84e8ff9640 1 -- 10.20.193.68:0/3558391967 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84dc037d80 con 0x7f84ec137850 2026-02-18T21:02:08.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f84f2a16640 1 -- 10.20.193.68:0/3558391967 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84ec116080 con 0x7f84ec137850 2026-02-18T21:02:08.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f84e8ff9640 1 -- 10.20.193.68:0/3558391967 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc042670 con 0x7f84ec137850 2026-02-18T21:02:08.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f84f2a16640 1 -- 10.20.193.68:0/3558391967 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f84ec071e40 con 0x7f84ec137850 2026-02-18T21:02:08.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f46f19b4640 1 -- 10.20.193.68:0/4172128483 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46ec128650 con 0x7f46ec072e20 2026-02-18T21:02:08.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f84f2a16640 1 -- 10.20.193.68:0/3558391967 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84ec134de0 con 0x7f84ec137850 2026-02-18T21:02:08.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f46c3fff640 1 -- 10.20.193.68:0/4172128483 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 9) ==== 62001+0+0 (secure 0 0 0) 0x7f46e0007430 con 0x7f46ec072e20 2026-02-18T21:02:08.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.983+0000 7f84e8ff9640 1 -- 10.20.193.68:0/3558391967 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 9) ==== 62001+0+0 (secure 0 0 0) 0x7f84dc04b450 con 0x7f84ec137850 2026-02-18T21:02:08.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.984+0000 7f46c3fff640 1 -- 10.20.193.68:0/4172128483 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(20..20 src has 1..20) ==== 3021+0+0 (secure 0 0 0) 0x7f46e0066720 con 0x7f46ec072e20 2026-02-18T21:02:08.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.984+0000 7f84e8ff9640 1 -- 10.20.193.68:0/3558391967 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(20..20 src has 1..20) ==== 3021+0+0 (secure 0 0 0) 0x7f84dc08b2d0 con 0x7f84ec137850 2026-02-18T21:02:08.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.986+0000 7f46c3fff640 1 -- 10.20.193.68:0/4172128483 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f46ec128650 con 0x7f46ec072e20 2026-02-18T21:02:08.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:07.988+0000 7f84e8ff9640 1 -- 10.20.193.68:0/3558391967 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f84dc065150 con 0x7f84ec137850 2026-02-18T21:02:08.015 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.013+0000 7ffa74d94640 1 -- 10.20.193.68:0/3851502435 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ffa7012fee0 con 0x7ffa7006f550 2026-02-18T21:02:08.015 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.013+0000 7ffa56ffd640 1 -- 10.20.193.68:0/3851502435 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffa640651f0 con 0x7ffa7006f550 2026-02-18T21:02:08.015 INFO:teuthology.orchestra.run.trial068.stdout:38654705677 2026-02-18T21:02:08.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.015+0000 7ffa74d94640 1 -- 10.20.193.68:0/3851502435 >> v1:10.20.193.68:6816/2904515774 conn(0x7ffa3c04f700 legacy=0x7ffa3c051bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.015+0000 7ffa74d94640 1 -- 10.20.193.68:0/3851502435 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ffa7006f550 msgr2=0x7ffa7011d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.015+0000 7ffa74d94640 1 --2- 10.20.193.68:0/3851502435 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ffa7006f550 0x7ffa7011d670 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400c730 tx=0x7ffa6400cc00 comp rx=0 tx=0).stop 2026-02-18T21:02:08.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.015+0000 7ffa74d94640 1 -- 10.20.193.68:0/3851502435 shutdown_connections 2026-02-18T21:02:08.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.015+0000 7ffa74d94640 1 --2- 10.20.193.68:0/3851502435 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ffa70070cb0 0x7ffa7011e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.015+0000 7ffa74d94640 1 --2- 10.20.193.68:0/3851502435 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ffa70070040 0x7ffa7011dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.015+0000 7ffa74d94640 1 --2- 10.20.193.68:0/3851502435 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ffa7006f550 0x7ffa7011d670 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.015+0000 7ffa74d94640 1 -- 10.20.193.68:0/3851502435 >> 10.20.193.68:0/3851502435 conn(0x7ffa700a16d0 msgr2=0x7ffa701379e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:08.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.015+0000 7ffa74d94640 1 -- 10.20.193.68:0/3851502435 shutdown_connections 2026-02-18T21:02:08.017 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.015+0000 7ffa74d94640 1 -- 10.20.193.68:0/3851502435 wait complete. 2026-02-18T21:02:08.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705676 got 38654705677 for osd.3 2026-02-18T21:02:08.025 DEBUG:teuthology.parallel:result is None 2026-02-18T21:02:08.058 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.056+0000 7f46f19b4640 1 -- 10.20.193.68:0/4172128483 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f46ec073200 con 0x7f46ec072e20 2026-02-18T21:02:08.058 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.056+0000 7f46c3fff640 1 -- 10.20.193.68:0/4172128483 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f46e00405b0 con 0x7f46ec072e20 2026-02-18T21:02:08.058 INFO:teuthology.orchestra.run.trial068.stdout:38654705676 2026-02-18T21:02:08.059 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.057+0000 7f46f19b4640 1 -- 10.20.193.68:0/4172128483 >> v1:10.20.193.68:6816/2904515774 conn(0x7f46bc04f700 legacy=0x7f46bc051bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.060 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.057+0000 7f46f19b4640 1 -- 10.20.193.68:0/4172128483 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f46ec072e20 msgr2=0x7f46ec1c7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.060 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.057+0000 7f46f19b4640 1 --2- 10.20.193.68:0/4172128483 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f46ec072e20 0x7f46ec1c7910 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f46e000c730 tx=0x7f46e000cc00 comp rx=0 tx=0).stop 2026-02-18T21:02:08.060 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.057+0000 7f46f19b4640 1 -- 10.20.193.68:0/4172128483 shutdown_connections 2026-02-18T21:02:08.060 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.057+0000 7f46f19b4640 1 --2- 10.20.193.68:0/4172128483 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f46ec132620 0x7f46ec12e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.060 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.057+0000 7f46f19b4640 1 --2- 10.20.193.68:0/4172128483 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f46ec073910 0x7f46ec1c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.060 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.057+0000 7f46f19b4640 1 --2- 10.20.193.68:0/4172128483 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f46ec072e20 0x7f46ec1c7910 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.060 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.057+0000 7f46f19b4640 1 -- 10.20.193.68:0/4172128483 >> 10.20.193.68:0/4172128483 conn(0x7f46ec09cea0 msgr2=0x7f46ec070650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:08.060 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.057+0000 7f46f19b4640 1 -- 10.20.193.68:0/4172128483 shutdown_connections 2026-02-18T21:02:08.060 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.057+0000 7f46f19b4640 1 -- 10.20.193.68:0/4172128483 wait complete. 2026-02-18T21:02:08.061 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.058+0000 7f84f2a16640 1 -- 10.20.193.68:0/3558391967 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f84ec069ef0 con 0x7f84ec137850 2026-02-18T21:02:08.061 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.058+0000 7f84e8ff9640 1 -- 10.20.193.68:0/3558391967 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f84dc08a380 con 0x7f84ec137850 2026-02-18T21:02:08.061 INFO:teuthology.orchestra.run.trial068.stdout:38654705677 2026-02-18T21:02:08.062 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.059+0000 7f84f2a16640 1 -- 10.20.193.68:0/3558391967 >> v1:10.20.193.68:6816/2904515774 conn(0x7f84bc04f700 legacy=0x7f84bc051bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.062 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.059+0000 7f84f2a16640 1 -- 10.20.193.68:0/3558391967 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f84ec137850 msgr2=0x7f84ec0713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.063 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.059+0000 7f84f2a16640 1 --2- 10.20.193.68:0/3558391967 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f84ec137850 0x7f84ec0713c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f84dc036000 tx=0x7f84dc0047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.063 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.059+0000 7f84f2a16640 1 -- 10.20.193.68:0/3558391967 shutdown_connections 2026-02-18T21:02:08.063 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.059+0000 7f84f2a16640 1 --2- 10.20.193.68:0/3558391967 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f84ec13a180 0x7f84ec071900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.063 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.059+0000 7f84f2a16640 1 --2- 10.20.193.68:0/3558391967 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f84ec137850 0x7f84ec0713c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.063 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.059+0000 7f84f2a16640 1 --2- 10.20.193.68:0/3558391967 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f84ec134a00 0x7f84ec070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.063 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.059+0000 7f84f2a16640 1 -- 10.20.193.68:0/3558391967 >> 10.20.193.68:0/3558391967 conn(0x7f84ec09cea0 msgr2=0x7f84ec138d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:08.063 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.059+0000 7f84f2a16640 1 -- 10.20.193.68:0/3558391967 shutdown_connections 2026-02-18T21:02:08.063 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.059+0000 7f84f2a16640 1 -- 10.20.193.68:0/3558391967 wait complete. 2026-02-18T21:02:08.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705675 got 38654705676 for osd.0 2026-02-18T21:02:08.068 DEBUG:teuthology.parallel:result is None 2026-02-18T21:02:08.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705676 got 38654705677 for osd.2 2026-02-18T21:02:08.069 DEBUG:teuthology.parallel:result is None 2026-02-18T21:02:08.069 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-18T21:02:08.070 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-18T21:02:08.182 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.175+0000 7f1a36ae9640 1 Processor -- start 2026-02-18T21:02:08.182 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.175+0000 7f1a36ae9640 1 -- start start 2026-02-18T21:02:08.182 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.175+0000 7f1a36ae9640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1a3006fed0 0x7f1a301331c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:08.182 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.175+0000 7f1a36ae9640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f1a30133700 0x7f1a30135af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:08.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.175+0000 7f1a36ae9640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a30072f80 con 0x7f1a3006f3e0 2026-02-18T21:02:08.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.175+0000 7f1a36ae9640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f1a300727c0 con 0x7f1a30133700 2026-02-18T21:02:08.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.175+0000 7f1a36ae9640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f1a3006d280 con 0x7f1a3006fed0 2026-02-18T21:02:08.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.175+0000 7f1a3485e640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f1a3006f3e0 0x7f1a3006f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:50740/0 (socket says 10.20.193.68:50740) 2026-02-18T21:02:08.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.175+0000 7f1a3485e640 1 -- 10.20.193.68:0/4154026348 learned_addr learned my addr 10.20.193.68:0/4154026348 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:08.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.175+0000 7f1a27fff640 1 --2- 10.20.193.68:0/4154026348 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1a3006fed0 0x7f1a301331c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:08.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.175+0000 7f1a3505f640 1 --2- 10.20.193.68:0/4154026348 >> v2:10.20.193.68:3300/0 conn(0x7f1a30133700 0x7f1a30135af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:08.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.175+0000 7f1a277fe640 1 -- 10.20.193.68:0/4154026348 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4088130861 0 0) 0x7f1a30072f80 con 0x7f1a3006f3e0 2026-02-18T21:02:08.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.175+0000 7f1a27fff640 1 -- 10.20.193.68:0/4154026348 >> v2:10.20.193.68:3300/0 conn(0x7f1a30133700 msgr2=0x7f1a30135af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:08.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.175+0000 7f1a27fff640 1 --2- 10.20.193.68:0/4154026348 >> v2:10.20.193.68:3300/0 conn(0x7f1a30133700 0x7f1a30135af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.183 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.175+0000 7f1a27fff640 1 -- 10.20.193.68:0/4154026348 >> v1:10.20.193.68:6789/0 conn(0x7f1a3006f3e0 legacy=0x7f1a3006f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.175+0000 7f1a27fff640 1 -- 10.20.193.68:0/4154026348 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a30073aa0 con 0x7f1a3006fed0 2026-02-18T21:02:08.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.176+0000 7f1a27fff640 1 --2- 10.20.193.68:0/4154026348 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1a3006fed0 0x7f1a301331c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1a180098a0 tx=0x7f1a1802ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b907cdc47a8f91b server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:08.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.176+0000 7f1a277fe640 1 -- 10.20.193.68:0/4154026348 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1803c070 con 0x7f1a3006fed0 2026-02-18T21:02:08.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.176+0000 7f1a277fe640 1 -- 10.20.193.68:0/4154026348 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1802fa40 con 0x7f1a3006fed0 2026-02-18T21:02:08.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.176+0000 7f1a277fe640 1 -- 10.20.193.68:0/4154026348 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1802fe10 con 0x7f1a3006fed0 2026-02-18T21:02:08.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.176+0000 7f1a36ae9640 1 -- 10.20.193.68:0/4154026348 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1a3006fed0 msgr2=0x7f1a301331c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.176+0000 7f1a36ae9640 1 --2- 10.20.193.68:0/4154026348 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1a3006fed0 0x7f1a301331c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1a180098a0 tx=0x7f1a1802ed80 comp rx=0 tx=0).stop 2026-02-18T21:02:08.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.176+0000 7f1a36ae9640 1 -- 10.20.193.68:0/4154026348 shutdown_connections 2026-02-18T21:02:08.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.176+0000 7f1a36ae9640 1 --2- 10.20.193.68:0/4154026348 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1a3006fed0 0x7f1a301331c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.176+0000 7f1a36ae9640 1 --2- 10.20.193.68:0/4154026348 >> v2:10.20.193.68:3300/0 conn(0x7f1a30133700 0x7f1a30135af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.176+0000 7f1a36ae9640 1 -- 10.20.193.68:0/4154026348 >> 10.20.193.68:0/4154026348 conn(0x7f1a3009d0d0 msgr2=0x7f1a3009d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:08.184 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.176+0000 7f1a36ae9640 1 -- 10.20.193.68:0/4154026348 shutdown_connections 2026-02-18T21:02:08.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.176+0000 7f1a36ae9640 1 -- 10.20.193.68:0/4154026348 wait complete. 2026-02-18T21:02:08.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.176+0000 7f1a36ae9640 1 Processor -- start 2026-02-18T21:02:08.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a36ae9640 1 -- start start 2026-02-18T21:02:08.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a36ae9640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1a3006f3e0 0x7f1a30095ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:08.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a36ae9640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1a3006fed0 0x7f1a30096430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:08.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a36ae9640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1a30133700 0x7f1a30096970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:08.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a36ae9640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301361b0 con 0x7f1a3006f3e0 2026-02-18T21:02:08.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a36ae9640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f1a30136030 con 0x7f1a3006fed0 2026-02-18T21:02:08.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a36ae9640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f1a30136330 con 0x7f1a30133700 2026-02-18T21:02:08.185 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a3485e640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1a3006f3e0 0x7f1a30095ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:08.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a27fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1a3006fed0 0x7f1a30096430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:08.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a3485e640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1a3006f3e0 0x7f1a30095ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:47628/0 (socket says 10.20.193.68:47628) 2026-02-18T21:02:08.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a3485e640 1 -- 10.20.193.68:0/42806558 learned_addr learned my addr 10.20.193.68:0/42806558 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:08.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a3505f640 1 --2- 10.20.193.68:0/42806558 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1a30133700 0x7f1a30096970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:08.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a27fff640 1 -- 10.20.193.68:0/42806558 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1a30133700 msgr2=0x7f1a30096970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a27fff640 1 --2- 10.20.193.68:0/42806558 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1a30133700 0x7f1a30096970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a27fff640 1 -- 10.20.193.68:0/42806558 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1a3006f3e0 msgr2=0x7f1a30095ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a27fff640 1 --2- 10.20.193.68:0/42806558 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1a3006f3e0 0x7f1a30095ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a27fff640 1 -- 10.20.193.68:0/42806558 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a30124590 con 0x7f1a3006fed0 2026-02-18T21:02:08.186 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a27fff640 1 --2- 10.20.193.68:0/42806558 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1a3006fed0 0x7f1a30096430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1a18036000 tx=0x7f1a180047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:08.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a257fa640 1 -- 10.20.193.68:0/42806558 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1803c040 con 0x7f1a3006fed0 2026-02-18T21:02:08.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a257fa640 1 -- 10.20.193.68:0/42806558 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a18042450 con 0x7f1a3006fed0 2026-02-18T21:02:08.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a36ae9640 1 -- 10.20.193.68:0/42806558 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a30096eb0 con 0x7f1a3006fed0 2026-02-18T21:02:08.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a257fa640 1 -- 10.20.193.68:0/42806558 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18042820 con 0x7f1a3006fed0 2026-02-18T21:02:08.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.177+0000 7f1a36ae9640 1 -- 10.20.193.68:0/42806558 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a301cb2d0 con 0x7f1a3006fed0 2026-02-18T21:02:08.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.178+0000 7f1a36ae9640 1 -- 10.20.193.68:0/42806558 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a3006f7c0 con 0x7f1a3006fed0 2026-02-18T21:02:08.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.178+0000 7f1a257fa640 1 -- 10.20.193.68:0/42806558 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 9) ==== 62001+0+0 (secure 0 0 0) 0x7f1a1804b410 con 0x7f1a3006fed0 2026-02-18T21:02:08.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.178+0000 7f1a257fa640 1 -- 10.20.193.68:0/42806558 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3021+0+0 (secure 0 0 0) 0x7f1a1808b9e0 con 0x7f1a3006fed0 2026-02-18T21:02:08.187 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.180+0000 7f1a257fa640 1 -- 10.20.193.68:0/42806558 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f1a18050020 con 0x7f1a3006fed0 2026-02-18T21:02:08.249 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.247+0000 7f1a36ae9640 1 -- 10.20.193.68:0/42806558 --> v1:10.20.193.68:6816/2904515774 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a30132aa0 con 0x7f1a0004f700 2026-02-18T21:02:08.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.248+0000 7f1a257fa640 1 -- 10.20.193.68:0/42806558 <== mgr.14114 v1:10.20.193.68:6816/2904515774 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31983 (unknown 2965378022 0 2917745280) 0x7f1a30132aa0 con 0x7f1a0004f700 2026-02-18T21:02:08.251 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:08.252 INFO:teuthology.orchestra.run.trial068.stderr:dumped all 2026-02-18T21:02:08.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.249+0000 7f1a36ae9640 1 -- 10.20.193.68:0/42806558 >> v1:10.20.193.68:6816/2904515774 conn(0x7f1a0004f700 legacy=0x7f1a00051bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.249+0000 7f1a36ae9640 1 -- 10.20.193.68:0/42806558 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1a3006fed0 msgr2=0x7f1a30096430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.249+0000 7f1a36ae9640 1 --2- 10.20.193.68:0/42806558 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1a3006fed0 0x7f1a30096430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1a18036000 tx=0x7f1a180047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.249+0000 7f1a36ae9640 1 -- 10.20.193.68:0/42806558 shutdown_connections 2026-02-18T21:02:08.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.249+0000 7f1a36ae9640 1 --2- 10.20.193.68:0/42806558 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1a30133700 0x7f1a30096970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.249+0000 7f1a36ae9640 1 --2- 10.20.193.68:0/42806558 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1a3006fed0 0x7f1a30096430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.249+0000 7f1a36ae9640 1 --2- 10.20.193.68:0/42806558 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1a3006f3e0 0x7f1a30095ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.249+0000 7f1a36ae9640 1 -- 10.20.193.68:0/42806558 >> 10.20.193.68:0/42806558 conn(0x7f1a3009d0d0 msgr2=0x7f1a3009a640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:08.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.249+0000 7f1a36ae9640 1 -- 10.20.193.68:0/42806558 shutdown_connections 2026-02-18T21:02:08.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.249+0000 7f1a36ae9640 1 -- 10.20.193.68:0/42806558 wait complete. 2026-02-18T21:02:08.258 INFO:teuthology.orchestra.run.trial068.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2026-02-18T21:02:07.001736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1207912,"kb_used_data":1840,"kb_used_omap":6,"kb_used_meta":1206009,"kb_avail":376279448,"statfs":{"total":386547056640,"available":385310154752,"internally_reserved":0,"allocated":1884160,"data_stored":1385798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6812,"internal_metadata":1234953572},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.000744"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-18T21:02:04.815461+0000","last_change":"2026-02-18T21:01:28.980829+0000","last_active":"2026-02-18T21:02:04.815461+0000","last_peered":"2026-02-18T21:02:04.815461+0000","last_clean":"2026-02-18T21:02:04.815461+0000","last_became_active":"2026-02-18T21:01:26.977322+0000","last_became_peered":"2026-02-18T21:01:26.977322+0000","last_unstale":"2026-02-18T21:02:04.815461+0000","last_undegraded":"2026-02-18T21:02:04.815461+0000","last_fullsized":"2026-02-18T21:02:04.815461+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T21:26:32.514855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000486527,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-18T21:02:04.815605+0000","last_change":"2026-02-18T21:01:28.979532+0000","last_active":"2026-02-18T21:02:04.815605+0000","last_peered":"2026-02-18T21:02:04.815605+0000","last_clean":"2026-02-18T21:02:04.815605+0000","last_became_active":"2026-02-18T21:01:26.977639+0000","last_became_peered":"2026-02-18T21:01:26.977639+0000","last_unstale":"2026-02-18T21:02:04.815605+0000","last_undegraded":"2026-02-18T21:02:04.815605+0000","last_fullsized":"2026-02-18T21:02:04.815605+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T02:00:29.756605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018692399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-18T21:02:04.815489+0000","last_change":"2026-02-18T21:01:28.980780+0000","last_active":"2026-02-18T21:02:04.815489+0000","last_peered":"2026-02-18T21:02:04.815489+0000","last_clean":"2026-02-18T21:02:04.815489+0000","last_became_active":"2026-02-18T21:01:26.977061+0000","last_became_peered":"2026-02-18T21:01:26.977061+0000","last_unstale":"2026-02-18T21:02:04.815489+0000","last_undegraded":"2026-02-18T21:02:04.815489+0000","last_fullsized":"2026-02-18T21:02:04.815489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T02:02:29.480539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044243599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-18T21:02:04.815567+0000","last_change":"2026-02-18T21:01:28.979551+0000","last_active":"2026-02-18T21:02:04.815567+0000","last_peered":"2026-02-18T21:02:04.815567+0000","last_clean":"2026-02-18T21:02:04.815567+0000","last_became_active":"2026-02-18T21:01:26.977643+0000","last_became_peered":"2026-02-18T21:01:26.977643+0000","last_unstale":"2026-02-18T21:02:04.815567+0000","last_undegraded":"2026-02-18T21:02:04.815567+0000","last_fullsized":"2026-02-18T21:02:04.815567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T23:54:23.501222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020214300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-18T21:02:04.815441+0000","last_change":"2026-02-18T21:01:28.980699+0000","last_active":"2026-02-18T21:02:04.815441+0000","last_peered":"2026-02-18T21:02:04.815441+0000","last_clean":"2026-02-18T21:02:04.815441+0000","last_became_active":"2026-02-18T21:01:26.977359+0000","last_became_peered":"2026-02-18T21:01:26.977359+0000","last_unstale":"2026-02-18T21:02:04.815441+0000","last_undegraded":"2026-02-18T21:02:04.815441+0000","last_fullsized":"2026-02-18T21:02:04.815441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T01:30:13.508600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036890000000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-18T21:02:04.820054+0000","last_change":"2026-02-18T21:01:28.979387+0000","last_active":"2026-02-18T21:02:04.820054+0000","last_peered":"2026-02-18T21:02:04.820054+0000","last_clean":"2026-02-18T21:02:04.820054+0000","last_became_active":"2026-02-18T21:01:26.976598+0000","last_became_peered":"2026-02-18T21:01:26.976598+0000","last_unstale":"2026-02-18T21:02:04.820054+0000","last_undegraded":"2026-02-18T21:02:04.820054+0000","last_fullsized":"2026-02-18T21:02:04.820054+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T02:00:29.756605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021428500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-18T21:02:04.815438+0000","last_change":"2026-02-18T21:01:28.980480+0000","last_active":"2026-02-18T21:02:04.815438+0000","last_peered":"2026-02-18T21:02:04.815438+0000","last_clean":"2026-02-18T21:02:04.815438+0000","last_became_active":"2026-02-18T21:01:26.977362+0000","last_became_peered":"2026-02-18T21:01:26.977362+0000","last_unstale":"2026-02-18T21:02:04.815438+0000","last_undegraded":"2026-02-18T21:02:04.815438+0000","last_fullsized":"2026-02-18T21:02:04.815438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T03:05:33.777234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017934099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-18T21:02:04.815436+0000","last_change":"2026-02-18T21:01:28.980495+0000","last_active":"2026-02-18T21:02:04.815436+0000","last_peered":"2026-02-18T21:02:04.815436+0000","last_clean":"2026-02-18T21:02:04.815436+0000","last_became_active":"2026-02-18T21:01:26.977066+0000","last_became_peered":"2026-02-18T21:01:26.977066+0000","last_unstale":"2026-02-18T21:02:04.815436+0000","last_undegraded":"2026-02-18T21:02:04.815436+0000","last_fullsized":"2026-02-18T21:02:04.815436+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T03:08:40.742665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000176987,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":107,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-18T21:02:04.815574+0000","last_change":"2026-02-18T21:01:21.968408+0000","last_active":"2026-02-18T21:02:04.815574+0000","last_peered":"2026-02-18T21:02:04.815574+0000","last_clean":"2026-02-18T21:02:04.815574+0000","last_became_active":"2026-02-18T21:01:21.967863+0000","last_became_peered":"2026-02-18T21:01:21.967863+0000","last_unstale":"2026-02-18T21:02:04.815574+0000","last_undegraded":"2026-02-18T21:02:04.815574+0000","last_fullsized":"2026-02-18T21:02:04.815574+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:20.963920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:20.963920+0000","last_clean_scrub_stamp":"2026-02-18T21:01:20.963920+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T05:29:54.216192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705677,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301692,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070148,"statfs":{"total":96636764160,"available":96327831552,"internally_reserved":0,"allocated":176128,"data_stored":51275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705677,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301688,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070152,"statfs":{"total":96636764160,"available":96327835648,"internally_reserved":0,"allocated":172032,"data_stored":51256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705675,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302268,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069572,"statfs":{"total":96636764160,"available":96327241728,"internally_reserved":0,"allocated":770048,"data_stored":641643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705676,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302264,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069576,"statfs":{"total":96636764160,"available":96327245824,"internally_reserved":0,"allocated":765952,"data_stored":641624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-18T21:02:08.259 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-18T21:02:08.332 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.326+0000 7feb33b8b640 1 Processor -- start 2026-02-18T21:02:08.332 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.326+0000 7feb33b8b640 1 -- start start 2026-02-18T21:02:08.333 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.326+0000 7feb33b8b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feb2c071400 0x7feb2c0717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:08.333 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.326+0000 7feb33b8b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb2c12e510 0x7feb2c13ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:08.333 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.326+0000 7feb33b8b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb2c0731f0 con 0x7feb2c071d20 2026-02-18T21:02:08.333 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.326+0000 7feb33b8b640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7feb2c09e090 con 0x7feb2c12e510 2026-02-18T21:02:08.333 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.326+0000 7feb33b8b640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7feb2c073f90 con 0x7feb2c071400 2026-02-18T21:02:08.333 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.326+0000 7feb31900640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feb2c071400 0x7feb2c0717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:08.333 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.326+0000 7feb32101640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb2c12e510 0x7feb2c13ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:08.333 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.326+0000 7feb31900640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feb2c071400 0x7feb2c0717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:39986/0 (socket says 10.20.193.68:39986) 2026-02-18T21:02:08.333 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.326+0000 7feb31900640 1 -- 10.20.193.68:0/575484486 learned_addr learned my addr 10.20.193.68:0/575484486 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:08.334 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.326+0000 7feb310ff640 1 --1- 10.20.193.68:0/575484486 >> v1:10.20.193.68:6789/0 conn(0x7feb2c071d20 0x7feb2c12de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:50752/0 (socket says 10.20.193.68:50752) 2026-02-18T21:02:08.334 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.326+0000 7feb31900640 1 -- 10.20.193.68:0/575484486 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb2c12e510 msgr2=0x7feb2c13ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:08.334 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.326+0000 7feb31900640 1 --2- 10.20.193.68:0/575484486 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb2c12e510 0x7feb2c13ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.334 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.326+0000 7feb31900640 1 -- 10.20.193.68:0/575484486 >> v1:10.20.193.68:6789/0 conn(0x7feb2c071d20 legacy=0x7feb2c12de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.334 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.326+0000 7feb31900640 1 -- 10.20.193.68:0/575484486 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2c072900 con 0x7feb2c071400 2026-02-18T21:02:08.334 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.327+0000 7feb31900640 1 --2- 10.20.193.68:0/575484486 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feb2c071400 0x7feb2c0717e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0099a0 tx=0x7feb1c02ef50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d8686ecdff0b4a2 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:08.334 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.327+0000 7feb308fe640 1 -- 10.20.193.68:0/575484486 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1c03c070 con 0x7feb2c071400 2026-02-18T21:02:08.334 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.327+0000 7feb308fe640 1 -- 10.20.193.68:0/575484486 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb1c02fb80 con 0x7feb2c071400 2026-02-18T21:02:08.334 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.327+0000 7feb308fe640 1 -- 10.20.193.68:0/575484486 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1c037440 con 0x7feb2c071400 2026-02-18T21:02:08.334 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.327+0000 7feb33b8b640 1 -- 10.20.193.68:0/575484486 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feb2c071400 msgr2=0x7feb2c0717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.334 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.327+0000 7feb33b8b640 1 --2- 10.20.193.68:0/575484486 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feb2c071400 0x7feb2c0717e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0099a0 tx=0x7feb1c02ef50 comp rx=0 tx=0).stop 2026-02-18T21:02:08.335 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.327+0000 7feb33b8b640 1 -- 10.20.193.68:0/575484486 shutdown_connections 2026-02-18T21:02:08.335 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.327+0000 7feb33b8b640 1 --2- 10.20.193.68:0/575484486 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb2c12e510 0x7feb2c13ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.335 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.327+0000 7feb33b8b640 1 --2- 10.20.193.68:0/575484486 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feb2c071400 0x7feb2c0717e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.335 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.327+0000 7feb33b8b640 1 -- 10.20.193.68:0/575484486 >> 10.20.193.68:0/575484486 conn(0x7feb2c09cee0 msgr2=0x7feb2c09d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:08.335 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.327+0000 7feb33b8b640 1 -- 10.20.193.68:0/575484486 shutdown_connections 2026-02-18T21:02:08.335 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.327+0000 7feb33b8b640 1 -- 10.20.193.68:0/575484486 wait complete. 2026-02-18T21:02:08.335 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb33b8b640 1 Processor -- start 2026-02-18T21:02:08.335 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb33b8b640 1 -- start start 2026-02-18T21:02:08.335 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb33b8b640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7feb2c071400 0x7feb2c123d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:08.335 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb33b8b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb2c071d20 0x7feb2c1242a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:08.335 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb33b8b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feb2c12e510 0x7feb2c1247e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:08.336 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb33b8b640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c072100 con 0x7feb2c071400 2026-02-18T21:02:08.336 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb33b8b640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7feb2c12e990 con 0x7feb2c071d20 2026-02-18T21:02:08.336 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb33b8b640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7feb2c125d40 con 0x7feb2c12e510 2026-02-18T21:02:08.336 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb31900640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7feb2c071400 0x7feb2c123d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:08.336 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb31900640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7feb2c071400 0x7feb2c123d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:47642/0 (socket says 10.20.193.68:47642) 2026-02-18T21:02:08.336 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb31900640 1 -- 10.20.193.68:0/4045426644 learned_addr learned my addr 10.20.193.68:0/4045426644 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:08.336 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb310ff640 1 --2- 10.20.193.68:0/4045426644 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb2c071d20 0x7feb2c1242a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:08.336 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb32101640 1 --2- 10.20.193.68:0/4045426644 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feb2c12e510 0x7feb2c1247e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:08.336 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb31900640 1 -- 10.20.193.68:0/4045426644 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feb2c12e510 msgr2=0x7feb2c1247e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.336 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb31900640 1 --2- 10.20.193.68:0/4045426644 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feb2c12e510 0x7feb2c1247e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.336 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb31900640 1 -- 10.20.193.68:0/4045426644 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb2c071d20 msgr2=0x7feb2c1242a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb31900640 1 --2- 10.20.193.68:0/4045426644 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb2c071d20 0x7feb2c1242a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb31900640 1 -- 10.20.193.68:0/4045426644 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2c1269f0 con 0x7feb2c071400 2026-02-18T21:02:08.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb31900640 1 --2- 10.20.193.68:0/4045426644 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7feb2c071400 0x7feb2c123d60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7feb1c002410 tx=0x7feb1c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:08.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb1a7fc640 1 -- 10.20.193.68:0/4045426644 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1c03c040 con 0x7feb2c071400 2026-02-18T21:02:08.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb1a7fc640 1 -- 10.20.193.68:0/4045426644 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb1c042430 con 0x7feb2c071400 2026-02-18T21:02:08.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb33b8b640 1 -- 10.20.193.68:0/4045426644 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb2c126620 con 0x7feb2c071400 2026-02-18T21:02:08.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb1a7fc640 1 -- 10.20.193.68:0/4045426644 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1c042800 con 0x7feb2c071400 2026-02-18T21:02:08.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.328+0000 7feb33b8b640 1 -- 10.20.193.68:0/4045426644 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb2c11a5f0 con 0x7feb2c071400 2026-02-18T21:02:08.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.329+0000 7feb33b8b640 1 -- 10.20.193.68:0/4045426644 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb2c0717e0 con 0x7feb2c071400 2026-02-18T21:02:08.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.329+0000 7feb1a7fc640 1 -- 10.20.193.68:0/4045426644 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 9) ==== 62001+0+0 (secure 0 0 0) 0x7feb1c0429a0 con 0x7feb2c071400 2026-02-18T21:02:08.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.329+0000 7feb1a7fc640 1 -- 10.20.193.68:0/4045426644 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3021+0+0 (secure 0 0 0) 0x7feb1c08bc90 con 0x7feb2c071400 2026-02-18T21:02:08.338 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.332+0000 7feb1a7fc640 1 -- 10.20.193.68:0/4045426644 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7feb1c091020 con 0x7feb2c071400 2026-02-18T21:02:08.404 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.402+0000 7feb33b8b640 1 -- 10.20.193.68:0/4045426644 --> v1:10.20.193.68:6816/2904515774 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feb2c069ef0 con 0x7feafc04f700 2026-02-18T21:02:08.404 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.402+0000 7feb1a7fc640 1 -- 10.20.193.68:0/4045426644 <== mgr.14114 v1:10.20.193.68:6816/2904515774 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31983 (unknown 2965378022 0 2917745280) 0x7feb2c069ef0 con 0x7feafc04f700 2026-02-18T21:02:08.405 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:08.406 INFO:teuthology.orchestra.run.trial068.stderr:dumped all 2026-02-18T21:02:08.406 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.404+0000 7feb33b8b640 1 -- 10.20.193.68:0/4045426644 >> v1:10.20.193.68:6816/2904515774 conn(0x7feafc04f700 legacy=0x7feafc051bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.404+0000 7feb33b8b640 1 -- 10.20.193.68:0/4045426644 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7feb2c071400 msgr2=0x7feb2c123d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.404+0000 7feb33b8b640 1 --2- 10.20.193.68:0/4045426644 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7feb2c071400 0x7feb2c123d60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7feb1c002410 tx=0x7feb1c0047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.404+0000 7feb33b8b640 1 -- 10.20.193.68:0/4045426644 shutdown_connections 2026-02-18T21:02:08.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.404+0000 7feb33b8b640 1 --2- 10.20.193.68:0/4045426644 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7feb2c12e510 0x7feb2c1247e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.404+0000 7feb33b8b640 1 --2- 10.20.193.68:0/4045426644 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7feb2c071d20 0x7feb2c1242a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.404+0000 7feb33b8b640 1 --2- 10.20.193.68:0/4045426644 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7feb2c071400 0x7feb2c123d60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.404+0000 7feb33b8b640 1 -- 10.20.193.68:0/4045426644 >> 10.20.193.68:0/4045426644 conn(0x7feb2c09cee0 msgr2=0x7feb2c12f020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:08.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.404+0000 7feb33b8b640 1 -- 10.20.193.68:0/4045426644 shutdown_connections 2026-02-18T21:02:08.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.404+0000 7feb33b8b640 1 -- 10.20.193.68:0/4045426644 wait complete. 2026-02-18T21:02:08.413 INFO:teuthology.orchestra.run.trial068.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2026-02-18T21:02:07.001736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1207912,"kb_used_data":1840,"kb_used_omap":6,"kb_used_meta":1206009,"kb_avail":376279448,"statfs":{"total":386547056640,"available":385310154752,"internally_reserved":0,"allocated":1884160,"data_stored":1385798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6812,"internal_metadata":1234953572},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.000744"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-18T21:02:04.815461+0000","last_change":"2026-02-18T21:01:28.980829+0000","last_active":"2026-02-18T21:02:04.815461+0000","last_peered":"2026-02-18T21:02:04.815461+0000","last_clean":"2026-02-18T21:02:04.815461+0000","last_became_active":"2026-02-18T21:01:26.977322+0000","last_became_peered":"2026-02-18T21:01:26.977322+0000","last_unstale":"2026-02-18T21:02:04.815461+0000","last_undegraded":"2026-02-18T21:02:04.815461+0000","last_fullsized":"2026-02-18T21:02:04.815461+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T21:26:32.514855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000486527,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-18T21:02:04.815605+0000","last_change":"2026-02-18T21:01:28.979532+0000","last_active":"2026-02-18T21:02:04.815605+0000","last_peered":"2026-02-18T21:02:04.815605+0000","last_clean":"2026-02-18T21:02:04.815605+0000","last_became_active":"2026-02-18T21:01:26.977639+0000","last_became_peered":"2026-02-18T21:01:26.977639+0000","last_unstale":"2026-02-18T21:02:04.815605+0000","last_undegraded":"2026-02-18T21:02:04.815605+0000","last_fullsized":"2026-02-18T21:02:04.815605+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T02:00:29.756605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018692399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-18T21:02:04.815489+0000","last_change":"2026-02-18T21:01:28.980780+0000","last_active":"2026-02-18T21:02:04.815489+0000","last_peered":"2026-02-18T21:02:04.815489+0000","last_clean":"2026-02-18T21:02:04.815489+0000","last_became_active":"2026-02-18T21:01:26.977061+0000","last_became_peered":"2026-02-18T21:01:26.977061+0000","last_unstale":"2026-02-18T21:02:04.815489+0000","last_undegraded":"2026-02-18T21:02:04.815489+0000","last_fullsized":"2026-02-18T21:02:04.815489+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T02:02:29.480539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044243599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-18T21:02:04.815567+0000","last_change":"2026-02-18T21:01:28.979551+0000","last_active":"2026-02-18T21:02:04.815567+0000","last_peered":"2026-02-18T21:02:04.815567+0000","last_clean":"2026-02-18T21:02:04.815567+0000","last_became_active":"2026-02-18T21:01:26.977643+0000","last_became_peered":"2026-02-18T21:01:26.977643+0000","last_unstale":"2026-02-18T21:02:04.815567+0000","last_undegraded":"2026-02-18T21:02:04.815567+0000","last_fullsized":"2026-02-18T21:02:04.815567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T23:54:23.501222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020214300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-18T21:02:04.815441+0000","last_change":"2026-02-18T21:01:28.980699+0000","last_active":"2026-02-18T21:02:04.815441+0000","last_peered":"2026-02-18T21:02:04.815441+0000","last_clean":"2026-02-18T21:02:04.815441+0000","last_became_active":"2026-02-18T21:01:26.977359+0000","last_became_peered":"2026-02-18T21:01:26.977359+0000","last_unstale":"2026-02-18T21:02:04.815441+0000","last_undegraded":"2026-02-18T21:02:04.815441+0000","last_fullsized":"2026-02-18T21:02:04.815441+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T01:30:13.508600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036890000000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-18T21:02:04.820054+0000","last_change":"2026-02-18T21:01:28.979387+0000","last_active":"2026-02-18T21:02:04.820054+0000","last_peered":"2026-02-18T21:02:04.820054+0000","last_clean":"2026-02-18T21:02:04.820054+0000","last_became_active":"2026-02-18T21:01:26.976598+0000","last_became_peered":"2026-02-18T21:01:26.976598+0000","last_unstale":"2026-02-18T21:02:04.820054+0000","last_undegraded":"2026-02-18T21:02:04.820054+0000","last_fullsized":"2026-02-18T21:02:04.820054+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T02:00:29.756605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021428500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-18T21:02:04.815438+0000","last_change":"2026-02-18T21:01:28.980480+0000","last_active":"2026-02-18T21:02:04.815438+0000","last_peered":"2026-02-18T21:02:04.815438+0000","last_clean":"2026-02-18T21:02:04.815438+0000","last_became_active":"2026-02-18T21:01:26.977362+0000","last_became_peered":"2026-02-18T21:01:26.977362+0000","last_unstale":"2026-02-18T21:02:04.815438+0000","last_undegraded":"2026-02-18T21:02:04.815438+0000","last_fullsized":"2026-02-18T21:02:04.815438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T03:05:33.777234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017934099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-18T21:02:04.815436+0000","last_change":"2026-02-18T21:01:28.980495+0000","last_active":"2026-02-18T21:02:04.815436+0000","last_peered":"2026-02-18T21:02:04.815436+0000","last_clean":"2026-02-18T21:02:04.815436+0000","last_became_active":"2026-02-18T21:01:26.977066+0000","last_became_peered":"2026-02-18T21:01:26.977066+0000","last_unstale":"2026-02-18T21:02:04.815436+0000","last_undegraded":"2026-02-18T21:02:04.815436+0000","last_fullsized":"2026-02-18T21:02:04.815436+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T03:08:40.742665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000176987,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":107,"reported_epoch":19,"state":"active+clean","last_fresh":"2026-02-18T21:02:04.815574+0000","last_change":"2026-02-18T21:01:21.968408+0000","last_active":"2026-02-18T21:02:04.815574+0000","last_peered":"2026-02-18T21:02:04.815574+0000","last_clean":"2026-02-18T21:02:04.815574+0000","last_became_active":"2026-02-18T21:01:21.967863+0000","last_became_peered":"2026-02-18T21:01:21.967863+0000","last_unstale":"2026-02-18T21:02:04.815574+0000","last_undegraded":"2026-02-18T21:02:04.815574+0000","last_fullsized":"2026-02-18T21:02:04.815574+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:20.963920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:20.963920+0000","last_clean_scrub_stamp":"2026-02-18T21:01:20.963920+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T05:29:54.216192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705677,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301692,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070148,"statfs":{"total":96636764160,"available":96327831552,"internally_reserved":0,"allocated":176128,"data_stored":51275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705677,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301688,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070152,"statfs":{"total":96636764160,"available":96327835648,"internally_reserved":0,"allocated":172032,"data_stored":51256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705675,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302268,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069572,"statfs":{"total":96636764160,"available":96327241728,"internally_reserved":0,"allocated":770048,"data_stored":641643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705676,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302264,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069576,"statfs":{"total":96636764160,"available":96327245824,"internally_reserved":0,"allocated":765952,"data_stored":641624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1703,"internal_metadata":308738393},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-18T21:02:08.414 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-18T21:02:08.415 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-18T21:02:08.415 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-18T21:02:08.415 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-18T21:02:08.487 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.481+0000 7fbf44178640 1 Processor -- start 2026-02-18T21:02:08.487 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.481+0000 7fbf44178640 1 -- start start 2026-02-18T21:02:08.487 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.481+0000 7fbf44178640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf3c114bb0 0x7fbf3c114f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:08.487 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.481+0000 7fbf44178640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf3c130bb0 0x7fbf3c138700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:08.487 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.481+0000 7fbf44178640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf3c071400 con 0x7fbf3c1154d0 2026-02-18T21:02:08.488 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.481+0000 7fbf44178640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fbf3c0716e0 con 0x7fbf3c130bb0 2026-02-18T21:02:08.488 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.481+0000 7fbf44178640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fbf3c09e090 con 0x7fbf3c114bb0 2026-02-18T21:02:08.488 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.481+0000 7fbf41eed640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf3c114bb0 0x7fbf3c114f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:08.488 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.481+0000 7fbf426ee640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf3c130bb0 0x7fbf3c138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:08.488 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.481+0000 7fbf416ec640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fbf3c1154d0 0x7fbf3c1304a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:50758/0 (socket says 10.20.193.68:50758) 2026-02-18T21:02:08.488 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.481+0000 7fbf41eed640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf3c114bb0 0x7fbf3c114f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:40002/0 (socket says 10.20.193.68:40002) 2026-02-18T21:02:08.488 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.481+0000 7fbf41eed640 1 -- 10.20.193.68:0/3487857637 learned_addr learned my addr 10.20.193.68:0/3487857637 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:08.488 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.481+0000 7fbf41eed640 1 -- 10.20.193.68:0/3487857637 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf3c130bb0 msgr2=0x7fbf3c138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:08.488 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.481+0000 7fbf41eed640 1 --2- 10.20.193.68:0/3487857637 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf3c130bb0 0x7fbf3c138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.488 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.481+0000 7fbf41eed640 1 -- 10.20.193.68:0/3487857637 >> v1:10.20.193.68:6789/0 conn(0x7fbf3c1154d0 legacy=0x7fbf3c1304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.488 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.482+0000 7fbf41eed640 1 -- 10.20.193.68:0/3487857637 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3c071ca0 con 0x7fbf3c114bb0 2026-02-18T21:02:08.488 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.482+0000 7fbf41eed640 1 --2- 10.20.193.68:0/3487857637 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf3c114bb0 0x7fbf3c114f90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0099a0 tx=0x7fbf2c02ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e7e1bf698c43dcd server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:08.489 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.482+0000 7fbf40eeb640 1 -- 10.20.193.68:0/3487857637 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c03c070 con 0x7fbf3c114bb0 2026-02-18T21:02:08.489 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.482+0000 7fbf40eeb640 1 -- 10.20.193.68:0/3487857637 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf2c02fb00 con 0x7fbf3c114bb0 2026-02-18T21:02:08.489 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.482+0000 7fbf40eeb640 1 -- 10.20.193.68:0/3487857637 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c037440 con 0x7fbf3c114bb0 2026-02-18T21:02:08.489 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.482+0000 7fbf44178640 1 -- 10.20.193.68:0/3487857637 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf3c114bb0 msgr2=0x7fbf3c114f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.489 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.482+0000 7fbf44178640 1 --2- 10.20.193.68:0/3487857637 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf3c114bb0 0x7fbf3c114f90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0099a0 tx=0x7fbf2c02ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:08.489 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.482+0000 7fbf44178640 1 -- 10.20.193.68:0/3487857637 shutdown_connections 2026-02-18T21:02:08.489 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.482+0000 7fbf44178640 1 --2- 10.20.193.68:0/3487857637 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf3c130bb0 0x7fbf3c138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.489 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.482+0000 7fbf44178640 1 --2- 10.20.193.68:0/3487857637 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf3c114bb0 0x7fbf3c114f90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.489 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.482+0000 7fbf44178640 1 -- 10.20.193.68:0/3487857637 >> 10.20.193.68:0/3487857637 conn(0x7fbf3c09cee0 msgr2=0x7fbf3c09d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:08.489 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.482+0000 7fbf44178640 1 -- 10.20.193.68:0/3487857637 shutdown_connections 2026-02-18T21:02:08.489 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.482+0000 7fbf44178640 1 -- 10.20.193.68:0/3487857637 wait complete. 2026-02-18T21:02:08.490 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.483+0000 7fbf44178640 1 Processor -- start 2026-02-18T21:02:08.490 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.483+0000 7fbf44178640 1 -- start start 2026-02-18T21:02:08.490 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.483+0000 7fbf44178640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf3c114bb0 0x7fbf3c1c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:08.490 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.483+0000 7fbf44178640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbf3c1154d0 0x7fbf3c1c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:08.490 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.483+0000 7fbf44178640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf3c130bb0 0x7fbf3c124a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:08.490 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.483+0000 7fbf44178640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3c1158b0 con 0x7fbf3c1154d0 2026-02-18T21:02:08.490 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.483+0000 7fbf44178640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fbf3c131060 con 0x7fbf3c114bb0 2026-02-18T21:02:08.490 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.483+0000 7fbf44178640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fbf3c126f90 con 0x7fbf3c130bb0 2026-02-18T21:02:08.490 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.483+0000 7fbf41eed640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf3c114bb0 0x7fbf3c1c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:08.490 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.483+0000 7fbf416ec640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbf3c1154d0 0x7fbf3c1c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:08.490 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.483+0000 7fbf41eed640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf3c114bb0 0x7fbf3c1c7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:39408/0 (socket says 10.20.193.68:39408) 2026-02-18T21:02:08.490 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.483+0000 7fbf41eed640 1 -- 10.20.193.68:0/2762855803 learned_addr learned my addr 10.20.193.68:0/2762855803 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:08.491 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.483+0000 7fbf426ee640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf3c130bb0 0x7fbf3c124a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:08.491 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.484+0000 7fbf41eed640 1 -- 10.20.193.68:0/2762855803 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf3c130bb0 msgr2=0x7fbf3c124a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.491 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.484+0000 7fbf41eed640 1 --2- 10.20.193.68:0/2762855803 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf3c130bb0 0x7fbf3c124a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.491 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.484+0000 7fbf41eed640 1 -- 10.20.193.68:0/2762855803 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbf3c1154d0 msgr2=0x7fbf3c1c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.491 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.484+0000 7fbf41eed640 1 --2- 10.20.193.68:0/2762855803 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbf3c1154d0 0x7fbf3c1c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.491 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.484+0000 7fbf41eed640 1 -- 10.20.193.68:0/2762855803 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3c126cc0 con 0x7fbf3c114bb0 2026-02-18T21:02:08.491 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.484+0000 7fbf416ec640 1 --2- 10.20.193.68:0/2762855803 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbf3c1154d0 0x7fbf3c1c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:08.491 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.484+0000 7fbf41eed640 1 --2- 10.20.193.68:0/2762855803 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf3c114bb0 0x7fbf3c1c7670 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009ad0 tx=0x7fbf2c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:08.491 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.484+0000 7fbf2a7fc640 1 -- 10.20.193.68:0/2762855803 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c03c040 con 0x7fbf3c114bb0 2026-02-18T21:02:08.491 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.484+0000 7fbf2a7fc640 1 -- 10.20.193.68:0/2762855803 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf2c042650 con 0x7fbf3c114bb0 2026-02-18T21:02:08.491 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.484+0000 7fbf44178640 1 -- 10.20.193.68:0/2762855803 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf3c1c80f0 con 0x7fbf3c114bb0 2026-02-18T21:02:08.491 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.484+0000 7fbf2a7fc640 1 -- 10.20.193.68:0/2762855803 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c042a40 con 0x7fbf3c114bb0 2026-02-18T21:02:08.492 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.484+0000 7fbf44178640 1 -- 10.20.193.68:0/2762855803 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf3c127890 con 0x7fbf3c114bb0 2026-02-18T21:02:08.492 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.484+0000 7fbf44178640 1 -- 10.20.193.68:0/2762855803 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf3c114f90 con 0x7fbf3c114bb0 2026-02-18T21:02:08.492 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.484+0000 7fbf2a7fc640 1 -- 10.20.193.68:0/2762855803 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 9) ==== 62001+0+0 (secure 0 0 0) 0x7fbf2c042be0 con 0x7fbf3c114bb0 2026-02-18T21:02:08.492 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.485+0000 7fbf2a7fc640 1 -- 10.20.193.68:0/2762855803 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3021+0+0 (secure 0 0 0) 0x7fbf2c08bde0 con 0x7fbf3c114bb0 2026-02-18T21:02:08.492 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.486+0000 7fbf2a7fc640 1 -- 10.20.193.68:0/2762855803 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fbf2c065e00 con 0x7fbf3c114bb0 2026-02-18T21:02:08.568 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.566+0000 7fbf44178640 1 -- 10.20.193.68:0/2762855803 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbf3c069ef0 con 0x7fbf3c114bb0 2026-02-18T21:02:08.568 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.566+0000 7fbf2a7fc640 1 -- 10.20.193.68:0/2762855803 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fbf2c02fa40 con 0x7fbf3c114bb0 2026-02-18T21:02:08.569 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:08.569 INFO:teuthology.orchestra.run.trial068.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-18T21:02:08.570 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.567+0000 7fbf44178640 1 -- 10.20.193.68:0/2762855803 >> v1:10.20.193.68:6816/2904515774 conn(0x7fbf0c04f700 legacy=0x7fbf0c051bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.570 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.567+0000 7fbf44178640 1 -- 10.20.193.68:0/2762855803 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf3c114bb0 msgr2=0x7fbf3c1c7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.570 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.567+0000 7fbf44178640 1 --2- 10.20.193.68:0/2762855803 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf3c114bb0 0x7fbf3c1c7670 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009ad0 tx=0x7fbf2c0047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.570 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.567+0000 7fbf44178640 1 -- 10.20.193.68:0/2762855803 shutdown_connections 2026-02-18T21:02:08.570 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.567+0000 7fbf44178640 1 --2- 10.20.193.68:0/2762855803 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf3c130bb0 0x7fbf3c124a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.567+0000 7fbf44178640 1 --2- 10.20.193.68:0/2762855803 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbf3c1154d0 0x7fbf3c1c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.567+0000 7fbf44178640 1 --2- 10.20.193.68:0/2762855803 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf3c114bb0 0x7fbf3c1c7670 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.567+0000 7fbf44178640 1 -- 10.20.193.68:0/2762855803 >> 10.20.193.68:0/2762855803 conn(0x7fbf3c09cee0 msgr2=0x7fbf3c11ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:08.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.567+0000 7fbf44178640 1 -- 10.20.193.68:0/2762855803 shutdown_connections 2026-02-18T21:02:08.571 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.567+0000 7fbf44178640 1 -- 10.20.193.68:0/2762855803 wait complete. 2026-02-18T21:02:08.576 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-18T21:02:08.577 INFO:teuthology.run_tasks:Running task ceph.restart... 2026-02-18T21:02:08.591 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-18T21:02:08.591 INFO:teuthology.orchestra.run:waiting for 300 2026-02-18T21:02:08.626 INFO:tasks.ceph.osd.0:Stopped 2026-02-18T21:02:08.626 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2026-02-18T21:02:08.738 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.732+0000 7f87c683d640 1 Processor -- start 2026-02-18T21:02:08.738 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.732+0000 7f87c683d640 1 -- start start 2026-02-18T21:02:08.738 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.732+0000 7f87c683d640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f87c0114bb0 0x7f87c0114f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:08.739 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.732+0000 7f87c683d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f87c01154d0 0x7f87c0137bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:08.739 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.732+0000 7f87c683d640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87c009e050 con 0x7f87c0071420 2026-02-18T21:02:08.739 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.732+0000 7f87c683d640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f87c0116910 con 0x7f87c0114bb0 2026-02-18T21:02:08.739 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.732+0000 7f87c683d640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f87c0116090 con 0x7f87c01154d0 2026-02-18T21:02:08.739 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.732+0000 7f87bffff640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f87c0114bb0 0x7f87c0114f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:08.739 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.732+0000 7f87bf7fe640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f87c0071420 0x7f87c01344c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:50762/0 (socket says 10.20.193.68:50762) 2026-02-18T21:02:08.739 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.732+0000 7f87bf7fe640 1 -- 10.20.193.68:0/3790169565 learned_addr learned my addr 10.20.193.68:0/3790169565 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:08.739 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.732+0000 7f87c4db3640 1 --2- 10.20.193.68:0/3790169565 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f87c01154d0 0x7f87c0137bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:08.739 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.732+0000 7f87bffff640 1 -- 10.20.193.68:0/3790169565 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f87c01154d0 msgr2=0x7f87c0137bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:08.739 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.732+0000 7f87bffff640 1 --2- 10.20.193.68:0/3790169565 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f87c01154d0 0x7f87c0137bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.732+0000 7f87bffff640 1 -- 10.20.193.68:0/3790169565 >> v1:10.20.193.68:6789/0 conn(0x7f87c0071420 legacy=0x7f87c01344c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.732+0000 7f87bffff640 1 -- 10.20.193.68:0/3790169565 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c01164d0 con 0x7f87c0114bb0 2026-02-18T21:02:08.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.732+0000 7f87beffd640 1 -- 10.20.193.68:0/3790169565 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 811991510 0 0) 0x7f87c009e050 con 0x7f87c0071420 2026-02-18T21:02:08.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.733+0000 7f87bffff640 1 --2- 10.20.193.68:0/3790169565 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f87c0114bb0 0x7f87c0114f90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0098a0 tx=0x7f87ac02ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed83071fb488f35e server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:08.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.733+0000 7f87beffd640 1 -- 10.20.193.68:0/3790169565 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac03c070 con 0x7f87c0114bb0 2026-02-18T21:02:08.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.733+0000 7f87beffd640 1 -- 10.20.193.68:0/3790169565 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87ac02fa40 con 0x7f87c0114bb0 2026-02-18T21:02:08.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.733+0000 7f87beffd640 1 -- 10.20.193.68:0/3790169565 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac02fe10 con 0x7f87c0114bb0 2026-02-18T21:02:08.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.733+0000 7f87c683d640 1 -- 10.20.193.68:0/3790169565 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f87c0114bb0 msgr2=0x7f87c0114f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.733+0000 7f87c683d640 1 --2- 10.20.193.68:0/3790169565 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f87c0114bb0 0x7f87c0114f90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f87ac0098a0 tx=0x7f87ac02ed80 comp rx=0 tx=0).stop 2026-02-18T21:02:08.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.733+0000 7f87c683d640 1 -- 10.20.193.68:0/3790169565 shutdown_connections 2026-02-18T21:02:08.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.733+0000 7f87c683d640 1 --2- 10.20.193.68:0/3790169565 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f87c01154d0 0x7f87c0137bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.733+0000 7f87c683d640 1 --2- 10.20.193.68:0/3790169565 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f87c0114bb0 0x7f87c0114f90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.741 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.733+0000 7f87c683d640 1 -- 10.20.193.68:0/3790169565 >> 10.20.193.68:0/3790169565 conn(0x7f87c009cea0 msgr2=0x7f87c009d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:08.741 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.733+0000 7f87c683d640 1 -- 10.20.193.68:0/3790169565 shutdown_connections 2026-02-18T21:02:08.741 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.733+0000 7f87c683d640 1 -- 10.20.193.68:0/3790169565 wait complete. 2026-02-18T21:02:08.741 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87c683d640 1 Processor -- start 2026-02-18T21:02:08.741 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87c683d640 1 -- start start 2026-02-18T21:02:08.741 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87c683d640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f87c0071420 0x7f87c011fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:08.741 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87c683d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f87c0114bb0 0x7f87c01202b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:08.741 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87c683d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f87c01154d0 0x7f87c01207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:08.741 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87c683d640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f87c01382b0 con 0x7f87c0071420 2026-02-18T21:02:08.741 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87c683d640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f87c0138130 con 0x7f87c01154d0 2026-02-18T21:02:08.741 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87c683d640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f87c0138430 con 0x7f87c0114bb0 2026-02-18T21:02:08.741 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87bffff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f87c0071420 0x7f87c011fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:08.742 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87c4db3640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f87c01154d0 0x7f87c01207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:08.742 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87c4db3640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f87c01154d0 0x7f87c01207f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:39412/0 (socket says 10.20.193.68:39412) 2026-02-18T21:02:08.742 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87bffff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f87c0071420 0x7f87c011fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:47670/0 (socket says 10.20.193.68:47670) 2026-02-18T21:02:08.742 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87c4db3640 1 -- 10.20.193.68:0/51486763 learned_addr learned my addr 10.20.193.68:0/51486763 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:08.742 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87bf7fe640 1 --2- 10.20.193.68:0/51486763 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f87c0114bb0 0x7f87c01202b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:08.742 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87c4db3640 1 -- 10.20.193.68:0/51486763 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f87c0114bb0 msgr2=0x7f87c01202b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.742 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87c4db3640 1 --2- 10.20.193.68:0/51486763 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f87c0114bb0 0x7f87c01202b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.742 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87c4db3640 1 -- 10.20.193.68:0/51486763 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f87c0071420 msgr2=0x7f87c011fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:08.742 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87c4db3640 1 --2- 10.20.193.68:0/51486763 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f87c0071420 0x7f87c011fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:08.742 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87c4db3640 1 -- 10.20.193.68:0/51486763 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c0121670 con 0x7f87c01154d0 2026-02-18T21:02:08.742 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87bffff640 1 --2- 10.20.193.68:0/51486763 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f87c0071420 0x7f87c011fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:08.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87c4db3640 1 --2- 10.20.193.68:0/51486763 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f87c01154d0 0x7f87c01207f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009dd0 tx=0x7f87b400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:08.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87bcff9640 1 -- 10.20.193.68:0/51486763 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b4018020 con 0x7f87c01154d0 2026-02-18T21:02:08.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87bcff9640 1 -- 10.20.193.68:0/51486763 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b4014480 con 0x7f87c01154d0 2026-02-18T21:02:08.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87bcff9640 1 -- 10.20.193.68:0/51486763 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b4014870 con 0x7f87c01154d0 2026-02-18T21:02:08.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87c683d640 1 -- 10.20.193.68:0/51486763 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c0120d30 con 0x7f87c01154d0 2026-02-18T21:02:08.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.734+0000 7f87c683d640 1 -- 10.20.193.68:0/51486763 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c0122770 con 0x7f87c01154d0 2026-02-18T21:02:08.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.735+0000 7f87c683d640 1 -- 10.20.193.68:0/51486763 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c0114f90 con 0x7f87c01154d0 2026-02-18T21:02:08.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.735+0000 7f87bcff9640 1 -- 10.20.193.68:0/51486763 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 9) ==== 62001+0+0 (secure 0 0 0) 0x7f87b4014a10 con 0x7f87c01154d0 2026-02-18T21:02:08.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.735+0000 7f87bcff9640 1 -- 10.20.193.68:0/51486763 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 3021+0+0 (secure 0 0 0) 0x7f87b4067770 con 0x7f87c01154d0 2026-02-18T21:02:08.744 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.737+0000 7f87bcff9640 1 -- 10.20.193.68:0/51486763 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f87b4022070 con 0x7f87c01154d0 2026-02-18T21:02:08.811 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:08.809+0000 7f87c683d640 1 -- 10.20.193.68:0/51486763 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) -- 0x7f87c0122a30 con 0x7f87c01154d0 2026-02-18T21:02:08.811 INFO:tasks.ceph.mon.a.trial068.stderr:2026-02-18T21:02:08.809+0000 7f919cfdc640 -1 mon.a@0(leader).osd e20 definitely_dead 0 2026-02-18T21:02:09.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.004+0000 7f87bcff9640 1 -- 10.20.193.68:0/51486763 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0. v21) ==== 89+0+0 (secure 0 0 0) 0x7f87b4010040 con 0x7f87c01154d0 2026-02-18T21:02:09.006 INFO:teuthology.orchestra.run.trial068.stderr:marked down osd.0. 2026-02-18T21:02:09.007 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.005+0000 7f87c683d640 1 -- 10.20.193.68:0/51486763 >> v1:10.20.193.68:6816/2904515774 conn(0x7f879004f730 legacy=0x7f8790051bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:09.007 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.005+0000 7f87c683d640 1 -- 10.20.193.68:0/51486763 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f87c01154d0 msgr2=0x7f87c01207f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:09.008 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.005+0000 7f87c683d640 1 --2- 10.20.193.68:0/51486763 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f87c01154d0 0x7f87c01207f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009dd0 tx=0x7f87b400c490 comp rx=0 tx=0).stop 2026-02-18T21:02:09.008 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.005+0000 7f87c683d640 1 -- 10.20.193.68:0/51486763 shutdown_connections 2026-02-18T21:02:09.008 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.005+0000 7f87c683d640 1 --2- 10.20.193.68:0/51486763 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f87c01154d0 0x7f87c01207f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:09.008 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.005+0000 7f87c683d640 1 --2- 10.20.193.68:0/51486763 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f87c0114bb0 0x7f87c01202b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:09.008 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.005+0000 7f87c683d640 1 --2- 10.20.193.68:0/51486763 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f87c0071420 0x7f87c011fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:09.008 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.005+0000 7f87c683d640 1 -- 10.20.193.68:0/51486763 >> 10.20.193.68:0/51486763 conn(0x7f87c009cea0 msgr2=0x7f87c006f250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:09.008 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.005+0000 7f87c683d640 1 -- 10.20.193.68:0/51486763 shutdown_connections 2026-02-18T21:02:09.008 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.005+0000 7f87c683d640 1 -- 10.20.193.68:0/51486763 wait complete. 2026-02-18T21:02:09.015 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-18T21:02:09.016 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-18T21:02:09.018 INFO:tasks.ceph.osd.0:Started 2026-02-18T21:02:09.018 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-18T21:02:09.018 INFO:teuthology.orchestra.run:waiting for 300 2026-02-18T21:02:09.059 INFO:tasks.ceph.osd.1:Stopped 2026-02-18T21:02:09.060 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2026-02-18T21:02:09.171 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.165+0000 7f5a3c0a2640 1 Processor -- start 2026-02-18T21:02:09.171 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.165+0000 7f5a3c0a2640 1 -- start start 2026-02-18T21:02:09.171 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.166+0000 7f5a3c0a2640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5a34134a00 0x7f5a34134de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:09.172 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.166+0000 7f5a3c0a2640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5a34071f90 0x7f5a3413c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:09.172 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.166+0000 7f5a3c0a2640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a3409e050 con 0x7f5a34071420 2026-02-18T21:02:09.172 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.166+0000 7f5a3c0a2640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f5a34134540 con 0x7f5a34071f90 2026-02-18T21:02:09.172 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.166+0000 7f5a3c0a2640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f5a34073e60 con 0x7f5a34134a00 2026-02-18T21:02:09.172 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.166+0000 7f5a39e17640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5a34134a00 0x7f5a34134de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:09.172 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.166+0000 7f5a3a618640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5a34071f90 0x7f5a3413c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:09.172 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.166+0000 7f5a39e17640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5a34134a00 0x7f5a34134de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:40016/0 (socket says 10.20.193.68:40016) 2026-02-18T21:02:09.172 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.166+0000 7f5a39616640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f5a34071420 0x7f5a34071880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:50788/0 (socket says 10.20.193.68:50788) 2026-02-18T21:02:09.172 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.166+0000 7f5a39e17640 1 -- 10.20.193.68:0/453530243 learned_addr learned my addr 10.20.193.68:0/453530243 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:09.173 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.166+0000 7f5a39e17640 1 -- 10.20.193.68:0/453530243 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5a34071f90 msgr2=0x7f5a3413c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:09.173 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.166+0000 7f5a39e17640 1 --2- 10.20.193.68:0/453530243 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5a34071f90 0x7f5a3413c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:09.173 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.166+0000 7f5a39e17640 1 -- 10.20.193.68:0/453530243 >> v1:10.20.193.68:6789/0 conn(0x7f5a34071420 legacy=0x7f5a34071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:09.173 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.166+0000 7f5a38e15640 1 -- 10.20.193.68:0/453530243 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 496379632 0 0) 0x7f5a3409e050 con 0x7f5a34071420 2026-02-18T21:02:09.173 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.166+0000 7f5a39e17640 1 -- 10.20.193.68:0/453530243 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a34073060 con 0x7f5a34134a00 2026-02-18T21:02:09.173 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.166+0000 7f5a3a618640 1 --2- 10.20.193.68:0/453530243 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5a34071f90 0x7f5a3413c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:09.173 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.166+0000 7f5a39e17640 1 --2- 10.20.193.68:0/453530243 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5a34134a00 0x7f5a34134de0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5a240099a0 tx=0x7f5a2402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45e0c993ba220d69 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:09.173 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.166+0000 7f5a38e15640 1 -- 10.20.193.68:0/453530243 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2403c070 con 0x7f5a34134a00 2026-02-18T21:02:09.173 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.166+0000 7f5a38e15640 1 -- 10.20.193.68:0/453530243 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a2402fb00 con 0x7f5a34134a00 2026-02-18T21:02:09.173 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.166+0000 7f5a38e15640 1 -- 10.20.193.68:0/453530243 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a24037440 con 0x7f5a34134a00 2026-02-18T21:02:09.173 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.167+0000 7f5a3c0a2640 1 -- 10.20.193.68:0/453530243 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5a34134a00 msgr2=0x7f5a34134de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:09.174 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.167+0000 7f5a3c0a2640 1 --2- 10.20.193.68:0/453530243 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5a34134a00 0x7f5a34134de0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5a240099a0 tx=0x7f5a2402ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:09.174 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.167+0000 7f5a3c0a2640 1 -- 10.20.193.68:0/453530243 shutdown_connections 2026-02-18T21:02:09.174 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.167+0000 7f5a3c0a2640 1 --2- 10.20.193.68:0/453530243 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5a34071f90 0x7f5a3413c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:09.174 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.167+0000 7f5a3c0a2640 1 --2- 10.20.193.68:0/453530243 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5a34134a00 0x7f5a34134de0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:09.174 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.167+0000 7f5a3c0a2640 1 -- 10.20.193.68:0/453530243 >> 10.20.193.68:0/453530243 conn(0x7f5a3409cea0 msgr2=0x7f5a3409d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:09.174 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.167+0000 7f5a3c0a2640 1 -- 10.20.193.68:0/453530243 shutdown_connections 2026-02-18T21:02:09.174 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.167+0000 7f5a3c0a2640 1 -- 10.20.193.68:0/453530243 wait complete. 2026-02-18T21:02:09.174 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.167+0000 7f5a3c0a2640 1 Processor -- start 2026-02-18T21:02:09.174 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.167+0000 7f5a3c0a2640 1 -- start start 2026-02-18T21:02:09.174 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a3c0a2640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5a34071420 0x7f5a34123d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:09.174 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a3c0a2640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5a34071f90 0x7f5a341242a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:09.174 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a3c0a2640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5a34134a00 0x7f5a341247e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:09.175 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a3c0a2640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f5a34135320 con 0x7f5a34071420 2026-02-18T21:02:09.175 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a3c0a2640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f5a3413cdc0 con 0x7f5a34134a00 2026-02-18T21:02:09.175 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a3c0a2640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f5a34125ce0 con 0x7f5a34071f90 2026-02-18T21:02:09.175 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a39e17640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5a34071420 0x7f5a34123d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:09.175 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a39e17640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5a34071420 0x7f5a34123d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:47682/0 (socket says 10.20.193.68:47682) 2026-02-18T21:02:09.175 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a39e17640 1 -- 10.20.193.68:0/3884222834 learned_addr learned my addr 10.20.193.68:0/3884222834 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:09.175 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a39616640 1 --2- 10.20.193.68:0/3884222834 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5a34071f90 0x7f5a341242a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:09.175 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a3a618640 1 --2- 10.20.193.68:0/3884222834 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5a34134a00 0x7f5a341247e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:09.175 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a39e17640 1 -- 10.20.193.68:0/3884222834 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5a34071f90 msgr2=0x7f5a341242a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:09.175 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a39e17640 1 --2- 10.20.193.68:0/3884222834 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5a34071f90 0x7f5a341242a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:09.175 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a39e17640 1 -- 10.20.193.68:0/3884222834 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5a34134a00 msgr2=0x7f5a341247e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:09.175 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a39e17640 1 --2- 10.20.193.68:0/3884222834 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5a34134a00 0x7f5a341247e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:09.176 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a39e17640 1 -- 10.20.193.68:0/3884222834 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3412e520 con 0x7f5a34071420 2026-02-18T21:02:09.176 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a3a618640 1 --2- 10.20.193.68:0/3884222834 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5a34134a00 0x7f5a341247e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:09.176 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a39e17640 1 --2- 10.20.193.68:0/3884222834 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5a34071420 0x7f5a34123d60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5a2402f3a0 tx=0x7f5a240047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:09.176 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a227fc640 1 -- 10.20.193.68:0/3884222834 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2403c040 con 0x7f5a34071420 2026-02-18T21:02:09.176 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a227fc640 1 -- 10.20.193.68:0/3884222834 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a24045070 con 0x7f5a34071420 2026-02-18T21:02:09.176 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a227fc640 1 -- 10.20.193.68:0/3884222834 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a24040870 con 0x7f5a34071420 2026-02-18T21:02:09.176 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a3c0a2640 1 -- 10.20.193.68:0/3884222834 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a34124d20 con 0x7f5a34071420 2026-02-18T21:02:09.176 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.168+0000 7f5a3c0a2640 1 -- 10.20.193.68:0/3884222834 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a3412dcf0 con 0x7f5a34071420 2026-02-18T21:02:09.176 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.169+0000 7f5a3c0a2640 1 -- 10.20.193.68:0/3884222834 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a340703c0 con 0x7f5a34071420 2026-02-18T21:02:09.176 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.169+0000 7f5a227fc640 1 -- 10.20.193.68:0/3884222834 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f5a2403f070 con 0x7f5a34071420 2026-02-18T21:02:09.176 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.169+0000 7f5a227fc640 1 -- 10.20.193.68:0/3884222834 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3021+0+0 (secure 0 0 0) 0x7f5a2408b690 con 0x7f5a34071420 2026-02-18T21:02:09.177 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.171+0000 7f5a227fc640 1 -- 10.20.193.68:0/3884222834 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f5a340703c0 con 0x7f5a34071420 2026-02-18T21:02:09.247 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:09.245+0000 7f5a3c0a2640 1 -- 10.20.193.68:0/3884222834 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) -- 0x7f5a34134de0 con 0x7f5a34071420 2026-02-18T21:02:09.247 INFO:tasks.ceph.mon.a.trial068.stderr:2026-02-18T21:02:09.245+0000 7f919cfdc640 -1 mon.a@0(leader).osd e21 definitely_dead 0 2026-02-18T21:02:10.008 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.006+0000 7f5a227fc640 1 -- 10.20.193.68:0/3884222834 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v22) ==== 89+0+0 (secure 0 0 0) 0x7f5a240655a0 con 0x7f5a34071420 2026-02-18T21:02:10.008 INFO:teuthology.orchestra.run.trial068.stderr:marked down osd.1. 2026-02-18T21:02:10.010 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.009+0000 7f5a3c0a2640 1 -- 10.20.193.68:0/3884222834 >> v1:10.20.193.68:6816/2904515774 conn(0x7f5a0404f790 legacy=0x7f5a04051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:10.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.009+0000 7f5a3c0a2640 1 -- 10.20.193.68:0/3884222834 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5a34071420 msgr2=0x7f5a34123d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:10.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.009+0000 7f5a3c0a2640 1 --2- 10.20.193.68:0/3884222834 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5a34071420 0x7f5a34123d60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5a2402f3a0 tx=0x7f5a240047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:10.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.009+0000 7f5a3c0a2640 1 -- 10.20.193.68:0/3884222834 shutdown_connections 2026-02-18T21:02:10.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.009+0000 7f5a3c0a2640 1 --2- 10.20.193.68:0/3884222834 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5a34134a00 0x7f5a341247e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:10.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.009+0000 7f5a3c0a2640 1 --2- 10.20.193.68:0/3884222834 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5a34071f90 0x7f5a341242a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:10.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.009+0000 7f5a3c0a2640 1 --2- 10.20.193.68:0/3884222834 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5a34071420 0x7f5a34123d60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:10.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.009+0000 7f5a3c0a2640 1 -- 10.20.193.68:0/3884222834 >> 10.20.193.68:0/3884222834 conn(0x7f5a3409cea0 msgr2=0x7f5a3406e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:10.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.009+0000 7f5a3c0a2640 1 -- 10.20.193.68:0/3884222834 shutdown_connections 2026-02-18T21:02:10.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.009+0000 7f5a3c0a2640 1 -- 10.20.193.68:0/3884222834 wait complete. 2026-02-18T21:02:10.019 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-18T21:02:10.019 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-18T21:02:10.022 INFO:tasks.ceph.osd.1:Started 2026-02-18T21:02:10.022 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-18T21:02:10.022 INFO:teuthology.orchestra.run:waiting for 300 2026-02-18T21:02:10.072 INFO:tasks.ceph.osd.2:Stopped 2026-02-18T21:02:10.072 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2026-02-18T21:02:10.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.138+0000 7fa20500c640 1 Processor -- start 2026-02-18T21:02:10.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.138+0000 7fa20500c640 1 -- start start 2026-02-18T21:02:10.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.138+0000 7fa20500c640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fa20012ac90 0x7fa20012b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:10.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.138+0000 7fa20500c640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa200073680 0x7fa200071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:10.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.138+0000 7fa20500c640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa200071960 0x7fa200071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:10.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.138+0000 7fa20500c640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7fa20012a7b0 con 0x7fa20012ac90 2026-02-18T21:02:10.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.138+0000 7fa20500c640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fa200073e60 con 0x7fa200071960 2026-02-18T21:02:10.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.138+0000 7fa20500c640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fa200072d10 con 0x7fa200073680 2026-02-18T21:02:10.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.138+0000 7fa1fed76640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fa20012ac90 0x7fa20012b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:10.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.138+0000 7fa1fe575640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa200073680 0x7fa200071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:10.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.138+0000 7fa1ff577640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa200071960 0x7fa200071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:10.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.138+0000 7fa1fed76640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fa20012ac90 0x7fa20012b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:54570/0 (socket says 10.20.193.68:54570) 2026-02-18T21:02:10.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.138+0000 7fa1fed76640 1 -- 10.20.193.68:0/3192490416 learned_addr learned my addr 10.20.193.68:0/3192490416 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:10.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.138+0000 7fa1fe575640 1 --2- 10.20.193.68:0/3192490416 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa200073680 0x7fa200071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:58564/0 (socket says 10.20.193.68:58564) 2026-02-18T21:02:10.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.139+0000 7fa1fed76640 1 -- 10.20.193.68:0/3192490416 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa200073680 msgr2=0x7fa200071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:10.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.139+0000 7fa1fed76640 1 --2- 10.20.193.68:0/3192490416 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa200073680 0x7fa200071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:10.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.139+0000 7fa1fed76640 1 -- 10.20.193.68:0/3192490416 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa200071960 msgr2=0x7fa200071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:10.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.139+0000 7fa1fed76640 1 --2- 10.20.193.68:0/3192490416 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa200071960 0x7fa200071dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:10.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.139+0000 7fa1fed76640 1 -- 10.20.193.68:0/3192490416 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20012b5b0 con 0x7fa20012ac90 2026-02-18T21:02:10.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.139+0000 7fa1ff577640 1 --2- 10.20.193.68:0/3192490416 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa200071960 0x7fa200071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:10.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.139+0000 7fa1fed76640 1 --2- 10.20.193.68:0/3192490416 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa20012ac90 0x7fa20012b070 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009970 tx=0x7fa1f402eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30f0a0d34813963 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:10.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.139+0000 7fa1fdd74640 1 -- 10.20.193.68:0/3192490416 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f403c070 con 0x7fa20012ac90 2026-02-18T21:02:10.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.139+0000 7fa1fdd74640 1 -- 10.20.193.68:0/3192490416 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f402fad0 con 0x7fa20012ac90 2026-02-18T21:02:10.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.139+0000 7fa1fdd74640 1 -- 10.20.193.68:0/3192490416 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4037440 con 0x7fa20012ac90 2026-02-18T21:02:10.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.139+0000 7fa20500c640 1 -- 10.20.193.68:0/3192490416 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa20012ac90 msgr2=0x7fa20012b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:10.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.139+0000 7fa20500c640 1 --2- 10.20.193.68:0/3192490416 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa20012ac90 0x7fa20012b070 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009970 tx=0x7fa1f402eea0 comp rx=0 tx=0).stop 2026-02-18T21:02:10.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.139+0000 7fa20500c640 1 -- 10.20.193.68:0/3192490416 shutdown_connections 2026-02-18T21:02:10.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.139+0000 7fa20500c640 1 --2- 10.20.193.68:0/3192490416 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa200071960 0x7fa200071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:10.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.139+0000 7fa20500c640 1 --2- 10.20.193.68:0/3192490416 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa200073680 0x7fa200071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:10.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.139+0000 7fa20500c640 1 --2- 10.20.193.68:0/3192490416 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa20012ac90 0x7fa20012b070 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:10.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.139+0000 7fa20500c640 1 -- 10.20.193.68:0/3192490416 >> 10.20.193.68:0/3192490416 conn(0x7fa20009cea0 msgr2=0x7fa20009d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:10.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.139+0000 7fa20500c640 1 -- 10.20.193.68:0/3192490416 shutdown_connections 2026-02-18T21:02:10.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.139+0000 7fa20500c640 1 -- 10.20.193.68:0/3192490416 wait complete. 2026-02-18T21:02:10.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.140+0000 7fa20500c640 1 Processor -- start 2026-02-18T21:02:10.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.140+0000 7fa20500c640 1 -- start start 2026-02-18T21:02:10.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.140+0000 7fa20500c640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa200071960 0x7fa2001c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:10.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.140+0000 7fa20500c640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa200073680 0x7fa2001c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:10.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.140+0000 7fa20500c640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa20012ac90 0x7fa2001316d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:10.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.140+0000 7fa20500c640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fa2001353f0 con 0x7fa200073680 2026-02-18T21:02:10.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.140+0000 7fa20500c640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fa200135270 con 0x7fa20012ac90 2026-02-18T21:02:10.148 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.140+0000 7fa20500c640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fa200135570 con 0x7fa200071960 2026-02-18T21:02:10.148 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.140+0000 7fa1fe575640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa200073680 0x7fa2001c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:10.148 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.140+0000 7fa1ff577640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa20012ac90 0x7fa2001316d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:10.148 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.140+0000 7fa1fed76640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa200071960 0x7fa2001c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:10.148 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.140+0000 7fa1fe575640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa200073680 0x7fa2001c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:54586/0 (socket says 10.20.193.68:54586) 2026-02-18T21:02:10.148 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.140+0000 7fa1fed76640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa200071960 0x7fa2001c56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:58576/0 (socket says 10.20.193.68:58576) 2026-02-18T21:02:10.148 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.140+0000 7fa1ff577640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa20012ac90 0x7fa2001316d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:60468/0 (socket says 10.20.193.68:60468) 2026-02-18T21:02:10.148 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.140+0000 7fa1fe575640 1 -- 10.20.193.68:0/636837367 learned_addr learned my addr 10.20.193.68:0/636837367 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:10.148 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.140+0000 7fa1fe575640 1 -- 10.20.193.68:0/636837367 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa200071960 msgr2=0x7fa2001c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:10.148 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.140+0000 7fa1fe575640 1 --2- 10.20.193.68:0/636837367 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa200071960 0x7fa2001c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:10.148 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.140+0000 7fa1fe575640 1 -- 10.20.193.68:0/636837367 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa20012ac90 msgr2=0x7fa2001316d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:10.148 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.141+0000 7fa1fe575640 1 --2- 10.20.193.68:0/636837367 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa20012ac90 0x7fa2001316d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:10.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.141+0000 7fa1fe575640 1 -- 10.20.193.68:0/636837367 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2001331f0 con 0x7fa200073680 2026-02-18T21:02:10.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.141+0000 7fa1ff577640 1 --2- 10.20.193.68:0/636837367 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa20012ac90 0x7fa2001316d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:10.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.141+0000 7fa1fed76640 1 --2- 10.20.193.68:0/636837367 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa200071960 0x7fa2001c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:10.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.141+0000 7fa1fe575640 1 --2- 10.20.193.68:0/636837367 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa200073680 0x7fa2001c5bf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800ec10 tx=0x7fa1e800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:10.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.141+0000 7fa1df7fe640 1 -- 10.20.193.68:0/636837367 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8017070 con 0x7fa200073680 2026-02-18T21:02:10.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.141+0000 7fa20500c640 1 -- 10.20.193.68:0/636837367 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa200133a10 con 0x7fa200073680 2026-02-18T21:02:10.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.141+0000 7fa1df7fe640 1 -- 10.20.193.68:0/636837367 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e800cc40 con 0x7fa200073680 2026-02-18T21:02:10.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.141+0000 7fa1df7fe640 1 -- 10.20.193.68:0/636837367 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8013470 con 0x7fa200073680 2026-02-18T21:02:10.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.141+0000 7fa20500c640 1 -- 10.20.193.68:0/636837367 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa200134460 con 0x7fa200073680 2026-02-18T21:02:10.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.141+0000 7fa20500c640 1 -- 10.20.193.68:0/636837367 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa20012a5d0 con 0x7fa200073680 2026-02-18T21:02:10.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.142+0000 7fa1df7fe640 1 -- 10.20.193.68:0/636837367 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fa1e8024060 con 0x7fa200073680 2026-02-18T21:02:10.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.142+0000 7fa1df7fe640 1 -- 10.20.193.68:0/636837367 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3021+0+0 (secure 0 0 0) 0x7fa1e8066a90 con 0x7fa200073680 2026-02-18T21:02:10.150 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.144+0000 7fa1df7fe640 1 -- 10.20.193.68:0/636837367 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fa20012a5d0 con 0x7fa200073680 2026-02-18T21:02:10.220 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:10.218+0000 7fa20500c640 1 -- 10.20.193.68:0/636837367 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) -- 0x7fa200124e10 con 0x7fa200073680 2026-02-18T21:02:10.220 INFO:tasks.ceph.mon.a.trial068.stderr:2026-02-18T21:02:10.218+0000 7f919cfdc640 -1 mon.a@0(leader).osd e22 definitely_dead 0 2026-02-18T21:02:10.913 INFO:tasks.ceph.osd.0.trial068.stderr:2026-02-18T21:02:10.911+0000 7ff16c023780 -1 Falling back to public interface 2026-02-18T21:02:11.009 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.007+0000 7fa1df7fe640 1 -- 10.20.193.68:0/636837367 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v23) ==== 89+0+0 (secure 0 0 0) 0x7fa1e8040890 con 0x7fa200073680 2026-02-18T21:02:11.009 INFO:teuthology.orchestra.run.trial068.stderr:marked down osd.2. 2026-02-18T21:02:11.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.009+0000 7fa20500c640 1 -- 10.20.193.68:0/636837367 >> v1:10.20.193.68:6816/2904515774 conn(0x7fa1cc04f790 legacy=0x7fa1cc051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:11.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.009+0000 7fa20500c640 1 -- 10.20.193.68:0/636837367 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa200073680 msgr2=0x7fa2001c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:11.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.009+0000 7fa20500c640 1 --2- 10.20.193.68:0/636837367 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa200073680 0x7fa2001c5bf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800ec10 tx=0x7fa1e800c520 comp rx=0 tx=0).stop 2026-02-18T21:02:11.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.009+0000 7fa20500c640 1 -- 10.20.193.68:0/636837367 shutdown_connections 2026-02-18T21:02:11.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.009+0000 7fa20500c640 1 --2- 10.20.193.68:0/636837367 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa20012ac90 0x7fa2001316d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:11.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.009+0000 7fa20500c640 1 --2- 10.20.193.68:0/636837367 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa200073680 0x7fa2001c5bf0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:11.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.009+0000 7fa20500c640 1 --2- 10.20.193.68:0/636837367 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa200071960 0x7fa2001c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:11.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.009+0000 7fa20500c640 1 -- 10.20.193.68:0/636837367 >> 10.20.193.68:0/636837367 conn(0x7fa20009cea0 msgr2=0x7fa200127190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:11.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.009+0000 7fa20500c640 1 -- 10.20.193.68:0/636837367 shutdown_connections 2026-02-18T21:02:11.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.009+0000 7fa20500c640 1 -- 10.20.193.68:0/636837367 wait complete. 2026-02-18T21:02:11.020 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-18T21:02:11.021 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-18T21:02:11.023 INFO:tasks.ceph.osd.2:Started 2026-02-18T21:02:11.023 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-18T21:02:11.023 INFO:teuthology.orchestra.run:waiting for 300 2026-02-18T21:02:11.068 INFO:tasks.ceph.osd.3:Stopped 2026-02-18T21:02:11.069 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2026-02-18T21:02:11.142 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.135+0000 7f1ab8adf640 1 Processor -- start 2026-02-18T21:02:11.142 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.135+0000 7f1ab8adf640 1 -- start start 2026-02-18T21:02:11.142 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.136+0000 7f1ab8adf640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1ab4134a00 0x7f1ab4134de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:11.142 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.136+0000 7f1ab8adf640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f1ab4071420 0x7f1ab4071880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:11.143 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.136+0000 7f1ab8adf640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1ab4071dc0 0x7f1ab413b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:11.143 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.136+0000 7f1ab8adf640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f1ab4134540 con 0x7f1ab4071420 2026-02-18T21:02:11.143 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.136+0000 7f1ab8adf640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f1ab4073e60 con 0x7f1ab4134a00 2026-02-18T21:02:11.143 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.136+0000 7f1ab8adf640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f1ab409e050 con 0x7f1ab4071dc0 2026-02-18T21:02:11.143 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.136+0000 7f1ab2575640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1ab4134a00 0x7f1ab4134de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:11.143 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.136+0000 7f1ab1d74640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f1ab4071420 0x7f1ab4071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:11.143 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.136+0000 7f1ab2575640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1ab4134a00 0x7f1ab4134de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:60500/0 (socket says 10.20.193.68:60500) 2026-02-18T21:02:11.143 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.136+0000 7f1ab2575640 1 -- 10.20.193.68:0/1023081903 learned_addr learned my addr 10.20.193.68:0/1023081903 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:11.143 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.136+0000 7f1ab2d76640 1 --2- 10.20.193.68:0/1023081903 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1ab4071dc0 0x7f1ab413b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:11.143 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.136+0000 7f1ab2575640 1 -- 10.20.193.68:0/1023081903 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1ab4071dc0 msgr2=0x7f1ab413b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:11.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.136+0000 7f1ab2575640 1 --2- 10.20.193.68:0/1023081903 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1ab4071dc0 0x7f1ab413b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:11.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.136+0000 7f1ab2575640 1 -- 10.20.193.68:0/1023081903 >> v2:10.20.193.68:3300/0 conn(0x7f1ab4071420 msgr2=0x7f1ab4071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:11.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.136+0000 7f1ab2575640 1 --2- 10.20.193.68:0/1023081903 >> v2:10.20.193.68:3300/0 conn(0x7f1ab4071420 0x7f1ab4071880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:11.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.136+0000 7f1ab2575640 1 -- 10.20.193.68:0/1023081903 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab4072230 con 0x7f1ab4134a00 2026-02-18T21:02:11.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.136+0000 7f1ab1d74640 1 --2- 10.20.193.68:0/1023081903 >> v2:10.20.193.68:3300/0 conn(0x7f1ab4071420 0x7f1ab4071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:11.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.136+0000 7f1ab2575640 1 --2- 10.20.193.68:0/1023081903 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1ab4134a00 0x7f1ab4134de0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009970 tx=0x7f1aa802ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41b63994be24ec6d server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:11.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.137+0000 7f1ab1573640 1 -- 10.20.193.68:0/1023081903 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa803c070 con 0x7f1ab4134a00 2026-02-18T21:02:11.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.137+0000 7f1ab1573640 1 -- 10.20.193.68:0/1023081903 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aa802fac0 con 0x7f1ab4134a00 2026-02-18T21:02:11.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.137+0000 7f1ab1573640 1 -- 10.20.193.68:0/1023081903 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8037440 con 0x7f1ab4134a00 2026-02-18T21:02:11.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.137+0000 7f1ab8adf640 1 -- 10.20.193.68:0/1023081903 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1ab4134a00 msgr2=0x7f1ab4134de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:11.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.137+0000 7f1ab8adf640 1 --2- 10.20.193.68:0/1023081903 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1ab4134a00 0x7f1ab4134de0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009970 tx=0x7f1aa802ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:11.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.137+0000 7f1ab8adf640 1 -- 10.20.193.68:0/1023081903 shutdown_connections 2026-02-18T21:02:11.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.137+0000 7f1ab8adf640 1 --2- 10.20.193.68:0/1023081903 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1ab4071dc0 0x7f1ab413b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:11.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.137+0000 7f1ab8adf640 1 --2- 10.20.193.68:0/1023081903 >> v2:10.20.193.68:3300/0 conn(0x7f1ab4071420 0x7f1ab4071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:11.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.137+0000 7f1ab8adf640 1 --2- 10.20.193.68:0/1023081903 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1ab4134a00 0x7f1ab4134de0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:11.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.137+0000 7f1ab8adf640 1 -- 10.20.193.68:0/1023081903 >> 10.20.193.68:0/1023081903 conn(0x7f1ab409cea0 msgr2=0x7f1ab409d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:11.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.137+0000 7f1ab8adf640 1 -- 10.20.193.68:0/1023081903 shutdown_connections 2026-02-18T21:02:11.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.137+0000 7f1ab8adf640 1 -- 10.20.193.68:0/1023081903 wait complete. 2026-02-18T21:02:11.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.137+0000 7f1ab8adf640 1 Processor -- start 2026-02-18T21:02:11.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.137+0000 7f1ab8adf640 1 -- start start 2026-02-18T21:02:11.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab8adf640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1ab4071420 0x7f1ab4123fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:11.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab8adf640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1ab4071dc0 0x7f1ab4124500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:11.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab8adf640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1ab4134a00 0x7f1ab4124a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:11.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab8adf640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab4135320 con 0x7f1ab4071dc0 2026-02-18T21:02:11.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab8adf640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f1ab4072d10 con 0x7f1ab4071420 2026-02-18T21:02:11.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab8adf640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f1ab412eb60 con 0x7f1ab4134a00 2026-02-18T21:02:11.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab2575640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1ab4071420 0x7f1ab4123fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:11.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab2575640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1ab4071420 0x7f1ab4123fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:60512/0 (socket says 10.20.193.68:60512) 2026-02-18T21:02:11.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab2575640 1 -- 10.20.193.68:0/3085959960 learned_addr learned my addr 10.20.193.68:0/3085959960 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:11.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab1d74640 1 --2- 10.20.193.68:0/3085959960 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1ab4071dc0 0x7f1ab4124500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:11.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab2d76640 1 --2- 10.20.193.68:0/3085959960 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1ab4134a00 0x7f1ab4124a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:11.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab2575640 1 -- 10.20.193.68:0/3085959960 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1ab4134a00 msgr2=0x7f1ab4124a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:11.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab2575640 1 --2- 10.20.193.68:0/3085959960 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1ab4134a00 0x7f1ab4124a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:11.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab2575640 1 -- 10.20.193.68:0/3085959960 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1ab4071dc0 msgr2=0x7f1ab4124500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:11.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab2575640 1 --2- 10.20.193.68:0/3085959960 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1ab4071dc0 0x7f1ab4124500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:11.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab2575640 1 -- 10.20.193.68:0/3085959960 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab412eda0 con 0x7f1ab4071420 2026-02-18T21:02:11.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab1d74640 1 --2- 10.20.193.68:0/3085959960 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1ab4071dc0 0x7f1ab4124500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:11.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab2575640 1 --2- 10.20.193.68:0/3085959960 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1ab4071420 0x7f1ab4123fc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009aa0 tx=0x7f1aa80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:11.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1a9affd640 1 -- 10.20.193.68:0/3085959960 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa803c040 con 0x7f1ab4071420 2026-02-18T21:02:11.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1a9affd640 1 -- 10.20.193.68:0/3085959960 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aa8045070 con 0x7f1ab4071420 2026-02-18T21:02:11.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab8adf640 1 -- 10.20.193.68:0/3085959960 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab41271b0 con 0x7f1ab4071420 2026-02-18T21:02:11.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1a9affd640 1 -- 10.20.193.68:0/3085959960 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8040890 con 0x7f1ab4071420 2026-02-18T21:02:11.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab8adf640 1 -- 10.20.193.68:0/3085959960 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab41cb660 con 0x7f1ab4071420 2026-02-18T21:02:11.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.138+0000 7f1ab8adf640 1 -- 10.20.193.68:0/3085959960 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ab406f7b0 con 0x7f1ab4071420 2026-02-18T21:02:11.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.139+0000 7f1a9affd640 1 -- 10.20.193.68:0/3085959960 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f1aa803f070 con 0x7f1ab4071420 2026-02-18T21:02:11.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.139+0000 7f1a9affd640 1 -- 10.20.193.68:0/3085959960 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 3021+0+0 (secure 0 0 0) 0x7f1aa808b5e0 con 0x7f1ab4071420 2026-02-18T21:02:11.148 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.141+0000 7f1a9affd640 1 -- 10.20.193.68:0/3085959960 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f1ab406f7b0 con 0x7f1ab4071420 2026-02-18T21:02:11.215 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:11.213+0000 7f1ab8adf640 1 -- 10.20.193.68:0/3085959960 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) -- 0x7f1ab4071880 con 0x7f1ab4071420 2026-02-18T21:02:11.215 INFO:tasks.ceph.mon.a.trial068.stderr:2026-02-18T21:02:11.214+0000 7f919cfdc640 -1 mon.a@0(leader).osd e23 definitely_dead 0 2026-02-18T21:02:11.903 INFO:tasks.ceph.osd.1.trial068.stderr:2026-02-18T21:02:11.902+0000 7f5b92f3d780 -1 Falling back to public interface 2026-02-18T21:02:12.011 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.009+0000 7f1a9affd640 1 -- 10.20.193.68:0/3085959960 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v24) ==== 89+0+0 (secure 0 0 0) 0x7f1aa80654f0 con 0x7f1ab4071420 2026-02-18T21:02:12.011 INFO:teuthology.orchestra.run.trial068.stderr:marked down osd.3. 2026-02-18T21:02:12.012 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.010+0000 7f1ab8adf640 1 -- 10.20.193.68:0/3085959960 >> v1:10.20.193.68:6816/2904515774 conn(0x7f1a8004f790 legacy=0x7f1a80051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:12.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.010+0000 7f1ab8adf640 1 -- 10.20.193.68:0/3085959960 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1ab4071420 msgr2=0x7f1ab4123fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:12.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.010+0000 7f1ab8adf640 1 --2- 10.20.193.68:0/3085959960 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1ab4071420 0x7f1ab4123fc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8009aa0 tx=0x7f1aa80047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:12.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.010+0000 7f1ab8adf640 1 -- 10.20.193.68:0/3085959960 shutdown_connections 2026-02-18T21:02:12.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.010+0000 7f1ab8adf640 1 --2- 10.20.193.68:0/3085959960 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f1ab4134a00 0x7f1ab4124a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:12.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.010+0000 7f1ab8adf640 1 --2- 10.20.193.68:0/3085959960 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f1ab4071dc0 0x7f1ab4124500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:12.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.010+0000 7f1ab8adf640 1 --2- 10.20.193.68:0/3085959960 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1ab4071420 0x7f1ab4123fc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:12.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.010+0000 7f1ab8adf640 1 -- 10.20.193.68:0/3085959960 >> 10.20.193.68:0/3085959960 conn(0x7f1ab409cea0 msgr2=0x7f1ab4131030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:12.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.010+0000 7f1ab8adf640 1 -- 10.20.193.68:0/3085959960 shutdown_connections 2026-02-18T21:02:12.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.010+0000 7f1ab8adf640 1 -- 10.20.193.68:0/3085959960 wait complete. 2026-02-18T21:02:12.020 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-18T21:02:12.021 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-18T21:02:12.023 INFO:tasks.ceph.osd.3:Started 2026-02-18T21:02:12.023 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-18T21:02:12.023 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-18T21:02:12.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.089+0000 7f8f3c8cc640 1 Processor -- start 2026-02-18T21:02:12.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.090+0000 7f8f3c8cc640 1 -- start start 2026-02-18T21:02:12.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.090+0000 7f8f3c8cc640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8f34114bb0 0x7f8f34114f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:12.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.090+0000 7f8f3c8cc640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8f341154d0 0x7f8f341304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:12.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.090+0000 7f8f3c8cc640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f34071400 con 0x7f8f341309e0 2026-02-18T21:02:12.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.090+0000 7f8f3c8cc640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f8f340716e0 con 0x7f8f34114bb0 2026-02-18T21:02:12.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.090+0000 7f8f3c8cc640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f8f3409e090 con 0x7f8f341154d0 2026-02-18T21:02:12.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.090+0000 7f8f3a641640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8f34114bb0 0x7f8f34114f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:12.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.090+0000 7f8f39e40640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8f341154d0 0x7f8f341304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:12.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.090+0000 7f8f3ae42640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f8f341309e0 0x7f8f341376f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:51712/0 (socket says 10.20.193.68:51712) 2026-02-18T21:02:12.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.090+0000 7f8f3ae42640 1 -- 10.20.193.68:0/2918394765 learned_addr learned my addr 10.20.193.68:0/2918394765 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:12.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.090+0000 7f8f39e40640 1 -- 10.20.193.68:0/2918394765 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8f34114bb0 msgr2=0x7f8f34114f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:12.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.090+0000 7f8f39e40640 1 --2- 10.20.193.68:0/2918394765 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8f34114bb0 0x7f8f34114f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:12.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.090+0000 7f8f3963f640 1 -- 10.20.193.68:0/2918394765 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1274305433 0 0) 0x7f8f28002ca0 con 0x7f8f341309e0 2026-02-18T21:02:12.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.090+0000 7f8f39e40640 1 -- 10.20.193.68:0/2918394765 >> v1:10.20.193.68:6789/0 conn(0x7f8f341309e0 legacy=0x7f8f341376f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:12.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.090+0000 7f8f39e40640 1 -- 10.20.193.68:0/2918394765 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f34071ca0 con 0x7f8f341154d0 2026-02-18T21:02:12.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.090+0000 7f8f39e40640 1 --2- 10.20.193.68:0/2918394765 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8f341154d0 0x7f8f341304a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8f200098d0 tx=0x7f8f2002edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f2b75413f91d1a7 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:12.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.090+0000 7f8f3963f640 1 -- 10.20.193.68:0/2918394765 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2003c070 con 0x7f8f341154d0 2026-02-18T21:02:12.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.090+0000 7f8f3963f640 1 -- 10.20.193.68:0/2918394765 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f2002fa30 con 0x7f8f341154d0 2026-02-18T21:02:12.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.090+0000 7f8f3963f640 1 -- 10.20.193.68:0/2918394765 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2002fe00 con 0x7f8f341154d0 2026-02-18T21:02:12.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.091+0000 7f8f3c8cc640 1 -- 10.20.193.68:0/2918394765 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8f341154d0 msgr2=0x7f8f341304a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:12.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.091+0000 7f8f3c8cc640 1 --2- 10.20.193.68:0/2918394765 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8f341154d0 0x7f8f341304a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8f200098d0 tx=0x7f8f2002edc0 comp rx=0 tx=0).stop 2026-02-18T21:02:12.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.091+0000 7f8f3c8cc640 1 -- 10.20.193.68:0/2918394765 shutdown_connections 2026-02-18T21:02:12.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.091+0000 7f8f3c8cc640 1 --2- 10.20.193.68:0/2918394765 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8f341154d0 0x7f8f341304a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:12.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.091+0000 7f8f3c8cc640 1 --2- 10.20.193.68:0/2918394765 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8f34114bb0 0x7f8f34114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:12.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.091+0000 7f8f3c8cc640 1 -- 10.20.193.68:0/2918394765 >> 10.20.193.68:0/2918394765 conn(0x7f8f3409cee0 msgr2=0x7f8f3409d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:12.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.091+0000 7f8f3c8cc640 1 -- 10.20.193.68:0/2918394765 shutdown_connections 2026-02-18T21:02:12.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.091+0000 7f8f3c8cc640 1 -- 10.20.193.68:0/2918394765 wait complete. 2026-02-18T21:02:12.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.091+0000 7f8f3c8cc640 1 Processor -- start 2026-02-18T21:02:12.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.091+0000 7f8f3c8cc640 1 -- start start 2026-02-18T21:02:12.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f3c8cc640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8f34114bb0 0x7f8f341c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:12.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f3c8cc640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8f341154d0 0x7f8f341c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:12.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f3c8cc640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8f341309e0 0x7f8f34124860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:12.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f3c8cc640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f8f341158b0 con 0x7f8f34114bb0 2026-02-18T21:02:12.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f3c8cc640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f8f34130e90 con 0x7f8f341154d0 2026-02-18T21:02:12.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f3c8cc640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f8f34127790 con 0x7f8f341309e0 2026-02-18T21:02:12.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f3a641640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8f34114bb0 0x7f8f341c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:12.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f39e40640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8f341154d0 0x7f8f341c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:12.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f3a641640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8f34114bb0 0x7f8f341c7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:54616/0 (socket says 10.20.193.68:54616) 2026-02-18T21:02:12.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f3a641640 1 -- 10.20.193.68:0/2505021105 learned_addr learned my addr 10.20.193.68:0/2505021105 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:12.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f3ae42640 1 --2- 10.20.193.68:0/2505021105 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8f341309e0 0x7f8f34124860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:12.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f39e40640 1 -- 10.20.193.68:0/2505021105 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8f341309e0 msgr2=0x7f8f34124860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:12.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f39e40640 1 --2- 10.20.193.68:0/2505021105 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8f341309e0 0x7f8f34124860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:12.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f39e40640 1 -- 10.20.193.68:0/2505021105 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8f34114bb0 msgr2=0x7f8f341c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:12.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f39e40640 1 --2- 10.20.193.68:0/2505021105 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8f34114bb0 0x7f8f341c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:12.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f39e40640 1 -- 10.20.193.68:0/2505021105 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f34073760 con 0x7f8f341154d0 2026-02-18T21:02:12.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f39e40640 1 --2- 10.20.193.68:0/2505021105 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8f341154d0 0x7f8f341c7bb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8f20036000 tx=0x7f8f200047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:12.100 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f1effd640 1 -- 10.20.193.68:0/2505021105 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2003c040 con 0x7f8f341154d0 2026-02-18T21:02:12.100 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f1effd640 1 -- 10.20.193.68:0/2505021105 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f20042650 con 0x7f8f341154d0 2026-02-18T21:02:12.100 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f3c8cc640 1 -- 10.20.193.68:0/2505021105 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f341274b0 con 0x7f8f341154d0 2026-02-18T21:02:12.100 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f1effd640 1 -- 10.20.193.68:0/2505021105 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f20042a40 con 0x7f8f341154d0 2026-02-18T21:02:12.100 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.092+0000 7f8f3c8cc640 1 -- 10.20.193.68:0/2505021105 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f34126ae0 con 0x7f8f341154d0 2026-02-18T21:02:12.100 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.093+0000 7f8f3c8cc640 1 -- 10.20.193.68:0/2505021105 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f341312a0 con 0x7f8f341154d0 2026-02-18T21:02:12.100 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.093+0000 7f8f1effd640 1 -- 10.20.193.68:0/2505021105 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f8f2003f3c0 con 0x7f8f341154d0 2026-02-18T21:02:12.100 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.093+0000 7f8f1effd640 1 -- 10.20.193.68:0/2505021105 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 3021+0+0 (secure 0 0 0) 0x7f8f2008bb50 con 0x7f8f341154d0 2026-02-18T21:02:12.101 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.095+0000 7f8f1effd640 1 -- 10.20.193.68:0/2505021105 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f8f2002fa00 con 0x7f8f341154d0 2026-02-18T21:02:12.167 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.166+0000 7f8f3c8cc640 1 -- 10.20.193.68:0/2505021105 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f34128150 con 0x7f8f341154d0 2026-02-18T21:02:12.168 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.166+0000 7f8f1effd640 1 -- 10.20.193.68:0/2505021105 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+8491 (secure 0 0 0) 0x7f8f20065a00 con 0x7f8f341154d0 2026-02-18T21:02:12.168 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:12.168 INFO:teuthology.orchestra.run.trial068.stdout:{"epoch":24,"fsid":"73558818-cfd1-494a-84aa-56d128598ef4","created":"2026-02-18T21:01:11.071818+0000","modified":"2026-02-18T21:02:12.008626+0000","last_up_change":"2026-02-18T21:02:12.008626+0000","last_in_change":"2026-02-18T21:01:11.803245+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-18T21:01:20.913845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-18T21:01:25.650381+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"bb5f8e54-3a43-41d6-b266-aa412a7f170e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6809","nonce":25183}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6811","nonce":25183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6814","nonce":25183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6812","nonce":25183}]},"public_addr":"10.20.193.68:6809/25183","cluster_addr":"10.20.193.68:6811/25183","heartbeat_back_addr":"10.20.193.68:6814/25183","heartbeat_front_addr":"10.20.193.68:6812/25183","state":["exists"]},{"osd":1,"uuid":"e26d8762-250e-42e7-8768-23caa22edb04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":21,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6808","nonce":25184}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6810","nonce":25184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6815","nonce":25184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6813","nonce":25184}]},"public_addr":"10.20.193.68:6808/25184","cluster_addr":"10.20.193.68:6810/25184","heartbeat_back_addr":"10.20.193.68:6815/25184","heartbeat_front_addr":"10.20.193.68:6813/25184","state":["exists"]},{"osd":2,"uuid":"568ee96d-39ac-4d79-92bb-d1f3f12601b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6800","nonce":25185}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6801","nonce":25185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6803","nonce":25185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6802","nonce":25185}]},"public_addr":"10.20.193.68:6800/25185","cluster_addr":"10.20.193.68:6801/25185","heartbeat_back_addr":"10.20.193.68:6803/25185","heartbeat_front_addr":"10.20.193.68:6802/25185","state":["exists"]},{"osd":3,"uuid":"765a38cd-f526-4aba-b94e-c57076ca6c72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6804","nonce":25186}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6805","nonce":25186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6807","nonce":25186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6806","nonce":25186}]},"public_addr":"10.20.193.68:6804/25186","cluster_addr":"10.20.193.68:6805/25186","heartbeat_back_addr":"10.20.193.68:6807/25186","heartbeat_front_addr":"10.20.193.68:6806/25186","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.873205+0000","dead_epoch":21},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.929452+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.863830+0000","dead_epoch":23},{"osd":3,"down_stamp":"2026-02-18T21:02:12.008626+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.949895+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.68:0/991885778":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/4112610678":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/4267957295":"2026-02-19T21:02:04.994407+0000","10.20.193.68:6816/24610":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/3536457986":"2026-02-19T21:02:04.994407+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T21:02:12.169 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.167+0000 7f8f3c8cc640 1 -- 10.20.193.68:0/2505021105 >> v1:10.20.193.68:6816/2904515774 conn(0x7f8f0404f790 legacy=0x7f8f04051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:12.169 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.167+0000 7f8f3c8cc640 1 -- 10.20.193.68:0/2505021105 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8f341154d0 msgr2=0x7f8f341c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:12.169 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.167+0000 7f8f3c8cc640 1 --2- 10.20.193.68:0/2505021105 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8f341154d0 0x7f8f341c7bb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8f20036000 tx=0x7f8f200047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:12.169 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.167+0000 7f8f3c8cc640 1 -- 10.20.193.68:0/2505021105 shutdown_connections 2026-02-18T21:02:12.170 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.167+0000 7f8f3c8cc640 1 --2- 10.20.193.68:0/2505021105 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8f341309e0 0x7f8f34124860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:12.170 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.167+0000 7f8f3c8cc640 1 --2- 10.20.193.68:0/2505021105 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8f341154d0 0x7f8f341c7bb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:12.170 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.167+0000 7f8f3c8cc640 1 --2- 10.20.193.68:0/2505021105 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8f34114bb0 0x7f8f341c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:12.170 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.167+0000 7f8f3c8cc640 1 -- 10.20.193.68:0/2505021105 >> 10.20.193.68:0/2505021105 conn(0x7f8f3409cee0 msgr2=0x7f8f3411db80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:12.170 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.167+0000 7f8f3c8cc640 1 -- 10.20.193.68:0/2505021105 shutdown_connections 2026-02-18T21:02:12.170 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:12.167+0000 7f8f3c8cc640 1 -- 10.20.193.68:0/2505021105 wait complete. 2026-02-18T21:02:12.908 INFO:tasks.ceph.osd.2.trial068.stderr:2026-02-18T21:02:12.907+0000 7f4347a10780 -1 Falling back to public interface 2026-02-18T21:02:13.905 INFO:tasks.ceph.osd.3.trial068.stderr:2026-02-18T21:02:13.904+0000 7f147dd64780 -1 Falling back to public interface 2026-02-18T21:02:15.177 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-18T21:02:15.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.246+0000 7f9ccc690640 1 Processor -- start 2026-02-18T21:02:15.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.246+0000 7f9ccc690640 1 -- start start 2026-02-18T21:02:15.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.246+0000 7f9ccc690640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f9cc412e1b0 0x7f9cc412e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:15.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.246+0000 7f9ccc690640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cc4073680 0x7f9cc4071400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:15.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.246+0000 7f9ccc690640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cc409e090 con 0x7f9cc4071940 2026-02-18T21:02:15.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.246+0000 7f9ccc690640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f9cc4073e60 con 0x7f9cc412e1b0 2026-02-18T21:02:15.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.246+0000 7f9ccc690640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f9cc412ead0 con 0x7f9cc4073680 2026-02-18T21:02:15.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.246+0000 7f9cc9c04640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cc4073680 0x7f9cc4071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:15.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.246+0000 7f9cca405640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f9cc412e1b0 0x7f9cc412e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:15.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.246+0000 7f9ccac06640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f9cc4071940 0x7f9cc4135080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:51726/0 (socket says 10.20.193.68:51726) 2026-02-18T21:02:15.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.246+0000 7f9ccac06640 1 -- 10.20.193.68:0/663342084 learned_addr learned my addr 10.20.193.68:0/663342084 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:15.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.246+0000 7f9cca405640 1 -- 10.20.193.68:0/663342084 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cc4073680 msgr2=0x7f9cc4071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:15.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.246+0000 7f9cca405640 1 --2- 10.20.193.68:0/663342084 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cc4073680 0x7f9cc4071400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:15.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.246+0000 7f9cca405640 1 -- 10.20.193.68:0/663342084 >> v1:10.20.193.68:6789/0 conn(0x7f9cc4071940 legacy=0x7f9cc4135080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:15.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.246+0000 7f9cc9403640 1 -- 10.20.193.68:0/663342084 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 183219295 0 0) 0x7f9cc409e090 con 0x7f9cc4071940 2026-02-18T21:02:15.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.246+0000 7f9cca405640 1 -- 10.20.193.68:0/663342084 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc4072d10 con 0x7f9cc412e1b0 2026-02-18T21:02:15.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.247+0000 7f9cca405640 1 --2- 10.20.193.68:0/663342084 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9cc412e1b0 0x7f9cc412e590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40098a0 tx=0x7f9cb402ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a84bc8f7711d50 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:15.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.247+0000 7f9cc9403640 1 -- 10.20.193.68:0/663342084 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb403c070 con 0x7f9cc412e1b0 2026-02-18T21:02:15.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.247+0000 7f9cc9403640 1 -- 10.20.193.68:0/663342084 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb402fa40 con 0x7f9cc412e1b0 2026-02-18T21:02:15.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.247+0000 7f9cc9403640 1 -- 10.20.193.68:0/663342084 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb402fe10 con 0x7f9cc412e1b0 2026-02-18T21:02:15.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.247+0000 7f9ccc690640 1 -- 10.20.193.68:0/663342084 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9cc412e1b0 msgr2=0x7f9cc412e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:15.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.247+0000 7f9ccc690640 1 --2- 10.20.193.68:0/663342084 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9cc412e1b0 0x7f9cc412e590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40098a0 tx=0x7f9cb402ed80 comp rx=0 tx=0).stop 2026-02-18T21:02:15.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.247+0000 7f9ccc690640 1 -- 10.20.193.68:0/663342084 shutdown_connections 2026-02-18T21:02:15.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.247+0000 7f9ccc690640 1 --2- 10.20.193.68:0/663342084 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cc4073680 0x7f9cc4071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:15.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.247+0000 7f9ccc690640 1 --2- 10.20.193.68:0/663342084 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9cc412e1b0 0x7f9cc412e590 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:15.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.247+0000 7f9ccc690640 1 -- 10.20.193.68:0/663342084 >> 10.20.193.68:0/663342084 conn(0x7f9cc409cee0 msgr2=0x7f9cc409d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:15.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.247+0000 7f9ccc690640 1 -- 10.20.193.68:0/663342084 shutdown_connections 2026-02-18T21:02:15.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.247+0000 7f9ccc690640 1 -- 10.20.193.68:0/663342084 wait complete. 2026-02-18T21:02:15.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9ccc690640 1 Processor -- start 2026-02-18T21:02:15.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9ccc690640 1 -- start start 2026-02-18T21:02:15.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9ccc690640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cc4071940 0x7f9cc4131b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:15.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9ccc690640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9cc4073680 0x7f9cc41320a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:15.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9ccc690640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9cc412e1b0 0x7f9cc41325e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:15.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9ccc690640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc4072160 con 0x7f9cc4073680 2026-02-18T21:02:15.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9ccc690640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f9cc4071fe0 con 0x7f9cc4071940 2026-02-18T21:02:15.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9ccc690640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f9cc41367a0 con 0x7f9cc412e1b0 2026-02-18T21:02:15.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9cca405640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cc4071940 0x7f9cc4131b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:15.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9cc9c04640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9cc4073680 0x7f9cc41320a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:15.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9cca405640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cc4071940 0x7f9cc4131b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:60552/0 (socket says 10.20.193.68:60552) 2026-02-18T21:02:15.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9cca405640 1 -- 10.20.193.68:0/2852541583 learned_addr learned my addr 10.20.193.68:0/2852541583 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:15.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9ccac06640 1 --2- 10.20.193.68:0/2852541583 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9cc412e1b0 0x7f9cc41325e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:15.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9cca405640 1 -- 10.20.193.68:0/2852541583 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9cc412e1b0 msgr2=0x7f9cc41325e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:15.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9cca405640 1 --2- 10.20.193.68:0/2852541583 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9cc412e1b0 0x7f9cc41325e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:15.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9cca405640 1 -- 10.20.193.68:0/2852541583 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9cc4073680 msgr2=0x7f9cc41320a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:15.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9cca405640 1 --2- 10.20.193.68:0/2852541583 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9cc4073680 0x7f9cc41320a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:15.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9cca405640 1 -- 10.20.193.68:0/2852541583 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc4135620 con 0x7f9cc4071940 2026-02-18T21:02:15.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9cc9c04640 1 --2- 10.20.193.68:0/2852541583 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9cc4073680 0x7f9cc41320a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:15.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9cca405640 1 --2- 10.20.193.68:0/2852541583 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cc4071940 0x7f9cc4131b60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40099d0 tx=0x7f9cb40047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:15.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9caaffd640 1 -- 10.20.193.68:0/2852541583 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4047070 con 0x7f9cc4071940 2026-02-18T21:02:15.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9caaffd640 1 -- 10.20.193.68:0/2852541583 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb4042630 con 0x7f9cc4071940 2026-02-18T21:02:15.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9caaffd640 1 -- 10.20.193.68:0/2852541583 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb403c040 con 0x7f9cc4071940 2026-02-18T21:02:15.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9ccc690640 1 -- 10.20.193.68:0/2852541583 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc41336d0 con 0x7f9cc4071940 2026-02-18T21:02:15.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.248+0000 7f9ccc690640 1 -- 10.20.193.68:0/2852541583 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc41353b0 con 0x7f9cc4071940 2026-02-18T21:02:15.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.249+0000 7f9ccc690640 1 -- 10.20.193.68:0/2852541583 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cc4134010 con 0x7f9cc4071940 2026-02-18T21:02:15.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.249+0000 7f9caaffd640 1 -- 10.20.193.68:0/2852541583 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f9cb403f3c0 con 0x7f9cc4071940 2026-02-18T21:02:15.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.249+0000 7f9caaffd640 1 -- 10.20.193.68:0/2852541583 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 3021+0+0 (secure 0 0 0) 0x7f9cb408b830 con 0x7f9cc4071940 2026-02-18T21:02:15.256 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.251+0000 7f9caaffd640 1 -- 10.20.193.68:0/2852541583 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f9cc4134010 con 0x7f9cc4071940 2026-02-18T21:02:15.320 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.320+0000 7f9ccc690640 1 -- 10.20.193.68:0/2852541583 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9cc4071400 con 0x7f9cc4071940 2026-02-18T21:02:15.321 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.321+0000 7f9caaffd640 1 -- 10.20.193.68:0/2852541583 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+8491 (secure 0 0 0) 0x7f9cb40656e0 con 0x7f9cc4071940 2026-02-18T21:02:15.322 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:15.322 INFO:teuthology.orchestra.run.trial068.stdout:{"epoch":24,"fsid":"73558818-cfd1-494a-84aa-56d128598ef4","created":"2026-02-18T21:01:11.071818+0000","modified":"2026-02-18T21:02:12.008626+0000","last_up_change":"2026-02-18T21:02:12.008626+0000","last_in_change":"2026-02-18T21:01:11.803245+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-18T21:01:20.913845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-18T21:01:25.650381+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"bb5f8e54-3a43-41d6-b266-aa412a7f170e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6809","nonce":25183}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6811","nonce":25183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6814","nonce":25183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6812","nonce":25183}]},"public_addr":"10.20.193.68:6809/25183","cluster_addr":"10.20.193.68:6811/25183","heartbeat_back_addr":"10.20.193.68:6814/25183","heartbeat_front_addr":"10.20.193.68:6812/25183","state":["exists"]},{"osd":1,"uuid":"e26d8762-250e-42e7-8768-23caa22edb04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":21,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6808","nonce":25184}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6810","nonce":25184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6815","nonce":25184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6813","nonce":25184}]},"public_addr":"10.20.193.68:6808/25184","cluster_addr":"10.20.193.68:6810/25184","heartbeat_back_addr":"10.20.193.68:6815/25184","heartbeat_front_addr":"10.20.193.68:6813/25184","state":["exists"]},{"osd":2,"uuid":"568ee96d-39ac-4d79-92bb-d1f3f12601b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6800","nonce":25185}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6801","nonce":25185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6803","nonce":25185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6802","nonce":25185}]},"public_addr":"10.20.193.68:6800/25185","cluster_addr":"10.20.193.68:6801/25185","heartbeat_back_addr":"10.20.193.68:6803/25185","heartbeat_front_addr":"10.20.193.68:6802/25185","state":["exists"]},{"osd":3,"uuid":"765a38cd-f526-4aba-b94e-c57076ca6c72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6804","nonce":25186}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6805","nonce":25186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6807","nonce":25186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6806","nonce":25186}]},"public_addr":"10.20.193.68:6804/25186","cluster_addr":"10.20.193.68:6805/25186","heartbeat_back_addr":"10.20.193.68:6807/25186","heartbeat_front_addr":"10.20.193.68:6806/25186","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.873205+0000","dead_epoch":21},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.929452+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.863830+0000","dead_epoch":23},{"osd":3,"down_stamp":"2026-02-18T21:02:12.008626+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.949895+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.68:0/991885778":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/4112610678":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/4267957295":"2026-02-19T21:02:04.994407+0000","10.20.193.68:6816/24610":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/3536457986":"2026-02-19T21:02:04.994407+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T21:02:15.323 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.321+0000 7f9ccc690640 1 -- 10.20.193.68:0/2852541583 >> v1:10.20.193.68:6816/2904515774 conn(0x7f9c9404f790 legacy=0x7f9c94051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:15.323 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.321+0000 7f9ccc690640 1 -- 10.20.193.68:0/2852541583 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cc4071940 msgr2=0x7f9cc4131b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:15.323 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.321+0000 7f9ccc690640 1 --2- 10.20.193.68:0/2852541583 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cc4071940 0x7f9cc4131b60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9cb40099d0 tx=0x7f9cb40047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:15.323 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.321+0000 7f9ccc690640 1 -- 10.20.193.68:0/2852541583 shutdown_connections 2026-02-18T21:02:15.323 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.321+0000 7f9ccc690640 1 --2- 10.20.193.68:0/2852541583 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9cc412e1b0 0x7f9cc41325e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:15.323 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.321+0000 7f9ccc690640 1 --2- 10.20.193.68:0/2852541583 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9cc4073680 0x7f9cc41320a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:15.324 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.321+0000 7f9ccc690640 1 --2- 10.20.193.68:0/2852541583 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cc4071940 0x7f9cc4131b60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:15.324 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.321+0000 7f9ccc690640 1 -- 10.20.193.68:0/2852541583 >> 10.20.193.68:0/2852541583 conn(0x7f9cc409cee0 msgr2=0x7f9cc4127190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:15.324 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.321+0000 7f9ccc690640 1 -- 10.20.193.68:0/2852541583 shutdown_connections 2026-02-18T21:02:15.324 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:15.321+0000 7f9ccc690640 1 -- 10.20.193.68:0/2852541583 wait complete. 2026-02-18T21:02:15.561 INFO:tasks.ceph.osd.0.trial068.stderr:2026-02-18T21:02:15.561+0000 7ff16c023780 -1 osd.0 20 log_to_monitors true 2026-02-18T21:02:16.026 INFO:tasks.ceph.osd.0.trial068.stderr:2026-02-18T21:02:16.026+0000 7ff15f71d640 -1 osd.0 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-18T21:02:16.547 INFO:tasks.ceph.osd.1.trial068.stderr:2026-02-18T21:02:16.547+0000 7f5b92f3d780 -1 osd.1 21 log_to_monitors true 2026-02-18T21:02:17.027 INFO:tasks.ceph.osd.1.trial068.stderr:2026-02-18T21:02:17.027+0000 7f5b86cdc640 -1 osd.1 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-18T21:02:17.591 INFO:tasks.ceph.osd.2.trial068.stderr:2026-02-18T21:02:17.591+0000 7f4347a10780 -1 osd.2 21 log_to_monitors true 2026-02-18T21:02:18.030 INFO:tasks.ceph.osd.2.trial068.stderr:2026-02-18T21:02:18.029+0000 7f433b15b640 -1 osd.2 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-18T21:02:18.331 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-18T21:02:18.402 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.398+0000 7f7a6c6a9640 1 Processor -- start 2026-02-18T21:02:18.403 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.399+0000 7f7a6c6a9640 1 -- start start 2026-02-18T21:02:18.403 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.399+0000 7f7a6c6a9640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7a64071400 0x7f7a640717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:18.403 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.399+0000 7f7a6c6a9640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f7a64071d20 0x7f7a6412de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:18.403 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.399+0000 7f7a6c6a9640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7a6412e340 0x7f7a6412e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:18.403 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.399+0000 7f7a6c6a9640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f7a640731f0 con 0x7f7a64071d20 2026-02-18T21:02:18.403 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.399+0000 7f7a6c6a9640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f7a6409e090 con 0x7f7a64071400 2026-02-18T21:02:18.403 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.399+0000 7f7a6c6a9640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f7a64073f90 con 0x7f7a6412e340 2026-02-18T21:02:18.403 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.399+0000 7f7a6a41e640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7a64071400 0x7f7a640717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:18.404 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.399+0000 7f7a6ac1f640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7a6412e340 0x7f7a6412e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:18.404 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.399+0000 7f7a69c1d640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f7a64071d20 0x7f7a6412de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:18.404 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.399+0000 7f7a6a41e640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7a64071400 0x7f7a640717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:60566/0 (socket says 10.20.193.68:60566) 2026-02-18T21:02:18.404 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.399+0000 7f7a6ac1f640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7a6412e340 0x7f7a6412e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:58654/0 (socket says 10.20.193.68:58654) 2026-02-18T21:02:18.404 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.399+0000 7f7a6a41e640 1 -- 10.20.193.68:0/319221049 learned_addr learned my addr 10.20.193.68:0/319221049 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:18.404 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.399+0000 7f7a6ac1f640 1 -- 10.20.193.68:0/319221049 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7a64071400 msgr2=0x7f7a640717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:18.404 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.399+0000 7f7a6ac1f640 1 --2- 10.20.193.68:0/319221049 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7a64071400 0x7f7a640717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:18.404 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.399+0000 7f7a6ac1f640 1 -- 10.20.193.68:0/319221049 >> v2:10.20.193.68:3300/0 conn(0x7f7a64071d20 msgr2=0x7f7a6412de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:18.404 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.399+0000 7f7a6ac1f640 1 --2- 10.20.193.68:0/319221049 >> v2:10.20.193.68:3300/0 conn(0x7f7a64071d20 0x7f7a6412de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:18.404 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.399+0000 7f7a6ac1f640 1 -- 10.20.193.68:0/319221049 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a64072900 con 0x7f7a6412e340 2026-02-18T21:02:18.404 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.400+0000 7f7a6ac1f640 1 --2- 10.20.193.68:0/319221049 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7a6412e340 0x7f7a6412e7c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7a60009d90 tx=0x7f7a6002f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9ad1f60c31c80b0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:18.404 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.400+0000 7f7a6941c640 1 -- 10.20.193.68:0/319221049 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6003c070 con 0x7f7a6412e340 2026-02-18T21:02:18.405 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.400+0000 7f7a6941c640 1 -- 10.20.193.68:0/319221049 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a6002fe50 con 0x7f7a6412e340 2026-02-18T21:02:18.405 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.400+0000 7f7a6941c640 1 -- 10.20.193.68:0/319221049 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a60037660 con 0x7f7a6412e340 2026-02-18T21:02:18.405 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.400+0000 7f7a6c6a9640 1 -- 10.20.193.68:0/319221049 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7a6412e340 msgr2=0x7f7a6412e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:18.405 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.400+0000 7f7a6c6a9640 1 --2- 10.20.193.68:0/319221049 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7a6412e340 0x7f7a6412e7c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7a60009d90 tx=0x7f7a6002f1e0 comp rx=0 tx=0).stop 2026-02-18T21:02:18.405 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.400+0000 7f7a6c6a9640 1 -- 10.20.193.68:0/319221049 shutdown_connections 2026-02-18T21:02:18.405 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.400+0000 7f7a6c6a9640 1 --2- 10.20.193.68:0/319221049 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7a6412e340 0x7f7a6412e7c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:18.405 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.400+0000 7f7a6c6a9640 1 --2- 10.20.193.68:0/319221049 >> v2:10.20.193.68:3300/0 conn(0x7f7a64071d20 0x7f7a6412de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:18.405 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.400+0000 7f7a6c6a9640 1 --2- 10.20.193.68:0/319221049 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7a64071400 0x7f7a640717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:18.405 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.400+0000 7f7a6c6a9640 1 -- 10.20.193.68:0/319221049 >> 10.20.193.68:0/319221049 conn(0x7f7a6409cee0 msgr2=0x7f7a6409d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:18.405 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.400+0000 7f7a6c6a9640 1 -- 10.20.193.68:0/319221049 shutdown_connections 2026-02-18T21:02:18.405 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.400+0000 7f7a6c6a9640 1 -- 10.20.193.68:0/319221049 wait complete. 2026-02-18T21:02:18.405 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.400+0000 7f7a6c6a9640 1 Processor -- start 2026-02-18T21:02:18.405 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a6c6a9640 1 -- start start 2026-02-18T21:02:18.406 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a6c6a9640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7a64071400 0x7f7a641cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:18.406 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a6c6a9640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7a64071d20 0x7f7a641cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:18.406 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a6c6a9640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7a6412e340 0x7f7a641cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:18.406 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a6c6a9640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f7a64072100 con 0x7f7a64071d20 2026-02-18T21:02:18.406 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a6c6a9640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f7a6413ba30 con 0x7f7a6412e340 2026-02-18T21:02:18.406 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a6c6a9640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f7a6413b040 con 0x7f7a64071400 2026-02-18T21:02:18.406 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a6a41e640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7a64071400 0x7f7a641cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:18.406 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a69c1d640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7a64071d20 0x7f7a641cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:18.406 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a6ac1f640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7a6412e340 0x7f7a641cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:18.406 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a69c1d640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7a64071d20 0x7f7a641cbf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:54654/0 (socket says 10.20.193.68:54654) 2026-02-18T21:02:18.406 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a6a41e640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7a64071400 0x7f7a641cba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:58664/0 (socket says 10.20.193.68:58664) 2026-02-18T21:02:18.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a69c1d640 1 -- 10.20.193.68:0/2301828303 learned_addr learned my addr 10.20.193.68:0/2301828303 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:18.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a69c1d640 1 -- 10.20.193.68:0/2301828303 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7a64071400 msgr2=0x7f7a641cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:18.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a69c1d640 1 --2- 10.20.193.68:0/2301828303 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7a64071400 0x7f7a641cba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:18.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a69c1d640 1 -- 10.20.193.68:0/2301828303 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7a6412e340 msgr2=0x7f7a641cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:18.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a69c1d640 1 --2- 10.20.193.68:0/2301828303 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7a6412e340 0x7f7a641cc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:18.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a69c1d640 1 -- 10.20.193.68:0/2301828303 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6412ee10 con 0x7f7a64071d20 2026-02-18T21:02:18.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a69c1d640 1 --2- 10.20.193.68:0/2301828303 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7a64071d20 0x7f7a641cbf90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800ebe0 tx=0x7f7a5800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:18.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a4affd640 1 -- 10.20.193.68:0/2301828303 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a58017070 con 0x7f7a64071d20 2026-02-18T21:02:18.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a4affd640 1 -- 10.20.193.68:0/2301828303 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5800cc40 con 0x7f7a64071d20 2026-02-18T21:02:18.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a6c6a9640 1 -- 10.20.193.68:0/2301828303 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a6413a7e0 con 0x7f7a64071d20 2026-02-18T21:02:18.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a4affd640 1 -- 10.20.193.68:0/2301828303 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a58013470 con 0x7f7a64071d20 2026-02-18T21:02:18.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.401+0000 7f7a6c6a9640 1 -- 10.20.193.68:0/2301828303 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a64114c50 con 0x7f7a64071d20 2026-02-18T21:02:18.407 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.402+0000 7f7a6c6a9640 1 -- 10.20.193.68:0/2301828303 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a6412de00 con 0x7f7a64071d20 2026-02-18T21:02:18.408 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.402+0000 7f7a4affd640 1 -- 10.20.193.68:0/2301828303 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f7a58013610 con 0x7f7a64071d20 2026-02-18T21:02:18.408 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.402+0000 7f7a4affd640 1 -- 10.20.193.68:0/2301828303 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3021+0+0 (secure 0 0 0) 0x7f7a58067270 con 0x7f7a64071d20 2026-02-18T21:02:18.408 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.404+0000 7f7a4affd640 1 -- 10.20.193.68:0/2301828303 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f7a58041070 con 0x7f7a64071d20 2026-02-18T21:02:18.476 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.476+0000 7f7a6c6a9640 1 -- 10.20.193.68:0/2301828303 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a64069ef0 con 0x7f7a64071d20 2026-02-18T21:02:18.476 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.476+0000 7f7a4affd640 1 -- 10.20.193.68:0/2301828303 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+9019 (secure 0 0 0) 0x7f7a58066330 con 0x7f7a64071d20 2026-02-18T21:02:18.477 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:18.477 INFO:teuthology.orchestra.run.trial068.stdout:{"epoch":27,"fsid":"73558818-cfd1-494a-84aa-56d128598ef4","created":"2026-02-18T21:01:11.071818+0000","modified":"2026-02-18T21:02:18.023329+0000","last_up_change":"2026-02-18T21:02:18.023329+0000","last_in_change":"2026-02-18T21:01:11.803245+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-18T21:01:20.913845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-18T21:01:25.650381+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"error_message":"pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.1), read balance score may not be reliable","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"bb5f8e54-3a43-41d6-b266-aa412a7f170e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":26,"up_thru":26,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6800","nonce":2637053487}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6801","nonce":2637053487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6803","nonce":2637053487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6802","nonce":2637053487}]},"public_addr":"10.20.193.68:6800/2637053487","cluster_addr":"10.20.193.68:6801/2637053487","heartbeat_back_addr":"10.20.193.68:6803/2637053487","heartbeat_front_addr":"10.20.193.68:6802/2637053487","state":["exists","up"]},{"osd":1,"uuid":"e26d8762-250e-42e7-8768-23caa22edb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":27,"up_thru":21,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6804","nonce":4160428224}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6805","nonce":4160428224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6807","nonce":4160428224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6806","nonce":4160428224}]},"public_addr":"10.20.193.68:6804/4160428224","cluster_addr":"10.20.193.68:6805/4160428224","heartbeat_back_addr":"10.20.193.68:6807/4160428224","heartbeat_front_addr":"10.20.193.68:6806/4160428224","state":["exists","up"]},{"osd":2,"uuid":"568ee96d-39ac-4d79-92bb-d1f3f12601b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6800","nonce":25185}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6801","nonce":25185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6803","nonce":25185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6802","nonce":25185}]},"public_addr":"10.20.193.68:6800/25185","cluster_addr":"10.20.193.68:6801/25185","heartbeat_back_addr":"10.20.193.68:6803/25185","heartbeat_front_addr":"10.20.193.68:6802/25185","state":["exists"]},{"osd":3,"uuid":"765a38cd-f526-4aba-b94e-c57076ca6c72","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6804","nonce":25186}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6805","nonce":25186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6807","nonce":25186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6806","nonce":25186}]},"public_addr":"10.20.193.68:6804/25186","cluster_addr":"10.20.193.68:6805/25186","heartbeat_back_addr":"10.20.193.68:6807/25186","heartbeat_front_addr":"10.20.193.68:6806/25186","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.873205+0000","dead_epoch":21},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.929452+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.863830+0000","dead_epoch":23},{"osd":3,"down_stamp":"2026-02-18T21:02:12.008626+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.949895+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.68:0/991885778":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/4112610678":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/4267957295":"2026-02-19T21:02:04.994407+0000","10.20.193.68:6816/24610":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/3536457986":"2026-02-19T21:02:04.994407+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T21:02:18.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.477+0000 7f7a6c6a9640 1 -- 10.20.193.68:0/2301828303 >> v1:10.20.193.68:6816/2904515774 conn(0x7f7a3404f790 legacy=0x7f7a34051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:18.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.477+0000 7f7a6c6a9640 1 -- 10.20.193.68:0/2301828303 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7a64071d20 msgr2=0x7f7a641cbf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:18.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.477+0000 7f7a6c6a9640 1 --2- 10.20.193.68:0/2301828303 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7a64071d20 0x7f7a641cbf90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800ebe0 tx=0x7f7a5800c520 comp rx=0 tx=0).stop 2026-02-18T21:02:18.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.477+0000 7f7a6c6a9640 1 -- 10.20.193.68:0/2301828303 shutdown_connections 2026-02-18T21:02:18.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.477+0000 7f7a6c6a9640 1 --2- 10.20.193.68:0/2301828303 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7a6412e340 0x7f7a641cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:18.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.477+0000 7f7a6c6a9640 1 --2- 10.20.193.68:0/2301828303 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7a64071d20 0x7f7a641cbf90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:18.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.477+0000 7f7a6c6a9640 1 --2- 10.20.193.68:0/2301828303 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7a64071400 0x7f7a641cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:18.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.477+0000 7f7a6c6a9640 1 -- 10.20.193.68:0/2301828303 >> 10.20.193.68:0/2301828303 conn(0x7f7a6409cee0 msgr2=0x7f7a641342e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:18.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.477+0000 7f7a6c6a9640 1 -- 10.20.193.68:0/2301828303 shutdown_connections 2026-02-18T21:02:18.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:18.477+0000 7f7a6c6a9640 1 -- 10.20.193.68:0/2301828303 wait complete. 2026-02-18T21:02:18.568 INFO:tasks.ceph.osd.3.trial068.stderr:2026-02-18T21:02:18.568+0000 7f147dd64780 -1 osd.3 23 log_to_monitors true 2026-02-18T21:02:19.034 INFO:tasks.ceph.osd.3.trial068.stderr:2026-02-18T21:02:19.034+0000 7f1471b05640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-18T21:02:21.485 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-18T21:02:21.558 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.554+0000 7fd1c5f2f640 1 Processor -- start 2026-02-18T21:02:21.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.554+0000 7fd1c5f2f640 1 -- start start 2026-02-18T21:02:21.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.554+0000 7fd1c5f2f640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fd1c0071400 0x7fd1c00717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:21.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.554+0000 7fd1c5f2f640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd1c0071d20 0x7fd1c012de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:21.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.554+0000 7fd1c5f2f640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1c00731f0 con 0x7fd1c012e340 2026-02-18T21:02:21.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.554+0000 7fd1c5f2f640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7fd1c009e090 con 0x7fd1c0071400 2026-02-18T21:02:21.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.554+0000 7fd1c5f2f640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fd1c0073f90 con 0x7fd1c0071d20 2026-02-18T21:02:21.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.554+0000 7fd1beffd640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd1c0071d20 0x7fd1c012de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:21.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.554+0000 7fd1bf7fe640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fd1c0071400 0x7fd1c00717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:21.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.554+0000 7fd1beffd640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd1c0071d20 0x7fd1c012de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60388/0 (socket says 10.20.193.68:60388) 2026-02-18T21:02:21.559 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.554+0000 7fd1beffd640 1 -- 10.20.193.68:0/3571138850 learned_addr learned my addr 10.20.193.68:0/3571138850 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:21.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.554+0000 7fd1beffd640 1 -- 10.20.193.68:0/3571138850 >> v2:10.20.193.68:3300/0 conn(0x7fd1c0071400 msgr2=0x7fd1c00717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:21.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.554+0000 7fd1beffd640 1 --2- 10.20.193.68:0/3571138850 >> v2:10.20.193.68:3300/0 conn(0x7fd1c0071400 0x7fd1c00717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.554+0000 7fd1be7fc640 1 -- 10.20.193.68:0/3571138850 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1319467161 0 0) 0x7fd1b4002ca0 con 0x7fd1c012e340 2026-02-18T21:02:21.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.554+0000 7fd1beffd640 1 -- 10.20.193.68:0/3571138850 >> v1:10.20.193.68:6789/0 conn(0x7fd1c012e340 legacy=0x7fd1c013ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:21.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.554+0000 7fd1beffd640 1 -- 10.20.193.68:0/3571138850 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c0072900 con 0x7fd1c0071d20 2026-02-18T21:02:21.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.554+0000 7fd1bf7fe640 1 --2- 10.20.193.68:0/3571138850 >> v2:10.20.193.68:3300/0 conn(0x7fd1c0071400 0x7fd1c00717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:21.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.555+0000 7fd1beffd640 1 --2- 10.20.193.68:0/3571138850 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd1c0071d20 0x7fd1c012de00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0009970 tx=0x7fd1b002eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e8ef769ddf1206a server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:21.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.555+0000 7fd1be7fc640 1 -- 10.20.193.68:0/3571138850 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b003c070 con 0x7fd1c0071d20 2026-02-18T21:02:21.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.555+0000 7fd1be7fc640 1 -- 10.20.193.68:0/3571138850 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1b002fbb0 con 0x7fd1c0071d20 2026-02-18T21:02:21.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.555+0000 7fd1be7fc640 1 -- 10.20.193.68:0/3571138850 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b0037440 con 0x7fd1c0071d20 2026-02-18T21:02:21.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.555+0000 7fd1c5f2f640 1 -- 10.20.193.68:0/3571138850 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd1c0071d20 msgr2=0x7fd1c012de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:21.560 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.555+0000 7fd1c5f2f640 1 --2- 10.20.193.68:0/3571138850 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd1c0071d20 0x7fd1c012de00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0009970 tx=0x7fd1b002eef0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.555+0000 7fd1c5f2f640 1 -- 10.20.193.68:0/3571138850 shutdown_connections 2026-02-18T21:02:21.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.555+0000 7fd1c5f2f640 1 --2- 10.20.193.68:0/3571138850 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd1c0071d20 0x7fd1c012de00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.555+0000 7fd1c5f2f640 1 --2- 10.20.193.68:0/3571138850 >> v2:10.20.193.68:3300/0 conn(0x7fd1c0071400 0x7fd1c00717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.555+0000 7fd1c5f2f640 1 -- 10.20.193.68:0/3571138850 >> 10.20.193.68:0/3571138850 conn(0x7fd1c009cee0 msgr2=0x7fd1c009d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:21.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.555+0000 7fd1c5f2f640 1 -- 10.20.193.68:0/3571138850 shutdown_connections 2026-02-18T21:02:21.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.555+0000 7fd1c5f2f640 1 -- 10.20.193.68:0/3571138850 wait complete. 2026-02-18T21:02:21.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.555+0000 7fd1c5f2f640 1 Processor -- start 2026-02-18T21:02:21.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1c5f2f640 1 -- start start 2026-02-18T21:02:21.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1c5f2f640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd1c0071400 0x7fd1c01cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:21.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1c5f2f640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd1c0071d20 0x7fd1c01cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:21.561 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1c5f2f640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd1c012e340 0x7fd1c01cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:21.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1c5f2f640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c012e7c0 con 0x7fd1c0071400 2026-02-18T21:02:21.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1c5f2f640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fd1c0072140 con 0x7fd1c012e340 2026-02-18T21:02:21.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1c5f2f640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fd1c012e940 con 0x7fd1c0071d20 2026-02-18T21:02:21.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1bf7fe640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd1c0071400 0x7fd1c01cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:21.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1bf7fe640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd1c0071400 0x7fd1c01cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:38610/0 (socket says 10.20.193.68:38610) 2026-02-18T21:02:21.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1beffd640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd1c0071d20 0x7fd1c01cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:21.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1bf7fe640 1 -- 10.20.193.68:0/98337337 learned_addr learned my addr 10.20.193.68:0/98337337 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:21.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1bffff640 1 --2- 10.20.193.68:0/98337337 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd1c012e340 0x7fd1c01cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:21.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1bf7fe640 1 -- 10.20.193.68:0/98337337 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd1c0071d20 msgr2=0x7fd1c01cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:21.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1bf7fe640 1 --2- 10.20.193.68:0/98337337 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd1c0071d20 0x7fd1c01cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1bf7fe640 1 -- 10.20.193.68:0/98337337 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd1c012e340 msgr2=0x7fd1c01cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:21.562 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1bf7fe640 1 --2- 10.20.193.68:0/98337337 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd1c012e340 0x7fd1c01cc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.563 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1bf7fe640 1 -- 10.20.193.68:0/98337337 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c011a940 con 0x7fd1c0071400 2026-02-18T21:02:21.563 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1beffd640 1 --2- 10.20.193.68:0/98337337 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd1c0071d20 0x7fd1c01cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:21.563 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1bf7fe640 1 --2- 10.20.193.68:0/98337337 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd1c0071400 0x7fd1c01cb740 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00ebe0 tx=0x7fd1ac00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:21.563 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd19bfff640 1 -- 10.20.193.68:0/98337337 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac017070 con 0x7fd1c0071400 2026-02-18T21:02:21.563 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd19bfff640 1 -- 10.20.193.68:0/98337337 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1ac00cc40 con 0x7fd1c0071400 2026-02-18T21:02:21.563 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1c5f2f640 1 -- 10.20.193.68:0/98337337 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1c011a020 con 0x7fd1c0071400 2026-02-18T21:02:21.563 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd19bfff640 1 -- 10.20.193.68:0/98337337 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac013470 con 0x7fd1c0071400 2026-02-18T21:02:21.563 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.556+0000 7fd1c5f2f640 1 -- 10.20.193.68:0/98337337 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1c01259a0 con 0x7fd1c0071400 2026-02-18T21:02:21.563 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.557+0000 7fd1c5f2f640 1 -- 10.20.193.68:0/98337337 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1c00717e0 con 0x7fd1c0071400 2026-02-18T21:02:21.563 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.557+0000 7fd19bfff640 1 -- 10.20.193.68:0/98337337 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fd1ac024060 con 0x7fd1c0071400 2026-02-18T21:02:21.564 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.557+0000 7fd19bfff640 1 -- 10.20.193.68:0/98337337 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3021+0+0 (secure 0 0 0) 0x7fd1ac066b80 con 0x7fd1c0071400 2026-02-18T21:02:21.564 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.559+0000 7fd19bfff640 1 -- 10.20.193.68:0/98337337 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fd1ac0408e0 con 0x7fd1c0071400 2026-02-18T21:02:21.628 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.627+0000 7fd1c5f2f640 1 -- 10.20.193.68:0/98337337 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd1c0123d60 con 0x7fd1c0071400 2026-02-18T21:02:21.628 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.628+0000 7fd19bfff640 1 -- 10.20.193.68:0/98337337 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+9172 (secure 0 0 0) 0x7fd1ac065ba0 con 0x7fd1c0071400 2026-02-18T21:02:21.629 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:21.629 INFO:teuthology.orchestra.run.trial068.stdout:{"epoch":30,"fsid":"73558818-cfd1-494a-84aa-56d128598ef4","created":"2026-02-18T21:01:11.071818+0000","modified":"2026-02-18T21:02:21.032084+0000","last_up_change":"2026-02-18T21:02:20.031260+0000","last_in_change":"2026-02-18T21:01:11.803245+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"quincy","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-18T21:01:20.913845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-18T21:01:25.650381+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5f8e54-3a43-41d6-b266-aa412a7f170e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":26,"up_thru":26,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6800","nonce":2637053487}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6801","nonce":2637053487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6803","nonce":2637053487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6802","nonce":2637053487}]},"public_addr":"10.20.193.68:6800/2637053487","cluster_addr":"10.20.193.68:6801/2637053487","heartbeat_back_addr":"10.20.193.68:6803/2637053487","heartbeat_front_addr":"10.20.193.68:6802/2637053487","state":["exists","up"]},{"osd":1,"uuid":"e26d8762-250e-42e7-8768-23caa22edb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":27,"up_thru":27,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6804","nonce":4160428224}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6805","nonce":4160428224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6807","nonce":4160428224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6806","nonce":4160428224}]},"public_addr":"10.20.193.68:6804/4160428224","cluster_addr":"10.20.193.68:6805/4160428224","heartbeat_back_addr":"10.20.193.68:6807/4160428224","heartbeat_front_addr":"10.20.193.68:6806/4160428224","state":["exists","up"]},{"osd":2,"uuid":"568ee96d-39ac-4d79-92bb-d1f3f12601b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":28,"up_thru":29,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6808","nonce":3642986683}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6809","nonce":3642986683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6811","nonce":3642986683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6810","nonce":3642986683}]},"public_addr":"10.20.193.68:6808/3642986683","cluster_addr":"10.20.193.68:6809/3642986683","heartbeat_back_addr":"10.20.193.68:6811/3642986683","heartbeat_front_addr":"10.20.193.68:6810/3642986683","state":["exists","up"]},{"osd":3,"uuid":"765a38cd-f526-4aba-b94e-c57076ca6c72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":29,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6812","nonce":1687218919}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6813","nonce":1687218919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6815","nonce":1687218919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6814","nonce":1687218919}]},"public_addr":"10.20.193.68:6812/1687218919","cluster_addr":"10.20.193.68:6813/1687218919","heartbeat_back_addr":"10.20.193.68:6815/1687218919","heartbeat_front_addr":"10.20.193.68:6814/1687218919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.873205+0000","dead_epoch":21},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.929452+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.863830+0000","dead_epoch":23},{"osd":3,"down_stamp":"2026-02-18T21:02:12.008626+0000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.949895+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.68:0/991885778":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/4112610678":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/4267957295":"2026-02-19T21:02:04.994407+0000","10.20.193.68:6816/24610":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/3536457986":"2026-02-19T21:02:04.994407+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T21:02:21.630 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.629+0000 7fd1c5f2f640 1 -- 10.20.193.68:0/98337337 >> v1:10.20.193.68:6816/2904515774 conn(0x7fd19004f7c0 legacy=0x7fd190051c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:21.631 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.629+0000 7fd1c5f2f640 1 -- 10.20.193.68:0/98337337 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd1c0071400 msgr2=0x7fd1c01cb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:21.631 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.629+0000 7fd1c5f2f640 1 --2- 10.20.193.68:0/98337337 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd1c0071400 0x7fd1c01cb740 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00ebe0 tx=0x7fd1ac00c520 comp rx=0 tx=0).stop 2026-02-18T21:02:21.631 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.629+0000 7fd1c5f2f640 1 -- 10.20.193.68:0/98337337 shutdown_connections 2026-02-18T21:02:21.631 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.629+0000 7fd1c5f2f640 1 --2- 10.20.193.68:0/98337337 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fd1c012e340 0x7fd1c01cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.631 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.629+0000 7fd1c5f2f640 1 --2- 10.20.193.68:0/98337337 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fd1c0071d20 0x7fd1c01cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.631 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.629+0000 7fd1c5f2f640 1 --2- 10.20.193.68:0/98337337 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fd1c0071400 0x7fd1c01cb740 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.631 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.629+0000 7fd1c5f2f640 1 -- 10.20.193.68:0/98337337 >> 10.20.193.68:0/98337337 conn(0x7fd1c009cee0 msgr2=0x7fd1c006fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:21.631 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.629+0000 7fd1c5f2f640 1 -- 10.20.193.68:0/98337337 shutdown_connections 2026-02-18T21:02:21.631 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.629+0000 7fd1c5f2f640 1 -- 10.20.193.68:0/98337337 wait complete. 2026-02-18T21:02:21.637 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-18T21:02:21.637 INFO:teuthology.run_tasks:Running task exec... 2026-02-18T21:02:21.648 INFO:teuthology.task.exec:Executing custom commands... 2026-02-18T21:02:21.648 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@trial068.front.sepia.ceph.com 2026-02-18T21:02:21.648 DEBUG:teuthology.orchestra.run.trial068:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2026-02-18T21:02:21.719 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.714+0000 7f350fd42640 1 Processor -- start 2026-02-18T21:02:21.719 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.714+0000 7f350fd42640 1 -- start start 2026-02-18T21:02:21.719 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.714+0000 7f350fd42640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f35081311a0 0x7f3508133590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:21.719 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.714+0000 7f350fd42640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f3508133ad0 0x7f3508135ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:21.719 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.714+0000 7f350fd42640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f350806cb50 con 0x7f3508070af0 2026-02-18T21:02:21.719 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.714+0000 7f350fd42640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f350808e9a0 con 0x7f35081311a0 2026-02-18T21:02:21.720 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.714+0000 7f350fd42640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f350808f880 con 0x7f3508133ad0 2026-02-18T21:02:21.720 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.714+0000 7f350dab7640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f3508070af0 0x7f3508070ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:44642/0 (socket says 10.20.193.68:44642) 2026-02-18T21:02:21.720 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.714+0000 7f350dab7640 1 -- 10.20.193.68:0/499617663 learned_addr learned my addr 10.20.193.68:0/499617663 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:21.720 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.714+0000 7f350e2b8640 1 --2- 10.20.193.68:0/499617663 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f3508133ad0 0x7f3508135ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:21.720 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.714+0000 7f350d2b6640 1 --2- 10.20.193.68:0/499617663 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f35081311a0 0x7f3508133590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:21.720 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.715+0000 7f350cab5640 1 -- 10.20.193.68:0/499617663 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1596574543 0 0) 0x7f350806cb50 con 0x7f3508070af0 2026-02-18T21:02:21.720 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.715+0000 7f350e2b8640 1 -- 10.20.193.68:0/499617663 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f35081311a0 msgr2=0x7f3508133590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:21.720 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.715+0000 7f350e2b8640 1 --2- 10.20.193.68:0/499617663 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f35081311a0 0x7f3508133590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.720 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.715+0000 7f350e2b8640 1 -- 10.20.193.68:0/499617663 >> v1:10.20.193.68:6789/0 conn(0x7f3508070af0 legacy=0x7f3508070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:21.720 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.715+0000 7f350e2b8640 1 -- 10.20.193.68:0/499617663 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350808fab0 con 0x7f3508133ad0 2026-02-18T21:02:21.720 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.715+0000 7f350e2b8640 1 --2- 10.20.193.68:0/499617663 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f3508133ad0 0x7f3508135ec0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3504009dc0 tx=0x7f350402f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d87d8d0cd39686c server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:21.721 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.715+0000 7f350cab5640 1 -- 10.20.193.68:0/499617663 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350403c070 con 0x7f3508133ad0 2026-02-18T21:02:21.721 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.715+0000 7f350cab5640 1 -- 10.20.193.68:0/499617663 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3504037440 con 0x7f3508133ad0 2026-02-18T21:02:21.721 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.715+0000 7f350cab5640 1 -- 10.20.193.68:0/499617663 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3504037810 con 0x7f3508133ad0 2026-02-18T21:02:21.721 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.715+0000 7f350fd42640 1 -- 10.20.193.68:0/499617663 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f3508133ad0 msgr2=0x7f3508135ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:21.721 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.715+0000 7f350fd42640 1 --2- 10.20.193.68:0/499617663 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f3508133ad0 0x7f3508135ec0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3504009dc0 tx=0x7f350402f230 comp rx=0 tx=0).stop 2026-02-18T21:02:21.721 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350fd42640 1 -- 10.20.193.68:0/499617663 shutdown_connections 2026-02-18T21:02:21.721 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350fd42640 1 --2- 10.20.193.68:0/499617663 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f35081311a0 0x7f3508133590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.721 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350fd42640 1 --2- 10.20.193.68:0/499617663 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f3508133ad0 0x7f3508135ec0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.721 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350fd42640 1 -- 10.20.193.68:0/499617663 >> 10.20.193.68:0/499617663 conn(0x7f350809d6a0 msgr2=0x7f350809dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:21.721 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350fd42640 1 -- 10.20.193.68:0/499617663 shutdown_connections 2026-02-18T21:02:21.721 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350fd42640 1 -- 10.20.193.68:0/499617663 wait complete. 2026-02-18T21:02:21.721 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350fd42640 1 Processor -- start 2026-02-18T21:02:21.722 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350fd42640 1 -- start start 2026-02-18T21:02:21.722 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350fd42640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f3508070af0 0x7f350812d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:21.722 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350fd42640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f35081311a0 0x7f350812dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:21.722 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350fd42640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f3508133ad0 0x7f350812e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:21.722 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350fd42640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f350808e690 con 0x7f35081311a0 2026-02-18T21:02:21.722 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350fd42640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f35080717f0 con 0x7f3508070af0 2026-02-18T21:02:21.722 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350fd42640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f3508136400 con 0x7f3508133ad0 2026-02-18T21:02:21.722 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350dab7640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f3508070af0 0x7f350812d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:21.722 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350d2b6640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f35081311a0 0x7f350812dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:21.722 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350dab7640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f3508070af0 0x7f350812d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42198/0 (socket says 10.20.193.68:42198) 2026-02-18T21:02:21.722 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350dab7640 1 -- 10.20.193.68:0/1962340475 learned_addr learned my addr 10.20.193.68:0/1962340475 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:21.722 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350e2b8640 1 --2- 10.20.193.68:0/1962340475 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f3508133ad0 0x7f350812e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:21.723 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350dab7640 1 -- 10.20.193.68:0/1962340475 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f3508133ad0 msgr2=0x7f350812e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:21.723 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350dab7640 1 --2- 10.20.193.68:0/1962340475 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f3508133ad0 0x7f350812e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.723 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350dab7640 1 -- 10.20.193.68:0/1962340475 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f35081311a0 msgr2=0x7f350812dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:21.723 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.716+0000 7f350dab7640 1 --2- 10.20.193.68:0/1962340475 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f35081311a0 0x7f350812dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.723 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.717+0000 7f350dab7640 1 -- 10.20.193.68:0/1962340475 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3508127e90 con 0x7f3508070af0 2026-02-18T21:02:21.723 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.717+0000 7f350dab7640 1 --2- 10.20.193.68:0/1962340475 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f3508070af0 0x7f350812d840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f34f800c540 tx=0x7f34f800ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:21.723 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.717+0000 7f34f67fc640 1 -- 10.20.193.68:0/1962340475 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f8018070 con 0x7f3508070af0 2026-02-18T21:02:21.723 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.717+0000 7f34f67fc640 1 -- 10.20.193.68:0/1962340475 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f8004d10 con 0x7f3508070af0 2026-02-18T21:02:21.723 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.717+0000 7f350fd42640 1 -- 10.20.193.68:0/1962340475 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3508073670 con 0x7f3508070af0 2026-02-18T21:02:21.723 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.717+0000 7f34f67fc640 1 -- 10.20.193.68:0/1962340475 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f8007310 con 0x7f3508070af0 2026-02-18T21:02:21.723 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.717+0000 7f350fd42640 1 -- 10.20.193.68:0/1962340475 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f35081c7520 con 0x7f3508070af0 2026-02-18T21:02:21.723 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.717+0000 7f350fd42640 1 -- 10.20.193.68:0/1962340475 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3508070ed0 con 0x7f3508070af0 2026-02-18T21:02:21.724 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.718+0000 7f34f67fc640 1 -- 10.20.193.68:0/1962340475 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f34f80074b0 con 0x7f3508070af0 2026-02-18T21:02:21.724 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.718+0000 7f34f67fc640 1 -- 10.20.193.68:0/1962340475 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3021+0+0 (secure 0 0 0) 0x7f34f8066330 con 0x7f3508070af0 2026-02-18T21:02:21.724 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.720+0000 7f34f67fc640 1 -- 10.20.193.68:0/1962340475 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f34f80401b0 con 0x7f3508070af0 2026-02-18T21:02:21.815 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.815+0000 7f350fd42640 1 -- 10.20.193.68:0/1962340475 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f350809be30 con 0x7f3508070af0 2026-02-18T21:02:21.815 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.815+0000 7f34f67fc640 1 -- 10.20.193.68:0/1962340475 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+507 (secure 0 0 0) 0x7f34f8065350 con 0x7f3508070af0 2026-02-18T21:02:21.816 INFO:teuthology.orchestra.run.trial068.stdout:{ 2026-02-18T21:02:21.816 INFO:teuthology.orchestra.run.trial068.stdout: "mon": { 2026-02-18T21:02:21.816 INFO:teuthology.orchestra.run.trial068.stdout: "ceph version 19.2.3-689-g5c7d9533 (5c7d9533eb2b3fdb031dd48c8022c4d967a9a910) squid (stable)": 3 2026-02-18T21:02:21.816 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.816 INFO:teuthology.orchestra.run.trial068.stdout: "mgr": { 2026-02-18T21:02:21.816 INFO:teuthology.orchestra.run.trial068.stdout: "ceph version 19.2.3-689-g5c7d9533 (5c7d9533eb2b3fdb031dd48c8022c4d967a9a910) squid (stable)": 2 2026-02-18T21:02:21.816 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.816 INFO:teuthology.orchestra.run.trial068.stdout: "osd": { 2026-02-18T21:02:21.816 INFO:teuthology.orchestra.run.trial068.stdout: "ceph version 19.2.3-689-g5c7d9533 (5c7d9533eb2b3fdb031dd48c8022c4d967a9a910) squid (stable)": 4 2026-02-18T21:02:21.817 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.817 INFO:teuthology.orchestra.run.trial068.stdout: "overall": { 2026-02-18T21:02:21.817 INFO:teuthology.orchestra.run.trial068.stdout: "ceph version 19.2.3-689-g5c7d9533 (5c7d9533eb2b3fdb031dd48c8022c4d967a9a910) squid (stable)": 9 2026-02-18T21:02:21.817 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.817 INFO:teuthology.orchestra.run.trial068.stdout:} 2026-02-18T21:02:21.818 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.816+0000 7f350fd42640 1 -- 10.20.193.68:0/1962340475 >> v1:10.20.193.68:6816/2904515774 conn(0x7f34d804f790 legacy=0x7f34d8051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:21.818 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.816+0000 7f350fd42640 1 -- 10.20.193.68:0/1962340475 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f3508070af0 msgr2=0x7f350812d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:21.818 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.816+0000 7f350fd42640 1 --2- 10.20.193.68:0/1962340475 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f3508070af0 0x7f350812d840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f34f800c540 tx=0x7f34f800ca10 comp rx=0 tx=0).stop 2026-02-18T21:02:21.818 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.816+0000 7f350fd42640 1 -- 10.20.193.68:0/1962340475 shutdown_connections 2026-02-18T21:02:21.818 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.816+0000 7f350fd42640 1 --2- 10.20.193.68:0/1962340475 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f3508133ad0 0x7f350812e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.818 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.816+0000 7f350fd42640 1 --2- 10.20.193.68:0/1962340475 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f35081311a0 0x7f350812dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.819 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.816+0000 7f350fd42640 1 --2- 10.20.193.68:0/1962340475 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f3508070af0 0x7f350812d840 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.819 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.816+0000 7f350fd42640 1 -- 10.20.193.68:0/1962340475 >> 10.20.193.68:0/1962340475 conn(0x7f350809d6a0 msgr2=0x7f3508131f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:21.819 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.816+0000 7f350fd42640 1 -- 10.20.193.68:0/1962340475 shutdown_connections 2026-02-18T21:02:21.819 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.816+0000 7f350fd42640 1 -- 10.20.193.68:0/1962340475 wait complete. 2026-02-18T21:02:21.824 DEBUG:teuthology.orchestra.run.trial068:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2026-02-18T21:02:21.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.888+0000 7f4d00a0e640 1 Processor -- start 2026-02-18T21:02:21.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.888+0000 7f4d00a0e640 1 -- start start 2026-02-18T21:02:21.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.888+0000 7f4d00a0e640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4cfc070880 0x7f4cfc070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:21.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.888+0000 7f4d00a0e640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f4cfc0711a0 0x7f4cfc134800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:21.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.888+0000 7f4d00a0e640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4cfc134d40 0x7f4cfc137130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:21.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.888+0000 7f4d00a0e640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f4cfc073d70 con 0x7f4cfc0711a0 2026-02-18T21:02:21.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.888+0000 7f4d00a0e640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f4cfc09c3c0 con 0x7f4cfc134d40 2026-02-18T21:02:21.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.888+0000 7f4d00a0e640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f4cfc0737a0 con 0x7f4cfc070880 2026-02-18T21:02:21.893 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.888+0000 7f4cfa575640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4cfc070880 0x7f4cfc070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:21.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.888+0000 7f4cfa575640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4cfc070880 0x7f4cfc070c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60434/0 (socket says 10.20.193.68:60434) 2026-02-18T21:02:21.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.888+0000 7f4cfa575640 1 -- 10.20.193.68:0/920995311 learned_addr learned my addr 10.20.193.68:0/920995311 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:21.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.888+0000 7f4cfad76640 1 --2- 10.20.193.68:0/920995311 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4cfc134d40 0x7f4cfc137130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:21.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.888+0000 7f4cf9d74640 1 --2- 10.20.193.68:0/920995311 >> v2:10.20.193.68:3300/0 conn(0x7f4cfc0711a0 0x7f4cfc134800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:21.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.888+0000 7f4cfa575640 1 -- 10.20.193.68:0/920995311 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4cfc134d40 msgr2=0x7f4cfc137130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:21.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.888+0000 7f4cfa575640 1 --2- 10.20.193.68:0/920995311 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4cfc134d40 0x7f4cfc137130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.888+0000 7f4cfa575640 1 -- 10.20.193.68:0/920995311 >> v2:10.20.193.68:3300/0 conn(0x7f4cfc0711a0 msgr2=0x7f4cfc134800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:21.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.888+0000 7f4cfa575640 1 --2- 10.20.193.68:0/920995311 >> v2:10.20.193.68:3300/0 conn(0x7f4cfc0711a0 0x7f4cfc134800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.888+0000 7f4cfa575640 1 -- 10.20.193.68:0/920995311 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cfc071e90 con 0x7f4cfc070880 2026-02-18T21:02:21.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.888+0000 7f4cf9d74640 1 --2- 10.20.193.68:0/920995311 >> v2:10.20.193.68:3300/0 conn(0x7f4cfc0711a0 0x7f4cfc134800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-18T21:02:21.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.889+0000 7f4cfa575640 1 --2- 10.20.193.68:0/920995311 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4cfc070880 0x7f4cfc070c60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009970 tx=0x7f4cf002eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=227360b5ffd7bd3f server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:21.894 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.889+0000 7f4cf9573640 1 -- 10.20.193.68:0/920995311 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf003c070 con 0x7f4cfc070880 2026-02-18T21:02:21.895 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.889+0000 7f4cf9573640 1 -- 10.20.193.68:0/920995311 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf002fb60 con 0x7f4cfc070880 2026-02-18T21:02:21.895 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.889+0000 7f4cf9573640 1 -- 10.20.193.68:0/920995311 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0037440 con 0x7f4cfc070880 2026-02-18T21:02:21.895 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.889+0000 7f4d00a0e640 1 -- 10.20.193.68:0/920995311 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4cfc070880 msgr2=0x7f4cfc070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:21.895 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.889+0000 7f4d00a0e640 1 --2- 10.20.193.68:0/920995311 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4cfc070880 0x7f4cfc070c60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0009970 tx=0x7f4cf002eef0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.895 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.889+0000 7f4d00a0e640 1 -- 10.20.193.68:0/920995311 shutdown_connections 2026-02-18T21:02:21.895 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.889+0000 7f4d00a0e640 1 --2- 10.20.193.68:0/920995311 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4cfc134d40 0x7f4cfc137130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.895 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.889+0000 7f4d00a0e640 1 --2- 10.20.193.68:0/920995311 >> v2:10.20.193.68:3300/0 conn(0x7f4cfc0711a0 0x7f4cfc134800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.895 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.889+0000 7f4d00a0e640 1 --2- 10.20.193.68:0/920995311 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4cfc070880 0x7f4cfc070c60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.895 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.889+0000 7f4d00a0e640 1 -- 10.20.193.68:0/920995311 >> 10.20.193.68:0/920995311 conn(0x7f4cfc09d6a0 msgr2=0x7f4cfc09dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:21.895 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.889+0000 7f4d00a0e640 1 -- 10.20.193.68:0/920995311 shutdown_connections 2026-02-18T21:02:21.895 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.889+0000 7f4d00a0e640 1 -- 10.20.193.68:0/920995311 wait complete. 2026-02-18T21:02:21.895 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4d00a0e640 1 Processor -- start 2026-02-18T21:02:21.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4d00a0e640 1 -- start start 2026-02-18T21:02:21.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4d00a0e640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4cfc070880 0x7f4cfc1c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:21.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4d00a0e640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4cfc0711a0 0x7f4cfc1c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:21.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4d00a0e640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4cfc134d40 0x7f4cfc123710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:21.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4d00a0e640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc072e90 con 0x7f4cfc070880 2026-02-18T21:02:21.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4d00a0e640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f4cfc072590 con 0x7f4cfc0711a0 2026-02-18T21:02:21.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4d00a0e640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f4cfc073010 con 0x7f4cfc134d40 2026-02-18T21:02:21.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4cf9d74640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4cfc0711a0 0x7f4cfc1c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:21.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4cf9d74640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4cfc0711a0 0x7f4cfc1c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42222/0 (socket says 10.20.193.68:42222) 2026-02-18T21:02:21.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4cf9d74640 1 -- 10.20.193.68:0/278733339 learned_addr learned my addr 10.20.193.68:0/278733339 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:21.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4cfa575640 1 --2- 10.20.193.68:0/278733339 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4cfc070880 0x7f4cfc1c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:21.896 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4cfad76640 1 --2- 10.20.193.68:0/278733339 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4cfc134d40 0x7f4cfc123710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:21.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4cfad76640 1 -- 10.20.193.68:0/278733339 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4cfc0711a0 msgr2=0x7f4cfc1c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:21.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4cfad76640 1 --2- 10.20.193.68:0/278733339 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4cfc0711a0 0x7f4cfc1c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4cfad76640 1 -- 10.20.193.68:0/278733339 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4cfc070880 msgr2=0x7f4cfc1c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:21.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4cfad76640 1 --2- 10.20.193.68:0/278733339 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4cfc070880 0x7f4cfc1c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:21.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4cfad76640 1 -- 10.20.193.68:0/278733339 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cfc1257a0 con 0x7f4cfc134d40 2026-02-18T21:02:21.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4cf9d74640 1 --2- 10.20.193.68:0/278733339 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4cfc0711a0 0x7f4cfc1c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:21.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4cfa575640 1 --2- 10.20.193.68:0/278733339 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4cfc070880 0x7f4cfc1c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:21.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4cfad76640 1 --2- 10.20.193.68:0/278733339 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4cfc134d40 0x7f4cfc123710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4cec007d90 tx=0x7f4cec00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:21.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4ce2ffd640 1 -- 10.20.193.68:0/278733339 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cec00ede0 con 0x7f4cfc134d40 2026-02-18T21:02:21.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4ce2ffd640 1 -- 10.20.193.68:0/278733339 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cec003a90 con 0x7f4cfc134d40 2026-02-18T21:02:21.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4d00a0e640 1 -- 10.20.193.68:0/278733339 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cfc074270 con 0x7f4cfc134d40 2026-02-18T21:02:21.897 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.890+0000 7f4ce2ffd640 1 -- 10.20.193.68:0/278733339 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cec004020 con 0x7f4cfc134d40 2026-02-18T21:02:21.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.891+0000 7f4d00a0e640 1 -- 10.20.193.68:0/278733339 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cfc1261e0 con 0x7f4cfc134d40 2026-02-18T21:02:21.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.891+0000 7f4d00a0e640 1 -- 10.20.193.68:0/278733339 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cfc126440 con 0x7f4cfc134d40 2026-02-18T21:02:21.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.891+0000 7f4ce2ffd640 1 -- 10.20.193.68:0/278733339 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f4cec0041c0 con 0x7f4cfc134d40 2026-02-18T21:02:21.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.892+0000 7f4ce2ffd640 1 -- 10.20.193.68:0/278733339 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(30..30 src has 1..30) ==== 3021+0+0 (secure 0 0 0) 0x7f4cec066e80 con 0x7f4cfc134d40 2026-02-18T21:02:21.898 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.894+0000 7f4ce2ffd640 1 -- 10.20.193.68:0/278733339 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f4cec040be0 con 0x7f4cfc134d40 2026-02-18T21:02:21.963 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.963+0000 7f4d00a0e640 1 -- 10.20.193.68:0/278733339 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f4cfc070c60 con 0x7f4cfc134d40 2026-02-18T21:02:21.964 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.963+0000 7f4ce2ffd640 1 -- 10.20.193.68:0/278733339 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v30) ==== 81+0+16836 (secure 0 0 0) 0x7f4cec065ea0 con 0x7f4cfc134d40 2026-02-18T21:02:21.964 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:21.964 INFO:teuthology.orchestra.run.trial068.stdout:{ 2026-02-18T21:02:21.964 INFO:teuthology.orchestra.run.trial068.stdout: "epoch": 30, 2026-02-18T21:02:21.964 INFO:teuthology.orchestra.run.trial068.stdout: "fsid": "73558818-cfd1-494a-84aa-56d128598ef4", 2026-02-18T21:02:21.965 INFO:teuthology.orchestra.run.trial068.stdout: "created": "2026-02-18T21:01:11.071818+0000", 2026-02-18T21:02:21.965 INFO:teuthology.orchestra.run.trial068.stdout: "modified": "2026-02-18T21:02:21.032084+0000", 2026-02-18T21:02:21.965 INFO:teuthology.orchestra.run.trial068.stdout: "last_up_change": "2026-02-18T21:02:20.031260+0000", 2026-02-18T21:02:21.965 INFO:teuthology.orchestra.run.trial068.stdout: "last_in_change": "2026-02-18T21:01:11.803245+0000", 2026-02-18T21:02:21.965 INFO:teuthology.orchestra.run.trial068.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-18T21:02:21.965 INFO:teuthology.orchestra.run.trial068.stdout: "flags_num": 5799936, 2026-02-18T21:02:21.965 INFO:teuthology.orchestra.run.trial068.stdout: "flags_set": [ 2026-02-18T21:02:21.965 INFO:teuthology.orchestra.run.trial068.stdout: "pglog_hardlimit", 2026-02-18T21:02:21.965 INFO:teuthology.orchestra.run.trial068.stdout: "purged_snapdirs", 2026-02-18T21:02:21.965 INFO:teuthology.orchestra.run.trial068.stdout: "recovery_deletes", 2026-02-18T21:02:21.965 INFO:teuthology.orchestra.run.trial068.stdout: "sortbitwise" 2026-02-18T21:02:21.965 INFO:teuthology.orchestra.run.trial068.stdout: ], 2026-02-18T21:02:21.966 INFO:teuthology.orchestra.run.trial068.stdout: "crush_version": 8, 2026-02-18T21:02:21.966 INFO:teuthology.orchestra.run.trial068.stdout: "full_ratio": 0.94999998807907104, 2026-02-18T21:02:21.966 INFO:teuthology.orchestra.run.trial068.stdout: "backfillfull_ratio": 0.89999997615814209, 2026-02-18T21:02:21.966 INFO:teuthology.orchestra.run.trial068.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-18T21:02:21.966 INFO:teuthology.orchestra.run.trial068.stdout: "cluster_snapshot": "", 2026-02-18T21:02:21.966 INFO:teuthology.orchestra.run.trial068.stdout: "pool_max": 2, 2026-02-18T21:02:21.966 INFO:teuthology.orchestra.run.trial068.stdout: "max_osd": 4, 2026-02-18T21:02:21.966 INFO:teuthology.orchestra.run.trial068.stdout: "require_min_compat_client": "quincy", 2026-02-18T21:02:21.966 INFO:teuthology.orchestra.run.trial068.stdout: "min_compat_client": "jewel", 2026-02-18T21:02:21.966 INFO:teuthology.orchestra.run.trial068.stdout: "require_osd_release": "quincy", 2026-02-18T21:02:21.966 INFO:teuthology.orchestra.run.trial068.stdout: "allow_crimson": false, 2026-02-18T21:02:21.966 INFO:teuthology.orchestra.run.trial068.stdout: "pools": [ 2026-02-18T21:02:21.967 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.967 INFO:teuthology.orchestra.run.trial068.stdout: "pool": 1, 2026-02-18T21:02:21.967 INFO:teuthology.orchestra.run.trial068.stdout: "pool_name": ".mgr", 2026-02-18T21:02:21.967 INFO:teuthology.orchestra.run.trial068.stdout: "create_time": "2026-02-18T21:01:20.913845+0000", 2026-02-18T21:02:21.967 INFO:teuthology.orchestra.run.trial068.stdout: "flags": 1, 2026-02-18T21:02:21.967 INFO:teuthology.orchestra.run.trial068.stdout: "flags_names": "hashpspool", 2026-02-18T21:02:21.967 INFO:teuthology.orchestra.run.trial068.stdout: "type": 1, 2026-02-18T21:02:21.967 INFO:teuthology.orchestra.run.trial068.stdout: "size": 2, 2026-02-18T21:02:21.967 INFO:teuthology.orchestra.run.trial068.stdout: "min_size": 1, 2026-02-18T21:02:21.967 INFO:teuthology.orchestra.run.trial068.stdout: "crush_rule": 0, 2026-02-18T21:02:21.967 INFO:teuthology.orchestra.run.trial068.stdout: "peering_crush_bucket_count": 0, 2026-02-18T21:02:21.967 INFO:teuthology.orchestra.run.trial068.stdout: "peering_crush_bucket_target": 0, 2026-02-18T21:02:21.968 INFO:teuthology.orchestra.run.trial068.stdout: "peering_crush_bucket_barrier": 0, 2026-02-18T21:02:21.968 INFO:teuthology.orchestra.run.trial068.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-18T21:02:21.968 INFO:teuthology.orchestra.run.trial068.stdout: "is_stretch_pool": false, 2026-02-18T21:02:21.968 INFO:teuthology.orchestra.run.trial068.stdout: "object_hash": 2, 2026-02-18T21:02:21.968 INFO:teuthology.orchestra.run.trial068.stdout: "pg_autoscale_mode": "off", 2026-02-18T21:02:21.968 INFO:teuthology.orchestra.run.trial068.stdout: "pg_num": 1, 2026-02-18T21:02:21.968 INFO:teuthology.orchestra.run.trial068.stdout: "pg_placement_num": 1, 2026-02-18T21:02:21.968 INFO:teuthology.orchestra.run.trial068.stdout: "pg_placement_num_target": 1, 2026-02-18T21:02:21.968 INFO:teuthology.orchestra.run.trial068.stdout: "pg_num_target": 1, 2026-02-18T21:02:21.968 INFO:teuthology.orchestra.run.trial068.stdout: "pg_num_pending": 1, 2026-02-18T21:02:21.968 INFO:teuthology.orchestra.run.trial068.stdout: "last_pg_merge_meta": { 2026-02-18T21:02:21.968 INFO:teuthology.orchestra.run.trial068.stdout: "source_pgid": "0.0", 2026-02-18T21:02:21.968 INFO:teuthology.orchestra.run.trial068.stdout: "ready_epoch": 0, 2026-02-18T21:02:21.969 INFO:teuthology.orchestra.run.trial068.stdout: "last_epoch_started": 0, 2026-02-18T21:02:21.969 INFO:teuthology.orchestra.run.trial068.stdout: "last_epoch_clean": 0, 2026-02-18T21:02:21.969 INFO:teuthology.orchestra.run.trial068.stdout: "source_version": "0'0", 2026-02-18T21:02:21.969 INFO:teuthology.orchestra.run.trial068.stdout: "target_version": "0'0" 2026-02-18T21:02:21.969 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.969 INFO:teuthology.orchestra.run.trial068.stdout: "last_change": "12", 2026-02-18T21:02:21.969 INFO:teuthology.orchestra.run.trial068.stdout: "last_force_op_resend": "0", 2026-02-18T21:02:21.969 INFO:teuthology.orchestra.run.trial068.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-18T21:02:21.969 INFO:teuthology.orchestra.run.trial068.stdout: "last_force_op_resend_preluminous": "0", 2026-02-18T21:02:21.969 INFO:teuthology.orchestra.run.trial068.stdout: "auid": 0, 2026-02-18T21:02:21.969 INFO:teuthology.orchestra.run.trial068.stdout: "snap_mode": "selfmanaged", 2026-02-18T21:02:21.969 INFO:teuthology.orchestra.run.trial068.stdout: "snap_seq": 0, 2026-02-18T21:02:21.969 INFO:teuthology.orchestra.run.trial068.stdout: "snap_epoch": 0, 2026-02-18T21:02:21.970 INFO:teuthology.orchestra.run.trial068.stdout: "pool_snaps": [], 2026-02-18T21:02:21.970 INFO:teuthology.orchestra.run.trial068.stdout: "removed_snaps": "[]", 2026-02-18T21:02:21.970 INFO:teuthology.orchestra.run.trial068.stdout: "quota_max_bytes": 0, 2026-02-18T21:02:21.970 INFO:teuthology.orchestra.run.trial068.stdout: "quota_max_objects": 0, 2026-02-18T21:02:21.970 INFO:teuthology.orchestra.run.trial068.stdout: "tiers": [], 2026-02-18T21:02:21.970 INFO:teuthology.orchestra.run.trial068.stdout: "tier_of": -1, 2026-02-18T21:02:21.970 INFO:teuthology.orchestra.run.trial068.stdout: "read_tier": -1, 2026-02-18T21:02:21.970 INFO:teuthology.orchestra.run.trial068.stdout: "write_tier": -1, 2026-02-18T21:02:21.970 INFO:teuthology.orchestra.run.trial068.stdout: "cache_mode": "none", 2026-02-18T21:02:21.970 INFO:teuthology.orchestra.run.trial068.stdout: "target_max_bytes": 0, 2026-02-18T21:02:21.970 INFO:teuthology.orchestra.run.trial068.stdout: "target_max_objects": 0, 2026-02-18T21:02:21.970 INFO:teuthology.orchestra.run.trial068.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-18T21:02:21.970 INFO:teuthology.orchestra.run.trial068.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-18T21:02:21.971 INFO:teuthology.orchestra.run.trial068.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-18T21:02:21.971 INFO:teuthology.orchestra.run.trial068.stdout: "cache_min_flush_age": 0, 2026-02-18T21:02:21.971 INFO:teuthology.orchestra.run.trial068.stdout: "cache_min_evict_age": 0, 2026-02-18T21:02:21.971 INFO:teuthology.orchestra.run.trial068.stdout: "erasure_code_profile": "", 2026-02-18T21:02:21.971 INFO:teuthology.orchestra.run.trial068.stdout: "hit_set_params": { 2026-02-18T21:02:21.971 INFO:teuthology.orchestra.run.trial068.stdout: "type": "none" 2026-02-18T21:02:21.971 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.971 INFO:teuthology.orchestra.run.trial068.stdout: "hit_set_period": 0, 2026-02-18T21:02:21.971 INFO:teuthology.orchestra.run.trial068.stdout: "hit_set_count": 0, 2026-02-18T21:02:21.971 INFO:teuthology.orchestra.run.trial068.stdout: "use_gmt_hitset": true, 2026-02-18T21:02:21.971 INFO:teuthology.orchestra.run.trial068.stdout: "min_read_recency_for_promote": 0, 2026-02-18T21:02:21.971 INFO:teuthology.orchestra.run.trial068.stdout: "min_write_recency_for_promote": 0, 2026-02-18T21:02:21.971 INFO:teuthology.orchestra.run.trial068.stdout: "hit_set_grade_decay_rate": 0, 2026-02-18T21:02:21.972 INFO:teuthology.orchestra.run.trial068.stdout: "hit_set_search_last_n": 0, 2026-02-18T21:02:21.972 INFO:teuthology.orchestra.run.trial068.stdout: "grade_table": [], 2026-02-18T21:02:21.972 INFO:teuthology.orchestra.run.trial068.stdout: "stripe_width": 0, 2026-02-18T21:02:21.972 INFO:teuthology.orchestra.run.trial068.stdout: "expected_num_objects": 0, 2026-02-18T21:02:21.972 INFO:teuthology.orchestra.run.trial068.stdout: "fast_read": false, 2026-02-18T21:02:21.972 INFO:teuthology.orchestra.run.trial068.stdout: "options": { 2026-02-18T21:02:21.972 INFO:teuthology.orchestra.run.trial068.stdout: "pg_num_max": 32, 2026-02-18T21:02:21.972 INFO:teuthology.orchestra.run.trial068.stdout: "pg_num_min": 1 2026-02-18T21:02:21.972 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.972 INFO:teuthology.orchestra.run.trial068.stdout: "application_metadata": { 2026-02-18T21:02:21.972 INFO:teuthology.orchestra.run.trial068.stdout: "mgr": {} 2026-02-18T21:02:21.972 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.972 INFO:teuthology.orchestra.run.trial068.stdout: "read_balance": { 2026-02-18T21:02:21.973 INFO:teuthology.orchestra.run.trial068.stdout: "score_type": "Fair distribution", 2026-02-18T21:02:21.973 INFO:teuthology.orchestra.run.trial068.stdout: "score_acting": 4, 2026-02-18T21:02:21.973 INFO:teuthology.orchestra.run.trial068.stdout: "score_stable": 4, 2026-02-18T21:02:21.973 INFO:teuthology.orchestra.run.trial068.stdout: "optimal_score": 0.5, 2026-02-18T21:02:21.973 INFO:teuthology.orchestra.run.trial068.stdout: "raw_score_acting": 2, 2026-02-18T21:02:21.973 INFO:teuthology.orchestra.run.trial068.stdout: "raw_score_stable": 2, 2026-02-18T21:02:21.973 INFO:teuthology.orchestra.run.trial068.stdout: "primary_affinity_weighted": 1, 2026-02-18T21:02:21.973 INFO:teuthology.orchestra.run.trial068.stdout: "average_primary_affinity": 1, 2026-02-18T21:02:21.973 INFO:teuthology.orchestra.run.trial068.stdout: "average_primary_affinity_weighted": 1 2026-02-18T21:02:21.973 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.973 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.973 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.973 INFO:teuthology.orchestra.run.trial068.stdout: "pool": 2, 2026-02-18T21:02:21.974 INFO:teuthology.orchestra.run.trial068.stdout: "pool_name": "rbd", 2026-02-18T21:02:21.974 INFO:teuthology.orchestra.run.trial068.stdout: "create_time": "2026-02-18T21:01:25.650381+0000", 2026-02-18T21:02:21.974 INFO:teuthology.orchestra.run.trial068.stdout: "flags": 8193, 2026-02-18T21:02:21.974 INFO:teuthology.orchestra.run.trial068.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2026-02-18T21:02:21.974 INFO:teuthology.orchestra.run.trial068.stdout: "type": 1, 2026-02-18T21:02:21.974 INFO:teuthology.orchestra.run.trial068.stdout: "size": 2, 2026-02-18T21:02:21.974 INFO:teuthology.orchestra.run.trial068.stdout: "min_size": 1, 2026-02-18T21:02:21.974 INFO:teuthology.orchestra.run.trial068.stdout: "crush_rule": 0, 2026-02-18T21:02:21.974 INFO:teuthology.orchestra.run.trial068.stdout: "peering_crush_bucket_count": 0, 2026-02-18T21:02:21.974 INFO:teuthology.orchestra.run.trial068.stdout: "peering_crush_bucket_target": 0, 2026-02-18T21:02:21.974 INFO:teuthology.orchestra.run.trial068.stdout: "peering_crush_bucket_barrier": 0, 2026-02-18T21:02:21.974 INFO:teuthology.orchestra.run.trial068.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-18T21:02:21.974 INFO:teuthology.orchestra.run.trial068.stdout: "is_stretch_pool": false, 2026-02-18T21:02:21.975 INFO:teuthology.orchestra.run.trial068.stdout: "object_hash": 2, 2026-02-18T21:02:21.975 INFO:teuthology.orchestra.run.trial068.stdout: "pg_autoscale_mode": "off", 2026-02-18T21:02:21.975 INFO:teuthology.orchestra.run.trial068.stdout: "pg_num": 8, 2026-02-18T21:02:21.975 INFO:teuthology.orchestra.run.trial068.stdout: "pg_placement_num": 8, 2026-02-18T21:02:21.975 INFO:teuthology.orchestra.run.trial068.stdout: "pg_placement_num_target": 8, 2026-02-18T21:02:21.975 INFO:teuthology.orchestra.run.trial068.stdout: "pg_num_target": 8, 2026-02-18T21:02:21.975 INFO:teuthology.orchestra.run.trial068.stdout: "pg_num_pending": 8, 2026-02-18T21:02:21.975 INFO:teuthology.orchestra.run.trial068.stdout: "last_pg_merge_meta": { 2026-02-18T21:02:21.975 INFO:teuthology.orchestra.run.trial068.stdout: "source_pgid": "0.0", 2026-02-18T21:02:21.975 INFO:teuthology.orchestra.run.trial068.stdout: "ready_epoch": 0, 2026-02-18T21:02:21.975 INFO:teuthology.orchestra.run.trial068.stdout: "last_epoch_started": 0, 2026-02-18T21:02:21.975 INFO:teuthology.orchestra.run.trial068.stdout: "last_epoch_clean": 0, 2026-02-18T21:02:21.976 INFO:teuthology.orchestra.run.trial068.stdout: "source_version": "0'0", 2026-02-18T21:02:21.976 INFO:teuthology.orchestra.run.trial068.stdout: "target_version": "0'0" 2026-02-18T21:02:21.976 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.976 INFO:teuthology.orchestra.run.trial068.stdout: "last_change": "16", 2026-02-18T21:02:21.976 INFO:teuthology.orchestra.run.trial068.stdout: "last_force_op_resend": "0", 2026-02-18T21:02:21.976 INFO:teuthology.orchestra.run.trial068.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-18T21:02:21.976 INFO:teuthology.orchestra.run.trial068.stdout: "last_force_op_resend_preluminous": "0", 2026-02-18T21:02:21.976 INFO:teuthology.orchestra.run.trial068.stdout: "auid": 0, 2026-02-18T21:02:21.976 INFO:teuthology.orchestra.run.trial068.stdout: "snap_mode": "selfmanaged", 2026-02-18T21:02:21.976 INFO:teuthology.orchestra.run.trial068.stdout: "snap_seq": 3, 2026-02-18T21:02:21.976 INFO:teuthology.orchestra.run.trial068.stdout: "snap_epoch": 16, 2026-02-18T21:02:21.977 INFO:teuthology.orchestra.run.trial068.stdout: "pool_snaps": [], 2026-02-18T21:02:21.977 INFO:teuthology.orchestra.run.trial068.stdout: "removed_snaps": "[]", 2026-02-18T21:02:21.977 INFO:teuthology.orchestra.run.trial068.stdout: "quota_max_bytes": 0, 2026-02-18T21:02:21.977 INFO:teuthology.orchestra.run.trial068.stdout: "quota_max_objects": 0, 2026-02-18T21:02:21.977 INFO:teuthology.orchestra.run.trial068.stdout: "tiers": [], 2026-02-18T21:02:21.977 INFO:teuthology.orchestra.run.trial068.stdout: "tier_of": -1, 2026-02-18T21:02:21.977 INFO:teuthology.orchestra.run.trial068.stdout: "read_tier": -1, 2026-02-18T21:02:21.977 INFO:teuthology.orchestra.run.trial068.stdout: "write_tier": -1, 2026-02-18T21:02:21.977 INFO:teuthology.orchestra.run.trial068.stdout: "cache_mode": "none", 2026-02-18T21:02:21.977 INFO:teuthology.orchestra.run.trial068.stdout: "target_max_bytes": 0, 2026-02-18T21:02:21.977 INFO:teuthology.orchestra.run.trial068.stdout: "target_max_objects": 0, 2026-02-18T21:02:21.977 INFO:teuthology.orchestra.run.trial068.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-18T21:02:21.977 INFO:teuthology.orchestra.run.trial068.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-18T21:02:21.978 INFO:teuthology.orchestra.run.trial068.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-18T21:02:21.978 INFO:teuthology.orchestra.run.trial068.stdout: "cache_min_flush_age": 0, 2026-02-18T21:02:21.978 INFO:teuthology.orchestra.run.trial068.stdout: "cache_min_evict_age": 0, 2026-02-18T21:02:21.978 INFO:teuthology.orchestra.run.trial068.stdout: "erasure_code_profile": "", 2026-02-18T21:02:21.978 INFO:teuthology.orchestra.run.trial068.stdout: "hit_set_params": { 2026-02-18T21:02:21.978 INFO:teuthology.orchestra.run.trial068.stdout: "type": "none" 2026-02-18T21:02:21.978 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.978 INFO:teuthology.orchestra.run.trial068.stdout: "hit_set_period": 0, 2026-02-18T21:02:21.978 INFO:teuthology.orchestra.run.trial068.stdout: "hit_set_count": 0, 2026-02-18T21:02:21.978 INFO:teuthology.orchestra.run.trial068.stdout: "use_gmt_hitset": true, 2026-02-18T21:02:21.978 INFO:teuthology.orchestra.run.trial068.stdout: "min_read_recency_for_promote": 0, 2026-02-18T21:02:21.978 INFO:teuthology.orchestra.run.trial068.stdout: "min_write_recency_for_promote": 0, 2026-02-18T21:02:21.978 INFO:teuthology.orchestra.run.trial068.stdout: "hit_set_grade_decay_rate": 0, 2026-02-18T21:02:21.979 INFO:teuthology.orchestra.run.trial068.stdout: "hit_set_search_last_n": 0, 2026-02-18T21:02:21.979 INFO:teuthology.orchestra.run.trial068.stdout: "grade_table": [], 2026-02-18T21:02:21.979 INFO:teuthology.orchestra.run.trial068.stdout: "stripe_width": 0, 2026-02-18T21:02:21.979 INFO:teuthology.orchestra.run.trial068.stdout: "expected_num_objects": 0, 2026-02-18T21:02:21.979 INFO:teuthology.orchestra.run.trial068.stdout: "fast_read": false, 2026-02-18T21:02:21.979 INFO:teuthology.orchestra.run.trial068.stdout: "options": {}, 2026-02-18T21:02:21.979 INFO:teuthology.orchestra.run.trial068.stdout: "application_metadata": { 2026-02-18T21:02:21.979 INFO:teuthology.orchestra.run.trial068.stdout: "rbd": {} 2026-02-18T21:02:21.979 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.979 INFO:teuthology.orchestra.run.trial068.stdout: "read_balance": { 2026-02-18T21:02:21.979 INFO:teuthology.orchestra.run.trial068.stdout: "score_type": "Fair distribution", 2026-02-18T21:02:21.979 INFO:teuthology.orchestra.run.trial068.stdout: "score_acting": 2.5, 2026-02-18T21:02:21.979 INFO:teuthology.orchestra.run.trial068.stdout: "score_stable": 2.5, 2026-02-18T21:02:21.980 INFO:teuthology.orchestra.run.trial068.stdout: "optimal_score": 1, 2026-02-18T21:02:21.980 INFO:teuthology.orchestra.run.trial068.stdout: "raw_score_acting": 2.5, 2026-02-18T21:02:21.980 INFO:teuthology.orchestra.run.trial068.stdout: "raw_score_stable": 2.5, 2026-02-18T21:02:21.980 INFO:teuthology.orchestra.run.trial068.stdout: "primary_affinity_weighted": 1, 2026-02-18T21:02:21.980 INFO:teuthology.orchestra.run.trial068.stdout: "average_primary_affinity": 1, 2026-02-18T21:02:21.980 INFO:teuthology.orchestra.run.trial068.stdout: "average_primary_affinity_weighted": 1 2026-02-18T21:02:21.980 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.980 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.980 INFO:teuthology.orchestra.run.trial068.stdout: ], 2026-02-18T21:02:21.980 INFO:teuthology.orchestra.run.trial068.stdout: "osds": [ 2026-02-18T21:02:21.980 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.980 INFO:teuthology.orchestra.run.trial068.stdout: "osd": 0, 2026-02-18T21:02:21.980 INFO:teuthology.orchestra.run.trial068.stdout: "uuid": "bb5f8e54-3a43-41d6-b266-aa412a7f170e", 2026-02-18T21:02:21.980 INFO:teuthology.orchestra.run.trial068.stdout: "up": 1, 2026-02-18T21:02:21.981 INFO:teuthology.orchestra.run.trial068.stdout: "in": 1, 2026-02-18T21:02:21.981 INFO:teuthology.orchestra.run.trial068.stdout: "weight": 1, 2026-02-18T21:02:21.981 INFO:teuthology.orchestra.run.trial068.stdout: "primary_affinity": 1, 2026-02-18T21:02:21.981 INFO:teuthology.orchestra.run.trial068.stdout: "last_clean_begin": 9, 2026-02-18T21:02:21.981 INFO:teuthology.orchestra.run.trial068.stdout: "last_clean_end": 20, 2026-02-18T21:02:21.981 INFO:teuthology.orchestra.run.trial068.stdout: "up_from": 26, 2026-02-18T21:02:21.981 INFO:teuthology.orchestra.run.trial068.stdout: "up_thru": 26, 2026-02-18T21:02:21.981 INFO:teuthology.orchestra.run.trial068.stdout: "down_at": 21, 2026-02-18T21:02:21.981 INFO:teuthology.orchestra.run.trial068.stdout: "lost_at": 0, 2026-02-18T21:02:21.981 INFO:teuthology.orchestra.run.trial068.stdout: "public_addrs": { 2026-02-18T21:02:21.982 INFO:teuthology.orchestra.run.trial068.stdout: "addrvec": [ 2026-02-18T21:02:21.982 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.982 INFO:teuthology.orchestra.run.trial068.stdout: "type": "v1", 2026-02-18T21:02:21.982 INFO:teuthology.orchestra.run.trial068.stdout: "addr": "10.20.193.68:6800", 2026-02-18T21:02:21.982 INFO:teuthology.orchestra.run.trial068.stdout: "nonce": 2637053487 2026-02-18T21:02:21.982 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.982 INFO:teuthology.orchestra.run.trial068.stdout: ] 2026-02-18T21:02:21.982 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.982 INFO:teuthology.orchestra.run.trial068.stdout: "cluster_addrs": { 2026-02-18T21:02:21.982 INFO:teuthology.orchestra.run.trial068.stdout: "addrvec": [ 2026-02-18T21:02:21.982 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.982 INFO:teuthology.orchestra.run.trial068.stdout: "type": "v1", 2026-02-18T21:02:21.983 INFO:teuthology.orchestra.run.trial068.stdout: "addr": "10.20.193.68:6801", 2026-02-18T21:02:21.983 INFO:teuthology.orchestra.run.trial068.stdout: "nonce": 2637053487 2026-02-18T21:02:21.983 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.983 INFO:teuthology.orchestra.run.trial068.stdout: ] 2026-02-18T21:02:21.983 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.983 INFO:teuthology.orchestra.run.trial068.stdout: "heartbeat_back_addrs": { 2026-02-18T21:02:21.983 INFO:teuthology.orchestra.run.trial068.stdout: "addrvec": [ 2026-02-18T21:02:21.983 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.983 INFO:teuthology.orchestra.run.trial068.stdout: "type": "v1", 2026-02-18T21:02:21.983 INFO:teuthology.orchestra.run.trial068.stdout: "addr": "10.20.193.68:6803", 2026-02-18T21:02:21.983 INFO:teuthology.orchestra.run.trial068.stdout: "nonce": 2637053487 2026-02-18T21:02:21.983 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.984 INFO:teuthology.orchestra.run.trial068.stdout: ] 2026-02-18T21:02:21.984 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.984 INFO:teuthology.orchestra.run.trial068.stdout: "heartbeat_front_addrs": { 2026-02-18T21:02:21.984 INFO:teuthology.orchestra.run.trial068.stdout: "addrvec": [ 2026-02-18T21:02:21.984 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.984 INFO:teuthology.orchestra.run.trial068.stdout: "type": "v1", 2026-02-18T21:02:21.984 INFO:teuthology.orchestra.run.trial068.stdout: "addr": "10.20.193.68:6802", 2026-02-18T21:02:21.984 INFO:teuthology.orchestra.run.trial068.stdout: "nonce": 2637053487 2026-02-18T21:02:21.984 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.984 INFO:teuthology.orchestra.run.trial068.stdout: ] 2026-02-18T21:02:21.984 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.984 INFO:teuthology.orchestra.run.trial068.stdout: "public_addr": "10.20.193.68:6800/2637053487", 2026-02-18T21:02:21.984 INFO:teuthology.orchestra.run.trial068.stdout: "cluster_addr": "10.20.193.68:6801/2637053487", 2026-02-18T21:02:21.985 INFO:teuthology.orchestra.run.trial068.stdout: "heartbeat_back_addr": "10.20.193.68:6803/2637053487", 2026-02-18T21:02:21.985 INFO:teuthology.orchestra.run.trial068.stdout: "heartbeat_front_addr": "10.20.193.68:6802/2637053487", 2026-02-18T21:02:21.985 INFO:teuthology.orchestra.run.trial068.stdout: "state": [ 2026-02-18T21:02:21.985 INFO:teuthology.orchestra.run.trial068.stdout: "exists", 2026-02-18T21:02:21.985 INFO:teuthology.orchestra.run.trial068.stdout: "up" 2026-02-18T21:02:21.985 INFO:teuthology.orchestra.run.trial068.stdout: ] 2026-02-18T21:02:21.985 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.985 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.985 INFO:teuthology.orchestra.run.trial068.stdout: "osd": 1, 2026-02-18T21:02:21.985 INFO:teuthology.orchestra.run.trial068.stdout: "uuid": "e26d8762-250e-42e7-8768-23caa22edb04", 2026-02-18T21:02:21.985 INFO:teuthology.orchestra.run.trial068.stdout: "up": 1, 2026-02-18T21:02:21.985 INFO:teuthology.orchestra.run.trial068.stdout: "in": 1, 2026-02-18T21:02:21.985 INFO:teuthology.orchestra.run.trial068.stdout: "weight": 1, 2026-02-18T21:02:21.986 INFO:teuthology.orchestra.run.trial068.stdout: "primary_affinity": 1, 2026-02-18T21:02:21.986 INFO:teuthology.orchestra.run.trial068.stdout: "last_clean_begin": 9, 2026-02-18T21:02:21.986 INFO:teuthology.orchestra.run.trial068.stdout: "last_clean_end": 21, 2026-02-18T21:02:21.986 INFO:teuthology.orchestra.run.trial068.stdout: "up_from": 27, 2026-02-18T21:02:21.986 INFO:teuthology.orchestra.run.trial068.stdout: "up_thru": 27, 2026-02-18T21:02:21.986 INFO:teuthology.orchestra.run.trial068.stdout: "down_at": 22, 2026-02-18T21:02:21.986 INFO:teuthology.orchestra.run.trial068.stdout: "lost_at": 0, 2026-02-18T21:02:21.986 INFO:teuthology.orchestra.run.trial068.stdout: "public_addrs": { 2026-02-18T21:02:21.986 INFO:teuthology.orchestra.run.trial068.stdout: "addrvec": [ 2026-02-18T21:02:21.986 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.986 INFO:teuthology.orchestra.run.trial068.stdout: "type": "v1", 2026-02-18T21:02:21.986 INFO:teuthology.orchestra.run.trial068.stdout: "addr": "10.20.193.68:6804", 2026-02-18T21:02:21.986 INFO:teuthology.orchestra.run.trial068.stdout: "nonce": 4160428224 2026-02-18T21:02:21.987 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.987 INFO:teuthology.orchestra.run.trial068.stdout: ] 2026-02-18T21:02:21.987 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.987 INFO:teuthology.orchestra.run.trial068.stdout: "cluster_addrs": { 2026-02-18T21:02:21.987 INFO:teuthology.orchestra.run.trial068.stdout: "addrvec": [ 2026-02-18T21:02:21.987 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.987 INFO:teuthology.orchestra.run.trial068.stdout: "type": "v1", 2026-02-18T21:02:21.987 INFO:teuthology.orchestra.run.trial068.stdout: "addr": "10.20.193.68:6805", 2026-02-18T21:02:21.987 INFO:teuthology.orchestra.run.trial068.stdout: "nonce": 4160428224 2026-02-18T21:02:21.987 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.987 INFO:teuthology.orchestra.run.trial068.stdout: ] 2026-02-18T21:02:21.988 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.988 INFO:teuthology.orchestra.run.trial068.stdout: "heartbeat_back_addrs": { 2026-02-18T21:02:21.988 INFO:teuthology.orchestra.run.trial068.stdout: "addrvec": [ 2026-02-18T21:02:21.988 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.988 INFO:teuthology.orchestra.run.trial068.stdout: "type": "v1", 2026-02-18T21:02:21.988 INFO:teuthology.orchestra.run.trial068.stdout: "addr": "10.20.193.68:6807", 2026-02-18T21:02:21.988 INFO:teuthology.orchestra.run.trial068.stdout: "nonce": 4160428224 2026-02-18T21:02:21.988 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.988 INFO:teuthology.orchestra.run.trial068.stdout: ] 2026-02-18T21:02:21.988 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.988 INFO:teuthology.orchestra.run.trial068.stdout: "heartbeat_front_addrs": { 2026-02-18T21:02:21.988 INFO:teuthology.orchestra.run.trial068.stdout: "addrvec": [ 2026-02-18T21:02:21.989 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.989 INFO:teuthology.orchestra.run.trial068.stdout: "type": "v1", 2026-02-18T21:02:21.989 INFO:teuthology.orchestra.run.trial068.stdout: "addr": "10.20.193.68:6806", 2026-02-18T21:02:21.989 INFO:teuthology.orchestra.run.trial068.stdout: "nonce": 4160428224 2026-02-18T21:02:21.989 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.989 INFO:teuthology.orchestra.run.trial068.stdout: ] 2026-02-18T21:02:21.989 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.989 INFO:teuthology.orchestra.run.trial068.stdout: "public_addr": "10.20.193.68:6804/4160428224", 2026-02-18T21:02:21.989 INFO:teuthology.orchestra.run.trial068.stdout: "cluster_addr": "10.20.193.68:6805/4160428224", 2026-02-18T21:02:21.989 INFO:teuthology.orchestra.run.trial068.stdout: "heartbeat_back_addr": "10.20.193.68:6807/4160428224", 2026-02-18T21:02:21.989 INFO:teuthology.orchestra.run.trial068.stdout: "heartbeat_front_addr": "10.20.193.68:6806/4160428224", 2026-02-18T21:02:21.989 INFO:teuthology.orchestra.run.trial068.stdout: "state": [ 2026-02-18T21:02:21.989 INFO:teuthology.orchestra.run.trial068.stdout: "exists", 2026-02-18T21:02:21.990 INFO:teuthology.orchestra.run.trial068.stdout: "up" 2026-02-18T21:02:21.990 INFO:teuthology.orchestra.run.trial068.stdout: ] 2026-02-18T21:02:21.990 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.990 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.990 INFO:teuthology.orchestra.run.trial068.stdout: "osd": 2, 2026-02-18T21:02:21.990 INFO:teuthology.orchestra.run.trial068.stdout: "uuid": "568ee96d-39ac-4d79-92bb-d1f3f12601b6", 2026-02-18T21:02:21.990 INFO:teuthology.orchestra.run.trial068.stdout: "up": 1, 2026-02-18T21:02:21.990 INFO:teuthology.orchestra.run.trial068.stdout: "in": 1, 2026-02-18T21:02:21.990 INFO:teuthology.orchestra.run.trial068.stdout: "weight": 1, 2026-02-18T21:02:21.990 INFO:teuthology.orchestra.run.trial068.stdout: "primary_affinity": 1, 2026-02-18T21:02:21.990 INFO:teuthology.orchestra.run.trial068.stdout: "last_clean_begin": 9, 2026-02-18T21:02:21.990 INFO:teuthology.orchestra.run.trial068.stdout: "last_clean_end": 21, 2026-02-18T21:02:21.990 INFO:teuthology.orchestra.run.trial068.stdout: "up_from": 28, 2026-02-18T21:02:21.991 INFO:teuthology.orchestra.run.trial068.stdout: "up_thru": 29, 2026-02-18T21:02:21.991 INFO:teuthology.orchestra.run.trial068.stdout: "down_at": 23, 2026-02-18T21:02:21.991 INFO:teuthology.orchestra.run.trial068.stdout: "lost_at": 0, 2026-02-18T21:02:21.991 INFO:teuthology.orchestra.run.trial068.stdout: "public_addrs": { 2026-02-18T21:02:21.991 INFO:teuthology.orchestra.run.trial068.stdout: "addrvec": [ 2026-02-18T21:02:21.991 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.991 INFO:teuthology.orchestra.run.trial068.stdout: "type": "v1", 2026-02-18T21:02:21.991 INFO:teuthology.orchestra.run.trial068.stdout: "addr": "10.20.193.68:6808", 2026-02-18T21:02:21.991 INFO:teuthology.orchestra.run.trial068.stdout: "nonce": 3642986683 2026-02-18T21:02:21.991 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.991 INFO:teuthology.orchestra.run.trial068.stdout: ] 2026-02-18T21:02:21.991 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.992 INFO:teuthology.orchestra.run.trial068.stdout: "cluster_addrs": { 2026-02-18T21:02:21.992 INFO:teuthology.orchestra.run.trial068.stdout: "addrvec": [ 2026-02-18T21:02:21.992 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.992 INFO:teuthology.orchestra.run.trial068.stdout: "type": "v1", 2026-02-18T21:02:21.992 INFO:teuthology.orchestra.run.trial068.stdout: "addr": "10.20.193.68:6809", 2026-02-18T21:02:21.992 INFO:teuthology.orchestra.run.trial068.stdout: "nonce": 3642986683 2026-02-18T21:02:21.992 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.992 INFO:teuthology.orchestra.run.trial068.stdout: ] 2026-02-18T21:02:21.992 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.992 INFO:teuthology.orchestra.run.trial068.stdout: "heartbeat_back_addrs": { 2026-02-18T21:02:21.992 INFO:teuthology.orchestra.run.trial068.stdout: "addrvec": [ 2026-02-18T21:02:21.992 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.992 INFO:teuthology.orchestra.run.trial068.stdout: "type": "v1", 2026-02-18T21:02:21.993 INFO:teuthology.orchestra.run.trial068.stdout: "addr": "10.20.193.68:6811", 2026-02-18T21:02:21.993 INFO:teuthology.orchestra.run.trial068.stdout: "nonce": 3642986683 2026-02-18T21:02:21.993 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.993 INFO:teuthology.orchestra.run.trial068.stdout: ] 2026-02-18T21:02:21.993 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.993 INFO:teuthology.orchestra.run.trial068.stdout: "heartbeat_front_addrs": { 2026-02-18T21:02:21.993 INFO:teuthology.orchestra.run.trial068.stdout: "addrvec": [ 2026-02-18T21:02:21.993 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.993 INFO:teuthology.orchestra.run.trial068.stdout: "type": "v1", 2026-02-18T21:02:21.993 INFO:teuthology.orchestra.run.trial068.stdout: "addr": "10.20.193.68:6810", 2026-02-18T21:02:21.993 INFO:teuthology.orchestra.run.trial068.stdout: "nonce": 3642986683 2026-02-18T21:02:21.993 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.993 INFO:teuthology.orchestra.run.trial068.stdout: ] 2026-02-18T21:02:21.994 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.994 INFO:teuthology.orchestra.run.trial068.stdout: "public_addr": "10.20.193.68:6808/3642986683", 2026-02-18T21:02:21.994 INFO:teuthology.orchestra.run.trial068.stdout: "cluster_addr": "10.20.193.68:6809/3642986683", 2026-02-18T21:02:21.994 INFO:teuthology.orchestra.run.trial068.stdout: "heartbeat_back_addr": "10.20.193.68:6811/3642986683", 2026-02-18T21:02:21.994 INFO:teuthology.orchestra.run.trial068.stdout: "heartbeat_front_addr": "10.20.193.68:6810/3642986683", 2026-02-18T21:02:21.994 INFO:teuthology.orchestra.run.trial068.stdout: "state": [ 2026-02-18T21:02:21.994 INFO:teuthology.orchestra.run.trial068.stdout: "exists", 2026-02-18T21:02:21.994 INFO:teuthology.orchestra.run.trial068.stdout: "up" 2026-02-18T21:02:21.994 INFO:teuthology.orchestra.run.trial068.stdout: ] 2026-02-18T21:02:21.994 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.994 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.995 INFO:teuthology.orchestra.run.trial068.stdout: "osd": 3, 2026-02-18T21:02:21.995 INFO:teuthology.orchestra.run.trial068.stdout: "uuid": "765a38cd-f526-4aba-b94e-c57076ca6c72", 2026-02-18T21:02:21.995 INFO:teuthology.orchestra.run.trial068.stdout: "up": 1, 2026-02-18T21:02:21.995 INFO:teuthology.orchestra.run.trial068.stdout: "in": 1, 2026-02-18T21:02:21.995 INFO:teuthology.orchestra.run.trial068.stdout: "weight": 1, 2026-02-18T21:02:21.995 INFO:teuthology.orchestra.run.trial068.stdout: "primary_affinity": 1, 2026-02-18T21:02:21.995 INFO:teuthology.orchestra.run.trial068.stdout: "last_clean_begin": 9, 2026-02-18T21:02:21.995 INFO:teuthology.orchestra.run.trial068.stdout: "last_clean_end": 23, 2026-02-18T21:02:21.995 INFO:teuthology.orchestra.run.trial068.stdout: "up_from": 29, 2026-02-18T21:02:21.995 INFO:teuthology.orchestra.run.trial068.stdout: "up_thru": 29, 2026-02-18T21:02:21.995 INFO:teuthology.orchestra.run.trial068.stdout: "down_at": 24, 2026-02-18T21:02:21.995 INFO:teuthology.orchestra.run.trial068.stdout: "lost_at": 0, 2026-02-18T21:02:21.995 INFO:teuthology.orchestra.run.trial068.stdout: "public_addrs": { 2026-02-18T21:02:21.996 INFO:teuthology.orchestra.run.trial068.stdout: "addrvec": [ 2026-02-18T21:02:21.996 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.996 INFO:teuthology.orchestra.run.trial068.stdout: "type": "v1", 2026-02-18T21:02:21.996 INFO:teuthology.orchestra.run.trial068.stdout: "addr": "10.20.193.68:6812", 2026-02-18T21:02:21.996 INFO:teuthology.orchestra.run.trial068.stdout: "nonce": 1687218919 2026-02-18T21:02:21.996 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.996 INFO:teuthology.orchestra.run.trial068.stdout: ] 2026-02-18T21:02:21.996 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.996 INFO:teuthology.orchestra.run.trial068.stdout: "cluster_addrs": { 2026-02-18T21:02:21.996 INFO:teuthology.orchestra.run.trial068.stdout: "addrvec": [ 2026-02-18T21:02:21.996 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.996 INFO:teuthology.orchestra.run.trial068.stdout: "type": "v1", 2026-02-18T21:02:21.996 INFO:teuthology.orchestra.run.trial068.stdout: "addr": "10.20.193.68:6813", 2026-02-18T21:02:21.996 INFO:teuthology.orchestra.run.trial068.stdout: "nonce": 1687218919 2026-02-18T21:02:21.997 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.997 INFO:teuthology.orchestra.run.trial068.stdout: ] 2026-02-18T21:02:21.997 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.997 INFO:teuthology.orchestra.run.trial068.stdout: "heartbeat_back_addrs": { 2026-02-18T21:02:21.997 INFO:teuthology.orchestra.run.trial068.stdout: "addrvec": [ 2026-02-18T21:02:21.997 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.997 INFO:teuthology.orchestra.run.trial068.stdout: "type": "v1", 2026-02-18T21:02:21.997 INFO:teuthology.orchestra.run.trial068.stdout: "addr": "10.20.193.68:6815", 2026-02-18T21:02:21.997 INFO:teuthology.orchestra.run.trial068.stdout: "nonce": 1687218919 2026-02-18T21:02:21.997 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.997 INFO:teuthology.orchestra.run.trial068.stdout: ] 2026-02-18T21:02:21.997 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.997 INFO:teuthology.orchestra.run.trial068.stdout: "heartbeat_front_addrs": { 2026-02-18T21:02:21.997 INFO:teuthology.orchestra.run.trial068.stdout: "addrvec": [ 2026-02-18T21:02:21.997 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.998 INFO:teuthology.orchestra.run.trial068.stdout: "type": "v1", 2026-02-18T21:02:21.998 INFO:teuthology.orchestra.run.trial068.stdout: "addr": "10.20.193.68:6814", 2026-02-18T21:02:21.998 INFO:teuthology.orchestra.run.trial068.stdout: "nonce": 1687218919 2026-02-18T21:02:21.998 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.998 INFO:teuthology.orchestra.run.trial068.stdout: ] 2026-02-18T21:02:21.998 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.998 INFO:teuthology.orchestra.run.trial068.stdout: "public_addr": "10.20.193.68:6812/1687218919", 2026-02-18T21:02:21.998 INFO:teuthology.orchestra.run.trial068.stdout: "cluster_addr": "10.20.193.68:6813/1687218919", 2026-02-18T21:02:21.998 INFO:teuthology.orchestra.run.trial068.stdout: "heartbeat_back_addr": "10.20.193.68:6815/1687218919", 2026-02-18T21:02:21.998 INFO:teuthology.orchestra.run.trial068.stdout: "heartbeat_front_addr": "10.20.193.68:6814/1687218919", 2026-02-18T21:02:21.998 INFO:teuthology.orchestra.run.trial068.stdout: "state": [ 2026-02-18T21:02:21.998 INFO:teuthology.orchestra.run.trial068.stdout: "exists", 2026-02-18T21:02:21.998 INFO:teuthology.orchestra.run.trial068.stdout: "up" 2026-02-18T21:02:21.998 INFO:teuthology.orchestra.run.trial068.stdout: ] 2026-02-18T21:02:21.999 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:21.999 INFO:teuthology.orchestra.run.trial068.stdout: ], 2026-02-18T21:02:21.999 INFO:teuthology.orchestra.run.trial068.stdout: "osd_xinfo": [ 2026-02-18T21:02:21.999 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:21.999 INFO:teuthology.orchestra.run.trial068.stdout: "osd": 0, 2026-02-18T21:02:21.999 INFO:teuthology.orchestra.run.trial068.stdout: "down_stamp": "0.000000", 2026-02-18T21:02:21.999 INFO:teuthology.orchestra.run.trial068.stdout: "laggy_probability": 0, 2026-02-18T21:02:21.999 INFO:teuthology.orchestra.run.trial068.stdout: "laggy_interval": 0, 2026-02-18T21:02:21.999 INFO:teuthology.orchestra.run.trial068.stdout: "features": 4540701547738038271, 2026-02-18T21:02:21.999 INFO:teuthology.orchestra.run.trial068.stdout: "old_weight": 0, 2026-02-18T21:02:21.999 INFO:teuthology.orchestra.run.trial068.stdout: "last_purged_snaps_scrub": "2026-02-18T21:01:16.873205+0000", 2026-02-18T21:02:21.999 INFO:teuthology.orchestra.run.trial068.stdout: "dead_epoch": 21 2026-02-18T21:02:21.999 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:21.999 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:22.000 INFO:teuthology.orchestra.run.trial068.stdout: "osd": 1, 2026-02-18T21:02:22.000 INFO:teuthology.orchestra.run.trial068.stdout: "down_stamp": "0.000000", 2026-02-18T21:02:22.000 INFO:teuthology.orchestra.run.trial068.stdout: "laggy_probability": 0, 2026-02-18T21:02:22.000 INFO:teuthology.orchestra.run.trial068.stdout: "laggy_interval": 0, 2026-02-18T21:02:22.000 INFO:teuthology.orchestra.run.trial068.stdout: "features": 4540701547738038271, 2026-02-18T21:02:22.000 INFO:teuthology.orchestra.run.trial068.stdout: "old_weight": 0, 2026-02-18T21:02:22.000 INFO:teuthology.orchestra.run.trial068.stdout: "last_purged_snaps_scrub": "2026-02-18T21:01:16.929452+0000", 2026-02-18T21:02:22.000 INFO:teuthology.orchestra.run.trial068.stdout: "dead_epoch": 22 2026-02-18T21:02:22.000 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:22.000 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:22.000 INFO:teuthology.orchestra.run.trial068.stdout: "osd": 2, 2026-02-18T21:02:22.000 INFO:teuthology.orchestra.run.trial068.stdout: "down_stamp": "0.000000", 2026-02-18T21:02:22.000 INFO:teuthology.orchestra.run.trial068.stdout: "laggy_probability": 0, 2026-02-18T21:02:22.000 INFO:teuthology.orchestra.run.trial068.stdout: "laggy_interval": 0, 2026-02-18T21:02:22.000 INFO:teuthology.orchestra.run.trial068.stdout: "features": 4540701547738038271, 2026-02-18T21:02:22.000 INFO:teuthology.orchestra.run.trial068.stdout: "old_weight": 0, 2026-02-18T21:02:22.001 INFO:teuthology.orchestra.run.trial068.stdout: "last_purged_snaps_scrub": "2026-02-18T21:01:16.863830+0000", 2026-02-18T21:02:22.001 INFO:teuthology.orchestra.run.trial068.stdout: "dead_epoch": 23 2026-02-18T21:02:22.001 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:22.001 INFO:teuthology.orchestra.run.trial068.stdout: { 2026-02-18T21:02:22.001 INFO:teuthology.orchestra.run.trial068.stdout: "osd": 3, 2026-02-18T21:02:22.001 INFO:teuthology.orchestra.run.trial068.stdout: "down_stamp": "2026-02-18T21:02:12.008626+0000", 2026-02-18T21:02:22.001 INFO:teuthology.orchestra.run.trial068.stdout: "laggy_probability": 0, 2026-02-18T21:02:22.001 INFO:teuthology.orchestra.run.trial068.stdout: "laggy_interval": 0, 2026-02-18T21:02:22.001 INFO:teuthology.orchestra.run.trial068.stdout: "features": 4540701547738038271, 2026-02-18T21:02:22.001 INFO:teuthology.orchestra.run.trial068.stdout: "old_weight": 0, 2026-02-18T21:02:22.001 INFO:teuthology.orchestra.run.trial068.stdout: "last_purged_snaps_scrub": "2026-02-18T21:01:16.949895+0000", 2026-02-18T21:02:22.001 INFO:teuthology.orchestra.run.trial068.stdout: "dead_epoch": 0 2026-02-18T21:02:22.001 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:22.001 INFO:teuthology.orchestra.run.trial068.stdout: ], 2026-02-18T21:02:22.001 INFO:teuthology.orchestra.run.trial068.stdout: "pg_upmap": [], 2026-02-18T21:02:22.001 INFO:teuthology.orchestra.run.trial068.stdout: "pg_upmap_items": [], 2026-02-18T21:02:22.002 INFO:teuthology.orchestra.run.trial068.stdout: "pg_upmap_primaries": [], 2026-02-18T21:02:22.002 INFO:teuthology.orchestra.run.trial068.stdout: "pg_temp": [], 2026-02-18T21:02:22.002 INFO:teuthology.orchestra.run.trial068.stdout: "primary_temp": [], 2026-02-18T21:02:22.002 INFO:teuthology.orchestra.run.trial068.stdout: "blocklist": { 2026-02-18T21:02:22.002 INFO:teuthology.orchestra.run.trial068.stdout: "10.20.193.68:0/991885778": "2026-02-19T21:02:04.994407+0000", 2026-02-18T21:02:22.002 INFO:teuthology.orchestra.run.trial068.stdout: "10.20.193.68:0/4112610678": "2026-02-19T21:02:04.994407+0000", 2026-02-18T21:02:22.002 INFO:teuthology.orchestra.run.trial068.stdout: "10.20.193.68:0/4267957295": "2026-02-19T21:02:04.994407+0000", 2026-02-18T21:02:22.002 INFO:teuthology.orchestra.run.trial068.stdout: "10.20.193.68:6816/24610": "2026-02-19T21:02:04.994407+0000", 2026-02-18T21:02:22.002 INFO:teuthology.orchestra.run.trial068.stdout: "10.20.193.68:0/3536457986": "2026-02-19T21:02:04.994407+0000" 2026-02-18T21:02:22.002 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:22.002 INFO:teuthology.orchestra.run.trial068.stdout: "range_blocklist": {}, 2026-02-18T21:02:22.002 INFO:teuthology.orchestra.run.trial068.stdout: "erasure_code_profiles": { 2026-02-18T21:02:22.002 INFO:teuthology.orchestra.run.trial068.stdout: "default": { 2026-02-18T21:02:22.002 INFO:teuthology.orchestra.run.trial068.stdout: "crush-failure-domain": "osd", 2026-02-18T21:02:22.002 INFO:teuthology.orchestra.run.trial068.stdout: "k": "2", 2026-02-18T21:02:22.002 INFO:teuthology.orchestra.run.trial068.stdout: "m": "1", 2026-02-18T21:02:22.003 INFO:teuthology.orchestra.run.trial068.stdout: "plugin": "jerasure", 2026-02-18T21:02:22.003 INFO:teuthology.orchestra.run.trial068.stdout: "technique": "reed_sol_van" 2026-02-18T21:02:22.003 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:22.003 INFO:teuthology.orchestra.run.trial068.stdout: }, 2026-02-18T21:02:22.003 INFO:teuthology.orchestra.run.trial068.stdout: "removed_snaps_queue": [], 2026-02-18T21:02:22.003 INFO:teuthology.orchestra.run.trial068.stdout: "new_removed_snaps": [], 2026-02-18T21:02:22.003 INFO:teuthology.orchestra.run.trial068.stdout: "new_purged_snaps": [], 2026-02-18T21:02:22.003 INFO:teuthology.orchestra.run.trial068.stdout: "crush_node_flags": {}, 2026-02-18T21:02:22.003 INFO:teuthology.orchestra.run.trial068.stdout: "device_class_flags": {}, 2026-02-18T21:02:22.003 INFO:teuthology.orchestra.run.trial068.stdout: "stretch_mode": { 2026-02-18T21:02:22.003 INFO:teuthology.orchestra.run.trial068.stdout: "stretch_mode_enabled": false, 2026-02-18T21:02:22.003 INFO:teuthology.orchestra.run.trial068.stdout: "stretch_bucket_count": 0, 2026-02-18T21:02:22.003 INFO:teuthology.orchestra.run.trial068.stdout: "degraded_stretch_mode": 0, 2026-02-18T21:02:22.003 INFO:teuthology.orchestra.run.trial068.stdout: "recovering_stretch_mode": 0, 2026-02-18T21:02:22.003 INFO:teuthology.orchestra.run.trial068.stdout: "stretch_mode_bucket": 0 2026-02-18T21:02:22.003 INFO:teuthology.orchestra.run.trial068.stdout: } 2026-02-18T21:02:22.003 INFO:teuthology.orchestra.run.trial068.stdout:} 2026-02-18T21:02:22.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.964+0000 7f4d00a0e640 1 -- 10.20.193.68:0/278733339 >> v1:10.20.193.68:6816/2904515774 conn(0x7f4cc804f790 legacy=0x7f4cc8051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:22.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.964+0000 7f4d00a0e640 1 -- 10.20.193.68:0/278733339 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4cfc134d40 msgr2=0x7f4cfc123710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:22.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.964+0000 7f4d00a0e640 1 --2- 10.20.193.68:0/278733339 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4cfc134d40 0x7f4cfc123710 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4cec007d90 tx=0x7f4cec00e4b0 comp rx=0 tx=0).stop 2026-02-18T21:02:22.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.964+0000 7f4d00a0e640 1 -- 10.20.193.68:0/278733339 shutdown_connections 2026-02-18T21:02:22.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.964+0000 7f4d00a0e640 1 --2- 10.20.193.68:0/278733339 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4cfc134d40 0x7f4cfc123710 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:22.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.964+0000 7f4d00a0e640 1 --2- 10.20.193.68:0/278733339 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4cfc0711a0 0x7f4cfc1c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:22.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.964+0000 7f4d00a0e640 1 --2- 10.20.193.68:0/278733339 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4cfc070880 0x7f4cfc1c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:22.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.964+0000 7f4d00a0e640 1 -- 10.20.193.68:0/278733339 >> 10.20.193.68:0/278733339 conn(0x7f4cfc09d6a0 msgr2=0x7f4cfc094900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:22.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.964+0000 7f4d00a0e640 1 -- 10.20.193.68:0/278733339 shutdown_connections 2026-02-18T21:02:22.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:21.964+0000 7f4d00a0e640 1 -- 10.20.193.68:0/278733339 wait complete. 2026-02-18T21:02:22.006 DEBUG:teuthology.orchestra.run.trial068:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs dump' 2026-02-18T21:02:22.077 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.072+0000 7fc3c0290640 1 Processor -- start 2026-02-18T21:02:22.077 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.072+0000 7fc3c0290640 1 -- start start 2026-02-18T21:02:22.077 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3c0290640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc3b8130070 0x7fc3b8130450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:22.078 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3c0290640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fc3b8130990 0x7fc3b812caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:22.078 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3c0290640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc3b812d030 0x7fc3b812d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:22.078 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3c0290640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7fc3b8118b40 con 0x7fc3b8130990 2026-02-18T21:02:22.078 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3c0290640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fc3b8118360 con 0x7fc3b8130070 2026-02-18T21:02:22.078 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3c0290640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fc3b8070ce0 con 0x7fc3b812d030 2026-02-18T21:02:22.078 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3be005640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc3b8130070 0x7fc3b8130450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:22.078 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3bd804640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fc3b8130990 0x7fc3b812caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:22.078 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3bd804640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fc3b8130990 0x7fc3b812caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:38660/0 (socket says 10.20.193.68:38660) 2026-02-18T21:02:22.078 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3be005640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc3b8130070 0x7fc3b8130450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42226/0 (socket says 10.20.193.68:42226) 2026-02-18T21:02:22.079 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3bd804640 1 -- 10.20.193.68:0/4086513042 learned_addr learned my addr 10.20.193.68:0/4086513042 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:22.079 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3be806640 1 --2- 10.20.193.68:0/4086513042 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc3b812d030 0x7fc3b812d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:22.079 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3bd804640 1 -- 10.20.193.68:0/4086513042 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc3b812d030 msgr2=0x7fc3b812d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:22.079 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3bd804640 1 --2- 10.20.193.68:0/4086513042 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc3b812d030 0x7fc3b812d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:22.079 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3bd804640 1 -- 10.20.193.68:0/4086513042 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc3b8130070 msgr2=0x7fc3b8130450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:22.079 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3bd804640 1 --2- 10.20.193.68:0/4086513042 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc3b8130070 0x7fc3b8130450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:22.079 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3bd804640 1 -- 10.20.193.68:0/4086513042 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b8118f10 con 0x7fc3b8130990 2026-02-18T21:02:22.079 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3be005640 1 --2- 10.20.193.68:0/4086513042 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc3b8130070 0x7fc3b8130450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:22.079 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3bd804640 1 --2- 10.20.193.68:0/4086513042 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc3b8130990 0x7fc3b812caf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0099a0 tx=0x7fc3ac02ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2255d333d7e4d98 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:22.079 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3bd003640 1 -- 10.20.193.68:0/4086513042 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac03c070 con 0x7fc3b8130990 2026-02-18T21:02:22.079 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3bd003640 1 -- 10.20.193.68:0/4086513042 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3ac02fac0 con 0x7fc3b8130990 2026-02-18T21:02:22.080 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.073+0000 7fc3bd003640 1 -- 10.20.193.68:0/4086513042 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac037440 con 0x7fc3b8130990 2026-02-18T21:02:22.080 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.074+0000 7fc3c0290640 1 -- 10.20.193.68:0/4086513042 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc3b8130990 msgr2=0x7fc3b812caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:22.080 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.074+0000 7fc3c0290640 1 --2- 10.20.193.68:0/4086513042 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc3b8130990 0x7fc3b812caf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0099a0 tx=0x7fc3ac02ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:22.080 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.074+0000 7fc3c0290640 1 -- 10.20.193.68:0/4086513042 shutdown_connections 2026-02-18T21:02:22.080 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.074+0000 7fc3c0290640 1 --2- 10.20.193.68:0/4086513042 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc3b812d030 0x7fc3b812d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:22.080 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.074+0000 7fc3c0290640 1 --2- 10.20.193.68:0/4086513042 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc3b8130990 0x7fc3b812caf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:22.080 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.074+0000 7fc3c0290640 1 --2- 10.20.193.68:0/4086513042 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc3b8130070 0x7fc3b8130450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:22.080 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.074+0000 7fc3c0290640 1 -- 10.20.193.68:0/4086513042 >> 10.20.193.68:0/4086513042 conn(0x7fc3b80713c0 msgr2=0x7fc3b80737e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:22.080 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.074+0000 7fc3c0290640 1 -- 10.20.193.68:0/4086513042 shutdown_connections 2026-02-18T21:02:22.080 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.074+0000 7fc3c0290640 1 -- 10.20.193.68:0/4086513042 wait complete. 2026-02-18T21:02:22.080 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.074+0000 7fc3c0290640 1 Processor -- start 2026-02-18T21:02:22.080 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.074+0000 7fc3c0290640 1 -- start start 2026-02-18T21:02:22.081 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc3c0290640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc3b812d030 0x7fc3b8133d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:22.081 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc3c0290640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc3b8130070 0x7fc3b81342b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:22.081 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc3c0290640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc3b8130990 0x7fc3b81347f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:22.081 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc3c0290640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8130f30 con 0x7fc3b812d030 2026-02-18T21:02:22.081 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc3c0290640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fc3b8130db0 con 0x7fc3b8130990 2026-02-18T21:02:22.081 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc3c0290640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fc3b8137400 con 0x7fc3b8130070 2026-02-18T21:02:22.081 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc3be005640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc3b812d030 0x7fc3b8133d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:22.081 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc3be806640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc3b8130990 0x7fc3b81347f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:22.081 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc3be005640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc3b812d030 0x7fc3b8133d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:38670/0 (socket says 10.20.193.68:38670) 2026-02-18T21:02:22.081 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc3be005640 1 -- 10.20.193.68:0/1047541210 learned_addr learned my addr 10.20.193.68:0/1047541210 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:22.081 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc3bd804640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc3b8130070 0x7fc3b81342b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:22.082 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc3be806640 1 -- 10.20.193.68:0/1047541210 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc3b8130070 msgr2=0x7fc3b81342b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:22.082 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc3be806640 1 --2- 10.20.193.68:0/1047541210 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc3b8130070 0x7fc3b81342b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:22.082 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc3be806640 1 -- 10.20.193.68:0/1047541210 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc3b812d030 msgr2=0x7fc3b8133d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:22.082 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc3be806640 1 --2- 10.20.193.68:0/1047541210 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc3b812d030 0x7fc3b8133d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:22.082 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc3be806640 1 -- 10.20.193.68:0/1047541210 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b812a7c0 con 0x7fc3b8130990 2026-02-18T21:02:22.082 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc3be005640 1 --2- 10.20.193.68:0/1047541210 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc3b812d030 0x7fc3b8133d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:22.082 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc3be806640 1 --2- 10.20.193.68:0/1047541210 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc3b8130990 0x7fc3b81347f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009d90 tx=0x7fc3b400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:22.083 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc39effd640 1 -- 10.20.193.68:0/1047541210 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4018020 con 0x7fc3b8130990 2026-02-18T21:02:22.083 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc39effd640 1 -- 10.20.193.68:0/1047541210 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b4014480 con 0x7fc3b8130990 2026-02-18T21:02:22.083 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc39effd640 1 -- 10.20.193.68:0/1047541210 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b4014870 con 0x7fc3b8130990 2026-02-18T21:02:22.083 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc3c0290640 1 -- 10.20.193.68:0/1047541210 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b8134d30 con 0x7fc3b8130990 2026-02-18T21:02:22.083 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.075+0000 7fc3c0290640 1 -- 10.20.193.68:0/1047541210 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b81368d0 con 0x7fc3b8130990 2026-02-18T21:02:22.083 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.076+0000 7fc3c0290640 1 -- 10.20.193.68:0/1047541210 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b8130450 con 0x7fc3b8130990 2026-02-18T21:02:22.083 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.076+0000 7fc39effd640 1 -- 10.20.193.68:0/1047541210 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fc3b4014a10 con 0x7fc3b8130990 2026-02-18T21:02:22.083 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.076+0000 7fc39effd640 1 -- 10.20.193.68:0/1047541210 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3021+0+0 (secure 0 0 0) 0x7fc3b4067ae0 con 0x7fc3b8130990 2026-02-18T21:02:22.084 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.078+0000 7fc39effd640 1 -- 10.20.193.68:0/1047541210 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fc3b4022030 con 0x7fc3b8130990 2026-02-18T21:02:22.159 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.159+0000 7fc3c0290640 1 -- 10.20.193.68:0/1047541210 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fc3b8050a10 con 0x7fc3b8130990 2026-02-18T21:02:22.159 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.159+0000 7fc39effd640 1 -- 10.20.193.68:0/1047541210 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 1 v1) ==== 75+0+396 (secure 0 0 0) 0x7fc3b4010040 con 0x7fc3b8130990 2026-02-18T21:02:22.159 INFO:teuthology.orchestra.run.trial068.stdout:e1 2026-02-18T21:02:22.160 INFO:teuthology.orchestra.run.trial068.stdout:btime 1970-01-01T00:00:00:000000+0000 2026-02-18T21:02:22.160 INFO:teuthology.orchestra.run.trial068.stdout:enable_multiple, ever_enabled_multiple: 1,1 2026-02-18T21:02:22.160 INFO:teuthology.orchestra.run.trial068.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2026-02-18T21:02:22.160 INFO:teuthology.orchestra.run.trial068.stdout:legacy client fscid: -1 2026-02-18T21:02:22.160 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:22.160 INFO:teuthology.orchestra.run.trial068.stdout:No filesystems configured 2026-02-18T21:02:22.161 INFO:teuthology.orchestra.run.trial068.stderr:dumped fsmap epoch 1 2026-02-18T21:02:22.161 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.160+0000 7fc3c0290640 1 -- 10.20.193.68:0/1047541210 >> v1:10.20.193.68:6816/2904515774 conn(0x7fc38804f7c0 legacy=0x7fc388051c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:22.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.160+0000 7fc3c0290640 1 -- 10.20.193.68:0/1047541210 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc3b8130990 msgr2=0x7fc3b81347f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:22.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.160+0000 7fc3c0290640 1 --2- 10.20.193.68:0/1047541210 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc3b8130990 0x7fc3b81347f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc3b4009d90 tx=0x7fc3b400c490 comp rx=0 tx=0).stop 2026-02-18T21:02:22.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.160+0000 7fc3c0290640 1 -- 10.20.193.68:0/1047541210 shutdown_connections 2026-02-18T21:02:22.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.160+0000 7fc3c0290640 1 --2- 10.20.193.68:0/1047541210 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc3b8130990 0x7fc3b81347f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:22.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.160+0000 7fc3c0290640 1 --2- 10.20.193.68:0/1047541210 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc3b8130070 0x7fc3b81342b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:22.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.160+0000 7fc3c0290640 1 --2- 10.20.193.68:0/1047541210 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc3b812d030 0x7fc3b8133d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:22.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.160+0000 7fc3c0290640 1 -- 10.20.193.68:0/1047541210 >> 10.20.193.68:0/1047541210 conn(0x7fc3b80713c0 msgr2=0x7fc3b812de50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:22.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.160+0000 7fc3c0290640 1 -- 10.20.193.68:0/1047541210 shutdown_connections 2026-02-18T21:02:22.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.160+0000 7fc3c0290640 1 -- 10.20.193.68:0/1047541210 wait complete. 2026-02-18T21:02:22.168 DEBUG:teuthology.orchestra.run.trial068:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release squid' 2026-02-18T21:02:22.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.234+0000 7f8bbbd53640 1 Processor -- start 2026-02-18T21:02:22.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.234+0000 7f8bbbd53640 1 -- start start 2026-02-18T21:02:22.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.234+0000 7f8bbbd53640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8bb4070af0 0x7f8bb4070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:22.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.234+0000 7f8bbbd53640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8bb412e5a0 0x7f8bb412ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:22.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.234+0000 7f8bbbd53640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb406cb50 con 0x7f8bb4071410 2026-02-18T21:02:22.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.234+0000 7f8bbbd53640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb408e9a0 con 0x7f8bb412e5a0 2026-02-18T21:02:22.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.234+0000 7f8bbbd53640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f8bb408f880 con 0x7f8bb4070af0 2026-02-18T21:02:22.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.234+0000 7f8bb9ac8640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8bb4070af0 0x7f8bb4070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:22.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.234+0000 7f8bb92c7640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f8bb4071410 0x7f8bb412de90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:44652/0 (socket says 10.20.193.68:44652) 2026-02-18T21:02:22.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.234+0000 7f8bba2c9640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8bb412e5a0 0x7f8bb412ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:22.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.234+0000 7f8bb92c7640 1 -- 10.20.193.68:0/3321933582 learned_addr learned my addr 10.20.193.68:0/3321933582 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:22.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.234+0000 7f8bb8ac6640 1 -- 10.20.193.68:0/3321933582 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2686944292 0 0) 0x7f8bb406cb50 con 0x7f8bb4071410 2026-02-18T21:02:22.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.234+0000 7f8bba2c9640 1 -- 10.20.193.68:0/3321933582 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8bb4070af0 msgr2=0x7f8bb4070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:22.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.234+0000 7f8bba2c9640 1 --2- 10.20.193.68:0/3321933582 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8bb4070af0 0x7f8bb4070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:22.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.234+0000 7f8bba2c9640 1 -- 10.20.193.68:0/3321933582 >> v1:10.20.193.68:6789/0 conn(0x7f8bb4071410 legacy=0x7f8bb412de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:22.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.234+0000 7f8bba2c9640 1 -- 10.20.193.68:0/3321933582 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb408fab0 con 0x7f8bb412e5a0 2026-02-18T21:02:22.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.235+0000 7f8bba2c9640 1 --2- 10.20.193.68:0/3321933582 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8bb412e5a0 0x7f8bb412ea10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009dc0 tx=0x7f8bb002f1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca142b40bbf9e1ea server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:22.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.235+0000 7f8bb8ac6640 1 -- 10.20.193.68:0/3321933582 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb003c070 con 0x7f8bb412e5a0 2026-02-18T21:02:22.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.235+0000 7f8bb8ac6640 1 -- 10.20.193.68:0/3321933582 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb0037440 con 0x7f8bb412e5a0 2026-02-18T21:02:22.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.235+0000 7f8bb8ac6640 1 -- 10.20.193.68:0/3321933582 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0037810 con 0x7f8bb412e5a0 2026-02-18T21:02:22.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.235+0000 7f8bbbd53640 1 -- 10.20.193.68:0/3321933582 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8bb412e5a0 msgr2=0x7f8bb412ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:22.236 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.235+0000 7f8bbbd53640 1 --2- 10.20.193.68:0/3321933582 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8bb412e5a0 0x7f8bb412ea10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009dc0 tx=0x7f8bb002f1d0 comp rx=0 tx=0).stop 2026-02-18T21:02:22.236 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.235+0000 7f8bbbd53640 1 -- 10.20.193.68:0/3321933582 shutdown_connections 2026-02-18T21:02:22.236 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.235+0000 7f8bbbd53640 1 --2- 10.20.193.68:0/3321933582 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8bb412e5a0 0x7f8bb412ea10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:22.236 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.235+0000 7f8bbbd53640 1 --2- 10.20.193.68:0/3321933582 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8bb4070af0 0x7f8bb4070ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:22.236 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.235+0000 7f8bbbd53640 1 -- 10.20.193.68:0/3321933582 >> 10.20.193.68:0/3321933582 conn(0x7f8bb409d6a0 msgr2=0x7f8bb409dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:22.236 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.235+0000 7f8bbbd53640 1 -- 10.20.193.68:0/3321933582 shutdown_connections 2026-02-18T21:02:22.236 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.235+0000 7f8bbbd53640 1 -- 10.20.193.68:0/3321933582 wait complete. 2026-02-18T21:02:22.236 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.236+0000 7f8bbbd53640 1 Processor -- start 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.236+0000 7f8bbbd53640 1 -- start start 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.236+0000 7f8bbbd53640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8bb4070af0 0x7f8bb4131d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.236+0000 7f8bbbd53640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8bb4071410 0x7f8bb4132280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.236+0000 7f8bbbd53640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8bb412e5a0 0x7f8bb41327c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.236+0000 7f8bbbd53640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb4136350 con 0x7f8bb412e5a0 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.236+0000 7f8bbbd53640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb41361d0 con 0x7f8bb4070af0 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.236+0000 7f8bbbd53640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f8bb41364d0 con 0x7f8bb4071410 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.236+0000 7f8bb9ac8640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8bb4070af0 0x7f8bb4131d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.236+0000 7f8bb92c7640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8bb4071410 0x7f8bb4132280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.236+0000 7f8bb9ac8640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8bb4070af0 0x7f8bb4131d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42236/0 (socket says 10.20.193.68:42236) 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.236+0000 7f8bb9ac8640 1 -- 10.20.193.68:0/2059729565 learned_addr learned my addr 10.20.193.68:0/2059729565 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.236+0000 7f8bb92c7640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8bb4071410 0x7f8bb4132280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60470/0 (socket says 10.20.193.68:60470) 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.236+0000 7f8bba2c9640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8bb412e5a0 0x7f8bb41327c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.236+0000 7f8bb9ac8640 1 -- 10.20.193.68:0/2059729565 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8bb4071410 msgr2=0x7f8bb4132280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.236+0000 7f8bb9ac8640 1 --2- 10.20.193.68:0/2059729565 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8bb4071410 0x7f8bb4132280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.236+0000 7f8bb9ac8640 1 -- 10.20.193.68:0/2059729565 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8bb412e5a0 msgr2=0x7f8bb41327c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.236+0000 7f8bb9ac8640 1 --2- 10.20.193.68:0/2059729565 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8bb412e5a0 0x7f8bb41327c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.236+0000 7f8bb9ac8640 1 -- 10.20.193.68:0/2059729565 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb4133600 con 0x7f8bb4070af0 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.237+0000 7f8bb9ac8640 1 --2- 10.20.193.68:0/2059729565 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8bb4070af0 0x7f8bb4131d40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400ebe0 tx=0x7f8ba400c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.237+0000 7f8ba27fc640 1 -- 10.20.193.68:0/2059729565 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4017070 con 0x7f8bb4070af0 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.237+0000 7f8ba27fc640 1 -- 10.20.193.68:0/2059729565 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba400cc40 con 0x7f8bb4070af0 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.237+0000 7f8bbbd53640 1 -- 10.20.193.68:0/2059729565 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb4132d00 con 0x7f8bb4070af0 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.237+0000 7f8ba27fc640 1 -- 10.20.193.68:0/2059729565 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba4013470 con 0x7f8bb4070af0 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.237+0000 7f8bbbd53640 1 -- 10.20.193.68:0/2059729565 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb41348c0 con 0x7f8bb4070af0 2026-02-18T21:02:22.237 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.237+0000 7f8bbbd53640 1 -- 10.20.193.68:0/2059729565 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bb41286e0 con 0x7f8bb4070af0 2026-02-18T21:02:22.238 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.237+0000 7f8ba27fc640 1 -- 10.20.193.68:0/2059729565 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f8ba4024060 con 0x7f8bb4070af0 2026-02-18T21:02:22.238 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.238+0000 7f8ba27fc640 1 -- 10.20.193.68:0/2059729565 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(30..30 src has 1..30) ==== 3021+0+0 (secure 0 0 0) 0x7f8ba4066cb0 con 0x7f8bb4070af0 2026-02-18T21:02:22.239 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.240+0000 7f8ba27fc640 1 -- 10.20.193.68:0/2059729565 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f8ba4040a10 con 0x7f8bb4070af0 2026-02-18T21:02:22.315 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:22.315+0000 7f8bbbd53640 1 -- 10.20.193.68:0/2059729565 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd require-osd-release", "release": "squid"} v 0) -- 0x7f8bb409be30 con 0x7f8bb4070af0 2026-02-18T21:02:23.043 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.043+0000 7f8ba27fc640 1 -- 10.20.193.68:0/2059729565 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "squid"}]=0 v31) ==== 91+0+0 (secure 0 0 0) 0x7f8ba4065cd0 con 0x7f8bb4070af0 2026-02-18T21:02:23.045 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.044+0000 7f8bbbd53640 1 -- 10.20.193.68:0/2059729565 >> v1:10.20.193.68:6816/2904515774 conn(0x7f8b8404f790 legacy=0x7f8b84051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:23.045 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.044+0000 7f8bbbd53640 1 -- 10.20.193.68:0/2059729565 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8bb4070af0 msgr2=0x7f8bb4131d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:23.045 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.044+0000 7f8bbbd53640 1 --2- 10.20.193.68:0/2059729565 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8bb4070af0 0x7f8bb4131d40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400ebe0 tx=0x7f8ba400c520 comp rx=0 tx=0).stop 2026-02-18T21:02:23.046 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.044+0000 7f8bbbd53640 1 -- 10.20.193.68:0/2059729565 shutdown_connections 2026-02-18T21:02:23.046 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.044+0000 7f8bbbd53640 1 --2- 10.20.193.68:0/2059729565 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f8bb412e5a0 0x7f8bb41327c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:23.046 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.044+0000 7f8bbbd53640 1 --2- 10.20.193.68:0/2059729565 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8bb4071410 0x7f8bb4132280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:23.046 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.044+0000 7f8bbbd53640 1 --2- 10.20.193.68:0/2059729565 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f8bb4070af0 0x7f8bb4131d40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:23.046 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.044+0000 7f8bbbd53640 1 -- 10.20.193.68:0/2059729565 >> 10.20.193.68:0/2059729565 conn(0x7f8bb409d6a0 msgr2=0x7f8bb406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:23.046 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.044+0000 7f8bbbd53640 1 -- 10.20.193.68:0/2059729565 shutdown_connections 2026-02-18T21:02:23.046 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.044+0000 7f8bbbd53640 1 -- 10.20.193.68:0/2059729565 wait complete. 2026-02-18T21:02:23.053 DEBUG:teuthology.orchestra.run.trial068:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2026-02-18T21:02:23.123 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.118+0000 7fbf62aa2640 1 Processor -- start 2026-02-18T21:02:23.123 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.118+0000 7fbf62aa2640 1 -- start start 2026-02-18T21:02:23.123 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.119+0000 7fbf62aa2640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf5c070880 0x7fbf5c070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:23.123 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.119+0000 7fbf62aa2640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf5c0711a0 0x7fbf5c134800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:23.123 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.119+0000 7fbf62aa2640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf5c09c3c0 con 0x7fbf5c134d40 2026-02-18T21:02:23.123 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.119+0000 7fbf62aa2640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fbf5c073d70 con 0x7fbf5c0711a0 2026-02-18T21:02:23.124 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.119+0000 7fbf62aa2640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fbf5c0737a0 con 0x7fbf5c070880 2026-02-18T21:02:23.124 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.119+0000 7fbf60817640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf5c070880 0x7fbf5c070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:23.124 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.119+0000 7fbf53fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf5c0711a0 0x7fbf5c134800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:23.124 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.119+0000 7fbf61018640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fbf5c134d40 0x7fbf5c137130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:44660/0 (socket says 10.20.193.68:44660) 2026-02-18T21:02:23.124 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.119+0000 7fbf61018640 1 -- 10.20.193.68:0/3809623327 learned_addr learned my addr 10.20.193.68:0/3809623327 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:23.124 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.119+0000 7fbf537fe640 1 -- 10.20.193.68:0/3809623327 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 609855727 0 0) 0x7fbf5c09c3c0 con 0x7fbf5c134d40 2026-02-18T21:02:23.124 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.119+0000 7fbf537fe640 1 -- 10.20.193.68:0/3809623327 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf48003620 con 0x7fbf5c134d40 2026-02-18T21:02:23.124 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.119+0000 7fbf53fff640 1 -- 10.20.193.68:0/3809623327 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf5c070880 msgr2=0x7fbf5c070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:23.124 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.119+0000 7fbf53fff640 1 --2- 10.20.193.68:0/3809623327 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf5c070880 0x7fbf5c070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:23.124 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.119+0000 7fbf53fff640 1 -- 10.20.193.68:0/3809623327 >> v1:10.20.193.68:6789/0 conn(0x7fbf5c134d40 legacy=0x7fbf5c137130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:23.124 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.119+0000 7fbf53fff640 1 -- 10.20.193.68:0/3809623327 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5c071e90 con 0x7fbf5c0711a0 2026-02-18T21:02:23.125 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.119+0000 7fbf60817640 1 --2- 10.20.193.68:0/3809623327 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf5c070880 0x7fbf5c070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:23.125 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.119+0000 7fbf53fff640 1 --2- 10.20.193.68:0/3809623327 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf5c0711a0 0x7fbf5c134800 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c073970 tx=0x7fbf4402edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a3a3785df3f01f server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:23.125 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.119+0000 7fbf537fe640 1 -- 10.20.193.68:0/3809623327 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4403c070 con 0x7fbf5c0711a0 2026-02-18T21:02:23.125 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.120+0000 7fbf537fe640 1 -- 10.20.193.68:0/3809623327 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf4402fa30 con 0x7fbf5c0711a0 2026-02-18T21:02:23.125 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.120+0000 7fbf537fe640 1 -- 10.20.193.68:0/3809623327 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4402fe00 con 0x7fbf5c0711a0 2026-02-18T21:02:23.125 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.120+0000 7fbf62aa2640 1 -- 10.20.193.68:0/3809623327 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf5c0711a0 msgr2=0x7fbf5c134800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:23.125 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.120+0000 7fbf62aa2640 1 --2- 10.20.193.68:0/3809623327 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf5c0711a0 0x7fbf5c134800 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c073970 tx=0x7fbf4402edc0 comp rx=0 tx=0).stop 2026-02-18T21:02:23.125 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.120+0000 7fbf62aa2640 1 -- 10.20.193.68:0/3809623327 shutdown_connections 2026-02-18T21:02:23.125 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.120+0000 7fbf62aa2640 1 --2- 10.20.193.68:0/3809623327 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf5c0711a0 0x7fbf5c134800 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:23.125 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.120+0000 7fbf62aa2640 1 --2- 10.20.193.68:0/3809623327 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf5c070880 0x7fbf5c070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:23.125 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.120+0000 7fbf62aa2640 1 -- 10.20.193.68:0/3809623327 >> 10.20.193.68:0/3809623327 conn(0x7fbf5c09d6a0 msgr2=0x7fbf5c09dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:23.125 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.120+0000 7fbf62aa2640 1 -- 10.20.193.68:0/3809623327 shutdown_connections 2026-02-18T21:02:23.126 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.120+0000 7fbf62aa2640 1 -- 10.20.193.68:0/3809623327 wait complete. 2026-02-18T21:02:23.126 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.120+0000 7fbf62aa2640 1 Processor -- start 2026-02-18T21:02:23.126 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.120+0000 7fbf62aa2640 1 -- start start 2026-02-18T21:02:23.126 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf62aa2640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbf5c070880 0x7fbf5c123710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:23.126 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf62aa2640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf5c0711a0 0x7fbf5c123c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:23.126 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf62aa2640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf5c134d40 0x7fbf5c124190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:23.126 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf62aa2640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c072e90 con 0x7fbf5c070880 2026-02-18T21:02:23.126 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf62aa2640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fbf5c071710 con 0x7fbf5c0711a0 2026-02-18T21:02:23.126 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf62aa2640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fbf5c073010 con 0x7fbf5c134d40 2026-02-18T21:02:23.126 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf53fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf5c0711a0 0x7fbf5c123c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:23.126 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf60817640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbf5c070880 0x7fbf5c123710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:23.126 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf53fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf5c0711a0 0x7fbf5c123c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42256/0 (socket says 10.20.193.68:42256) 2026-02-18T21:02:23.127 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf53fff640 1 -- 10.20.193.68:0/4092926659 learned_addr learned my addr 10.20.193.68:0/4092926659 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:23.127 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf61018640 1 --2- 10.20.193.68:0/4092926659 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf5c134d40 0x7fbf5c124190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:23.127 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf53fff640 1 -- 10.20.193.68:0/4092926659 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf5c134d40 msgr2=0x7fbf5c124190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:23.127 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf53fff640 1 --2- 10.20.193.68:0/4092926659 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf5c134d40 0x7fbf5c124190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:23.127 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf53fff640 1 -- 10.20.193.68:0/4092926659 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbf5c070880 msgr2=0x7fbf5c123710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:23.127 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf53fff640 1 --2- 10.20.193.68:0/4092926659 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbf5c070880 0x7fbf5c123710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:23.127 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf53fff640 1 -- 10.20.193.68:0/4092926659 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5c09a890 con 0x7fbf5c0711a0 2026-02-18T21:02:23.127 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf60817640 1 --2- 10.20.193.68:0/4092926659 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbf5c070880 0x7fbf5c123710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:23.127 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf53fff640 1 --2- 10.20.193.68:0/4092926659 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf5c0711a0 0x7fbf5c123c50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbf4403a040 tx=0x7fbf440047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:23.127 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf517fa640 1 -- 10.20.193.68:0/4092926659 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf44047070 con 0x7fbf5c0711a0 2026-02-18T21:02:23.127 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf517fa640 1 -- 10.20.193.68:0/4092926659 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf44037d80 con 0x7fbf5c0711a0 2026-02-18T21:02:23.127 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf517fa640 1 -- 10.20.193.68:0/4092926659 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4403c040 con 0x7fbf5c0711a0 2026-02-18T21:02:23.128 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf62aa2640 1 -- 10.20.193.68:0/4092926659 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf5c125750 con 0x7fbf5c0711a0 2026-02-18T21:02:23.128 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.121+0000 7fbf62aa2640 1 -- 10.20.193.68:0/4092926659 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf5c124790 con 0x7fbf5c0711a0 2026-02-18T21:02:23.128 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.122+0000 7fbf62aa2640 1 -- 10.20.193.68:0/4092926659 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf5c124ed0 con 0x7fbf5c0711a0 2026-02-18T21:02:23.128 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.122+0000 7fbf517fa640 1 -- 10.20.193.68:0/4092926659 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fbf4403f3c0 con 0x7fbf5c0711a0 2026-02-18T21:02:23.128 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.122+0000 7fbf517fa640 1 -- 10.20.193.68:0/4092926659 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(31..31 src has 1..31) ==== 3025+0+0 (secure 0 0 0) 0x7fbf4408b210 con 0x7fbf5c0711a0 2026-02-18T21:02:23.128 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.124+0000 7fbf517fa640 1 -- 10.20.193.68:0/4092926659 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fbf440650b0 con 0x7fbf5c0711a0 2026-02-18T21:02:23.193 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.193+0000 7fbf62aa2640 1 -- 10.20.193.68:0/4092926659 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd pool ls"} v 0) -- 0x7fbf5c070c60 con 0x7fbf5c0711a0 2026-02-18T21:02:23.193 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.193+0000 7fbf517fa640 1 -- 10.20.193.68:0/4092926659 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v31) ==== 59+0+9 (secure 0 0 0) 0x7fbf44048df0 con 0x7fbf5c0711a0 2026-02-18T21:02:23.194 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.194+0000 7fbf62aa2640 1 -- 10.20.193.68:0/4092926659 >> v1:10.20.193.68:6816/2904515774 conn(0x7fbf2c04f790 legacy=0x7fbf2c051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:23.195 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.194+0000 7fbf62aa2640 1 -- 10.20.193.68:0/4092926659 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf5c0711a0 msgr2=0x7fbf5c123c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:23.195 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.194+0000 7fbf62aa2640 1 --2- 10.20.193.68:0/4092926659 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf5c0711a0 0x7fbf5c123c50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbf4403a040 tx=0x7fbf440047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:23.195 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.194+0000 7fbf62aa2640 1 -- 10.20.193.68:0/4092926659 shutdown_connections 2026-02-18T21:02:23.195 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.194+0000 7fbf62aa2640 1 --2- 10.20.193.68:0/4092926659 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbf5c134d40 0x7fbf5c124190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:23.195 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.194+0000 7fbf62aa2640 1 --2- 10.20.193.68:0/4092926659 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbf5c0711a0 0x7fbf5c123c50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:23.195 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.194+0000 7fbf62aa2640 1 --2- 10.20.193.68:0/4092926659 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbf5c070880 0x7fbf5c123710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:23.195 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.194+0000 7fbf62aa2640 1 -- 10.20.193.68:0/4092926659 >> 10.20.193.68:0/4092926659 conn(0x7fbf5c09d6a0 msgr2=0x7fbf5c137760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:23.195 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.194+0000 7fbf62aa2640 1 -- 10.20.193.68:0/4092926659 shutdown_connections 2026-02-18T21:02:23.195 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.194+0000 7fbf62aa2640 1 -- 10.20.193.68:0/4092926659 wait complete. 2026-02-18T21:02:23.246 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.241+0000 7f21e58df640 1 Processor -- start 2026-02-18T21:02:23.246 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21e58df640 1 -- start start 2026-02-18T21:02:23.246 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21e58df640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f21e012c350 0x7f21e012c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:23.246 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21e58df640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f21e012cc70 0x7f21e009b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:23.246 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21e58df640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f21e009b9f0 0x7f21e009be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:23.246 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21e58df640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f21e006ca90 con 0x7f21e012c350 2026-02-18T21:02:23.246 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21e58df640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f21e012d0d0 con 0x7f21e012cc70 2026-02-18T21:02:23.246 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21e58df640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f21e0073880 con 0x7f21e009b9f0 2026-02-18T21:02:23.247 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21deffd640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f21e012c350 0x7f21e012c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:23.247 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21de7fc640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f21e012cc70 0x7f21e009b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:23.247 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21deffd640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f21e012c350 0x7f21e012c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:38696/0 (socket says 10.20.193.68:38696) 2026-02-18T21:02:23.247 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21df7fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f21e009b9f0 0x7f21e009be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:23.247 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21deffd640 1 -- 10.20.193.68:0/3995714450 learned_addr learned my addr 10.20.193.68:0/3995714450 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:23.247 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21de7fc640 1 -- 10.20.193.68:0/3995714450 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f21e009b9f0 msgr2=0x7f21e009be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:23.247 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21de7fc640 1 --2- 10.20.193.68:0/3995714450 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f21e009b9f0 0x7f21e009be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:23.247 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21de7fc640 1 -- 10.20.193.68:0/3995714450 >> v2:10.20.193.68:3300/0 conn(0x7f21e012c350 msgr2=0x7f21e012c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:23.247 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21de7fc640 1 --2- 10.20.193.68:0/3995714450 >> v2:10.20.193.68:3300/0 conn(0x7f21e012c350 0x7f21e012c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:23.247 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21de7fc640 1 -- 10.20.193.68:0/3995714450 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e0073e20 con 0x7f21e012cc70 2026-02-18T21:02:23.247 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21deffd640 1 --2- 10.20.193.68:0/3995714450 >> v2:10.20.193.68:3300/0 conn(0x7f21e012c350 0x7f21e012c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:23.247 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21de7fc640 1 --2- 10.20.193.68:0/3995714450 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f21e012cc70 0x7f21e009b4b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f21c800aa80 tx=0x7f21c8030210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91211d9ee5bd4d5f server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:23.248 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21ddffb640 1 -- 10.20.193.68:0/3995714450 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c803d070 con 0x7f21e012cc70 2026-02-18T21:02:23.248 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21ddffb640 1 -- 10.20.193.68:0/3995714450 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c8038440 con 0x7f21e012cc70 2026-02-18T21:02:23.248 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.242+0000 7f21ddffb640 1 -- 10.20.193.68:0/3995714450 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c8038810 con 0x7f21e012cc70 2026-02-18T21:02:23.248 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.243+0000 7f21e58df640 1 -- 10.20.193.68:0/3995714450 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f21e012cc70 msgr2=0x7f21e009b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:23.248 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.243+0000 7f21e58df640 1 --2- 10.20.193.68:0/3995714450 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f21e012cc70 0x7f21e009b4b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f21c800aa80 tx=0x7f21c8030210 comp rx=0 tx=0).stop 2026-02-18T21:02:23.248 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.243+0000 7f21e58df640 1 -- 10.20.193.68:0/3995714450 shutdown_connections 2026-02-18T21:02:23.248 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.243+0000 7f21e58df640 1 --2- 10.20.193.68:0/3995714450 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f21e012cc70 0x7f21e009b4b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:23.248 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.243+0000 7f21e58df640 1 --2- 10.20.193.68:0/3995714450 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f21e009b9f0 0x7f21e009be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:23.248 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.243+0000 7f21e58df640 1 --2- 10.20.193.68:0/3995714450 >> v2:10.20.193.68:3300/0 conn(0x7f21e012c350 0x7f21e012c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:23.248 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.243+0000 7f21e58df640 1 -- 10.20.193.68:0/3995714450 >> 10.20.193.68:0/3995714450 conn(0x7f21e009dec0 msgr2=0x7f21e006f520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:23.248 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.243+0000 7f21e58df640 1 -- 10.20.193.68:0/3995714450 shutdown_connections 2026-02-18T21:02:23.248 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.243+0000 7f21e58df640 1 -- 10.20.193.68:0/3995714450 wait complete. 2026-02-18T21:02:23.249 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.243+0000 7f21e58df640 1 Processor -- start 2026-02-18T21:02:23.249 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.243+0000 7f21e58df640 1 -- start start 2026-02-18T21:02:23.249 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21e58df640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f21e009b9f0 0x7f21e0123a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:23.249 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21e58df640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f21e012c350 0x7f21e0123fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:23.249 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21e58df640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f21e012cc70 0x7f21e0124510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:23.249 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21e58df640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f21e0070fd0 con 0x7f21e012cc70 2026-02-18T21:02:23.249 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21e58df640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f21e0070e50 con 0x7f21e012c350 2026-02-18T21:02:23.249 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21e58df640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f21e0071150 con 0x7f21e009b9f0 2026-02-18T21:02:23.249 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21deffd640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f21e009b9f0 0x7f21e0123a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:23.249 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21de7fc640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f21e012c350 0x7f21e0123fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:23.249 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21de7fc640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f21e012c350 0x7f21e0123fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42272/0 (socket says 10.20.193.68:42272) 2026-02-18T21:02:23.249 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21deffd640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f21e009b9f0 0x7f21e0123a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60500/0 (socket says 10.20.193.68:60500) 2026-02-18T21:02:23.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21deffd640 1 -- 10.20.193.68:0/2795840819 learned_addr learned my addr 10.20.193.68:0/2795840819 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:23.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21df7fe640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f21e012cc70 0x7f21e0124510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:23.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21de7fc640 1 -- 10.20.193.68:0/2795840819 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f21e009b9f0 msgr2=0x7f21e0123a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:23.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21de7fc640 1 --2- 10.20.193.68:0/2795840819 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f21e009b9f0 0x7f21e0123a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:23.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21de7fc640 1 -- 10.20.193.68:0/2795840819 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f21e012cc70 msgr2=0x7f21e0124510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:23.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21de7fc640 1 --2- 10.20.193.68:0/2795840819 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f21e012cc70 0x7f21e0124510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:23.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21de7fc640 1 -- 10.20.193.68:0/2795840819 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e00977d0 con 0x7f21e012c350 2026-02-18T21:02:23.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21df7fe640 1 --2- 10.20.193.68:0/2795840819 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f21e012cc70 0x7f21e0124510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:23.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21de7fc640 1 --2- 10.20.193.68:0/2795840819 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f21e012c350 0x7f21e0123fd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f21c8037000 tx=0x7f21c80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:23.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21b7fff640 1 -- 10.20.193.68:0/2795840819 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c803d070 con 0x7f21e012c350 2026-02-18T21:02:23.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21b7fff640 1 -- 10.20.193.68:0/2795840819 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c8039500 con 0x7f21e012c350 2026-02-18T21:02:23.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21b7fff640 1 -- 10.20.193.68:0/2795840819 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c8038830 con 0x7f21e012c350 2026-02-18T21:02:23.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21e58df640 1 -- 10.20.193.68:0/2795840819 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e0124a50 con 0x7f21e012c350 2026-02-18T21:02:23.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21e58df640 1 -- 10.20.193.68:0/2795840819 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e01cd630 con 0x7f21e012c350 2026-02-18T21:02:23.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.244+0000 7f21e58df640 1 -- 10.20.193.68:0/2795840819 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21e012c730 con 0x7f21e012c350 2026-02-18T21:02:23.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.245+0000 7f21b7fff640 1 -- 10.20.193.68:0/2795840819 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f21c80389d0 con 0x7f21e012c350 2026-02-18T21:02:23.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.245+0000 7f21b7fff640 1 -- 10.20.193.68:0/2795840819 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(31..31 src has 1..31) ==== 3025+0+0 (secure 0 0 0) 0x7f21c808bdf0 con 0x7f21e012c350 2026-02-18T21:02:23.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.247+0000 7f21b7fff640 1 -- 10.20.193.68:0/2795840819 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f21c800b040 con 0x7f21e012c350 2026-02-18T21:02:23.319 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:23.319+0000 7f21e58df640 1 -- 10.20.193.68:0/2795840819 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"} v 0) -- 0x7f21e00969e0 con 0x7f21e012c350 2026-02-18T21:02:24.045 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.045+0000 7f21b7fff640 1 -- 10.20.193.68:0/2795840819 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v32) ==== 153+0+0 (secure 0 0 0) 0x7f21c8065bc0 con 0x7f21e012c350 2026-02-18T21:02:24.046 INFO:teuthology.orchestra.run.trial068.stderr:set pool 1 pg_autoscale_mode to off 2026-02-18T21:02:24.047 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.046+0000 7f21e58df640 1 -- 10.20.193.68:0/2795840819 >> v1:10.20.193.68:6816/2904515774 conn(0x7f21b004f790 legacy=0x7f21b0051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:24.047 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.046+0000 7f21e58df640 1 -- 10.20.193.68:0/2795840819 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f21e012c350 msgr2=0x7f21e0123fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:24.047 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.046+0000 7f21e58df640 1 --2- 10.20.193.68:0/2795840819 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f21e012c350 0x7f21e0123fd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f21c8037000 tx=0x7f21c80047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:24.047 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.047+0000 7f21e58df640 1 -- 10.20.193.68:0/2795840819 shutdown_connections 2026-02-18T21:02:24.048 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.047+0000 7f21e58df640 1 --2- 10.20.193.68:0/2795840819 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f21e012cc70 0x7f21e0124510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:24.048 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.047+0000 7f21e58df640 1 --2- 10.20.193.68:0/2795840819 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f21e012c350 0x7f21e0123fd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:24.048 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.047+0000 7f21e58df640 1 --2- 10.20.193.68:0/2795840819 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f21e009b9f0 0x7f21e0123a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:24.048 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.047+0000 7f21e58df640 1 -- 10.20.193.68:0/2795840819 >> 10.20.193.68:0/2795840819 conn(0x7f21e009dec0 msgr2=0x7f21e012ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:24.048 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.047+0000 7f21e58df640 1 -- 10.20.193.68:0/2795840819 shutdown_connections 2026-02-18T21:02:24.048 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.047+0000 7f21e58df640 1 -- 10.20.193.68:0/2795840819 wait complete. 2026-02-18T21:02:24.101 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.097+0000 7fbcfb438640 1 Processor -- start 2026-02-18T21:02:24.102 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.097+0000 7fbcfb438640 1 -- start start 2026-02-18T21:02:24.102 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.097+0000 7fbcfb438640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcf40719d0 0x7fbcf4071db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:24.102 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.097+0000 7fbcfb438640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fbcf4130920 0x7fbcf4130db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:24.102 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.097+0000 7fbcfb438640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf4073750 con 0x7fbcf40722f0 2026-02-18T21:02:24.102 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.097+0000 7fbcfb438640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf4073e50 con 0x7fbcf4130920 2026-02-18T21:02:24.102 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.097+0000 7fbcfb438640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fbcf4072fe0 con 0x7fbcf40719d0 2026-02-18T21:02:24.102 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.097+0000 7fbcf91ad640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcf40719d0 0x7fbcf4071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:24.102 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.097+0000 7fbcf99ae640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fbcf4130920 0x7fbcf4130db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:24.102 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.097+0000 7fbcf91ad640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcf40719d0 0x7fbcf4071db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60504/0 (socket says 10.20.193.68:60504) 2026-02-18T21:02:24.103 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.097+0000 7fbcf91ad640 1 -- 10.20.193.68:0/3197162126 learned_addr learned my addr 10.20.193.68:0/3197162126 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:24.103 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.097+0000 7fbcf91ad640 1 -- 10.20.193.68:0/3197162126 >> v2:10.20.193.68:3300/0 conn(0x7fbcf4130920 msgr2=0x7fbcf4130db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:24.103 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.097+0000 7fbcf91ad640 1 --2- 10.20.193.68:0/3197162126 >> v2:10.20.193.68:3300/0 conn(0x7fbcf4130920 0x7fbcf4130db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:24.103 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.097+0000 7fbcf91ad640 1 -- 10.20.193.68:0/3197162126 >> v1:10.20.193.68:6789/0 conn(0x7fbcf40722f0 legacy=0x7fbcf4130210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:24.103 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.097+0000 7fbcf91ad640 1 -- 10.20.193.68:0/3197162126 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf4072730 con 0x7fbcf40719d0 2026-02-18T21:02:24.103 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.098+0000 7fbcf91ad640 1 --2- 10.20.193.68:0/3197162126 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcf40719d0 0x7fbcf4071db0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbce4009970 tx=0x7fbce402ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=375b4668b56ad16f server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:24.103 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.098+0000 7fbce3fff640 1 -- 10.20.193.68:0/3197162126 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce403c070 con 0x7fbcf40719d0 2026-02-18T21:02:24.103 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.098+0000 7fbce3fff640 1 -- 10.20.193.68:0/3197162126 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce402fb10 con 0x7fbcf40719d0 2026-02-18T21:02:24.103 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.098+0000 7fbce3fff640 1 -- 10.20.193.68:0/3197162126 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce4037440 con 0x7fbcf40719d0 2026-02-18T21:02:24.103 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.098+0000 7fbcfb438640 1 -- 10.20.193.68:0/3197162126 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcf40719d0 msgr2=0x7fbcf4071db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:24.104 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.098+0000 7fbcfb438640 1 --2- 10.20.193.68:0/3197162126 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcf40719d0 0x7fbcf4071db0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbce4009970 tx=0x7fbce402ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:24.104 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.098+0000 7fbcfb438640 1 -- 10.20.193.68:0/3197162126 shutdown_connections 2026-02-18T21:02:24.104 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.098+0000 7fbcfb438640 1 --2- 10.20.193.68:0/3197162126 >> v2:10.20.193.68:3300/0 conn(0x7fbcf4130920 0x7fbcf4130db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:24.104 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.098+0000 7fbcfb438640 1 --2- 10.20.193.68:0/3197162126 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcf40719d0 0x7fbcf4071db0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:24.104 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.098+0000 7fbcfb438640 1 -- 10.20.193.68:0/3197162126 >> 10.20.193.68:0/3197162126 conn(0x7fbcf406d970 msgr2=0x7fbcf406fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:24.104 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.098+0000 7fbcfb438640 1 -- 10.20.193.68:0/3197162126 shutdown_connections 2026-02-18T21:02:24.104 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.098+0000 7fbcfb438640 1 -- 10.20.193.68:0/3197162126 wait complete. 2026-02-18T21:02:24.104 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcfb438640 1 Processor -- start 2026-02-18T21:02:24.104 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcfb438640 1 -- start start 2026-02-18T21:02:24.104 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcfb438640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcf40719d0 0x7fbcf412b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:24.105 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcfb438640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbcf40722f0 0x7fbcf412b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:24.105 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcfb438640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbcf4130920 0x7fbcf412bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:24.105 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcfb438640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf41388e0 con 0x7fbcf40722f0 2026-02-18T21:02:24.105 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcfb438640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf4138760 con 0x7fbcf4130920 2026-02-18T21:02:24.105 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcfb438640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fbcf4138a60 con 0x7fbcf40719d0 2026-02-18T21:02:24.105 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcf91ad640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcf40719d0 0x7fbcf412b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:24.105 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcf91ad640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcf40719d0 0x7fbcf412b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60510/0 (socket says 10.20.193.68:60510) 2026-02-18T21:02:24.105 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcf91ad640 1 -- 10.20.193.68:0/2274553384 learned_addr learned my addr 10.20.193.68:0/2274553384 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:24.105 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcf89ac640 1 --2- 10.20.193.68:0/2274553384 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbcf40722f0 0x7fbcf412b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:24.105 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcf99ae640 1 --2- 10.20.193.68:0/2274553384 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbcf4130920 0x7fbcf412bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:24.105 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcf91ad640 1 -- 10.20.193.68:0/2274553384 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbcf4130920 msgr2=0x7fbcf412bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:24.106 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcf91ad640 1 --2- 10.20.193.68:0/2274553384 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbcf4130920 0x7fbcf412bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:24.106 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcf91ad640 1 -- 10.20.193.68:0/2274553384 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbcf40722f0 msgr2=0x7fbcf412b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:24.106 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcf91ad640 1 --2- 10.20.193.68:0/2274553384 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbcf40722f0 0x7fbcf412b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:24.106 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcf91ad640 1 -- 10.20.193.68:0/2274553384 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf4137b90 con 0x7fbcf40719d0 2026-02-18T21:02:24.106 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcf99ae640 1 --2- 10.20.193.68:0/2274553384 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbcf4130920 0x7fbcf412bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-18T21:02:24.106 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcf91ad640 1 --2- 10.20.193.68:0/2274553384 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcf40719d0 0x7fbcf412b490 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbce4002410 tx=0x7fbce40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:24.106 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbce1ffb640 1 -- 10.20.193.68:0/2274553384 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce403c040 con 0x7fbcf40719d0 2026-02-18T21:02:24.106 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbce1ffb640 1 -- 10.20.193.68:0/2274553384 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce4042450 con 0x7fbcf40719d0 2026-02-18T21:02:24.106 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcfb438640 1 -- 10.20.193.68:0/2274553384 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf412cf40 con 0x7fbcf40719d0 2026-02-18T21:02:24.106 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbce1ffb640 1 -- 10.20.193.68:0/2274553384 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce4042840 con 0x7fbcf40719d0 2026-02-18T21:02:24.106 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.099+0000 7fbcfb438640 1 -- 10.20.193.68:0/2274553384 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf41312a0 con 0x7fbcf40719d0 2026-02-18T21:02:24.107 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.100+0000 7fbcfb438640 1 -- 10.20.193.68:0/2274553384 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf4071db0 con 0x7fbcf40719d0 2026-02-18T21:02:24.107 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.100+0000 7fbce1ffb640 1 -- 10.20.193.68:0/2274553384 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fbce404b410 con 0x7fbcf40719d0 2026-02-18T21:02:24.107 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.100+0000 7fbce1ffb640 1 -- 10.20.193.68:0/2274553384 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(32..32 src has 1..32) ==== 3025+0+0 (secure 0 0 0) 0x7fbce408b940 con 0x7fbcf40719d0 2026-02-18T21:02:24.107 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.102+0000 7fbce1ffb640 1 -- 10.20.193.68:0/2274553384 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fbce4050020 con 0x7fbcf40719d0 2026-02-18T21:02:24.171 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:24.171+0000 7fbcfb438640 1 -- 10.20.193.68:0/2274553384 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) -- 0x7fbcf4076360 con 0x7fbcf40719d0 2026-02-18T21:02:25.048 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.048+0000 7fbce1ffb640 1 -- 10.20.193.68:0/2274553384 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v33) ==== 152+0+0 (secure 0 0 0) 0x7fbce40657e0 con 0x7fbcf40719d0 2026-02-18T21:02:25.049 INFO:teuthology.orchestra.run.trial068.stderr:set pool 2 pg_autoscale_mode to off 2026-02-18T21:02:25.050 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.049+0000 7fbcfb438640 1 -- 10.20.193.68:0/2274553384 >> v1:10.20.193.68:6816/2904515774 conn(0x7fbcc404f790 legacy=0x7fbcc4051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.050 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.049+0000 7fbcfb438640 1 -- 10.20.193.68:0/2274553384 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcf40719d0 msgr2=0x7fbcf412b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.050 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.049+0000 7fbcfb438640 1 --2- 10.20.193.68:0/2274553384 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcf40719d0 0x7fbcf412b490 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbce4002410 tx=0x7fbce40047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.050 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.049+0000 7fbcfb438640 1 -- 10.20.193.68:0/2274553384 shutdown_connections 2026-02-18T21:02:25.050 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.049+0000 7fbcfb438640 1 --2- 10.20.193.68:0/2274553384 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fbcf4130920 0x7fbcf412bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.050 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.049+0000 7fbcfb438640 1 --2- 10.20.193.68:0/2274553384 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fbcf40722f0 0x7fbcf412b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.050 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.049+0000 7fbcfb438640 1 --2- 10.20.193.68:0/2274553384 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fbcf40719d0 0x7fbcf412b490 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.051 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.049+0000 7fbcfb438640 1 -- 10.20.193.68:0/2274553384 >> 10.20.193.68:0/2274553384 conn(0x7fbcf406d970 msgr2=0x7fbcf406dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.051 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.049+0000 7fbcfb438640 1 -- 10.20.193.68:0/2274553384 shutdown_connections 2026-02-18T21:02:25.051 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.049+0000 7fbcfb438640 1 -- 10.20.193.68:0/2274553384 wait complete. 2026-02-18T21:02:25.058 INFO:teuthology.run_tasks:Running task ceph.healthy... 2026-02-18T21:02:25.075 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-18T21:02:25.075 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-18T21:02:25.075 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-18T21:02:25.148 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.144+0000 7f61620e9640 1 Processor -- start 2026-02-18T21:02:25.148 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.144+0000 7f61620e9640 1 -- start start 2026-02-18T21:02:25.148 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.144+0000 7f61620e9640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f615c114bb0 0x7f615c114f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.144+0000 7f61620e9640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f615c1154d0 0x7f615c1304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.144+0000 7f61620e9640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f615c1309e0 0x7f615c130e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.144+0000 7f61620e9640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f615c0716e0 con 0x7f615c114bb0 2026-02-18T21:02:25.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.144+0000 7f61620e9640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f615c071400 con 0x7f615c1154d0 2026-02-18T21:02:25.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.144+0000 7f61620e9640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f615c09e090 con 0x7f615c1309e0 2026-02-18T21:02:25.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.144+0000 7f615b7fe640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f615c114bb0 0x7f615c114f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.144+0000 7f615affd640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f615c1154d0 0x7f615c1304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.144+0000 7f615bfff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f615c1309e0 0x7f615c130e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.144+0000 7f615affd640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f615c1154d0 0x7f615c1304a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42292/0 (socket says 10.20.193.68:42292) 2026-02-18T21:02:25.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.144+0000 7f615affd640 1 -- 10.20.193.68:0/2544974844 learned_addr learned my addr 10.20.193.68:0/2544974844 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.150 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.144+0000 7f615affd640 1 -- 10.20.193.68:0/2544974844 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f615c1309e0 msgr2=0x7f615c130e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:25.150 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.144+0000 7f615affd640 1 --2- 10.20.193.68:0/2544974844 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f615c1309e0 0x7f615c130e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.150 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.144+0000 7f615affd640 1 -- 10.20.193.68:0/2544974844 >> v2:10.20.193.68:3300/0 conn(0x7f615c114bb0 msgr2=0x7f615c114f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:25.150 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.144+0000 7f615affd640 1 --2- 10.20.193.68:0/2544974844 >> v2:10.20.193.68:3300/0 conn(0x7f615c114bb0 0x7f615c114f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.150 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.144+0000 7f615affd640 1 -- 10.20.193.68:0/2544974844 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f615c071ca0 con 0x7f615c1154d0 2026-02-18T21:02:25.150 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.145+0000 7f615affd640 1 --2- 10.20.193.68:0/2544974844 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f615c1154d0 0x7f615c1304a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f614c009970 tx=0x7f614c02ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5754c7df20ca43a3 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.150 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.145+0000 7f615a7fc640 1 -- 10.20.193.68:0/2544974844 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c03c070 con 0x7f615c1154d0 2026-02-18T21:02:25.150 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.145+0000 7f615a7fc640 1 -- 10.20.193.68:0/2544974844 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614c02fac0 con 0x7f615c1154d0 2026-02-18T21:02:25.150 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.145+0000 7f615a7fc640 1 -- 10.20.193.68:0/2544974844 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614c037440 con 0x7f615c1154d0 2026-02-18T21:02:25.150 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.145+0000 7f61620e9640 1 -- 10.20.193.68:0/2544974844 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f615c1154d0 msgr2=0x7f615c1304a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.150 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.145+0000 7f61620e9640 1 --2- 10.20.193.68:0/2544974844 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f615c1154d0 0x7f615c1304a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f614c009970 tx=0x7f614c02ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:25.150 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.145+0000 7f61620e9640 1 -- 10.20.193.68:0/2544974844 shutdown_connections 2026-02-18T21:02:25.150 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.145+0000 7f61620e9640 1 --2- 10.20.193.68:0/2544974844 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f615c1154d0 0x7f615c1304a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.151 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.145+0000 7f61620e9640 1 --2- 10.20.193.68:0/2544974844 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f615c1309e0 0x7f615c130e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.151 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.145+0000 7f61620e9640 1 --2- 10.20.193.68:0/2544974844 >> v2:10.20.193.68:3300/0 conn(0x7f615c114bb0 0x7f615c114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.151 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.145+0000 7f61620e9640 1 -- 10.20.193.68:0/2544974844 >> 10.20.193.68:0/2544974844 conn(0x7f615c09cee0 msgr2=0x7f615c09d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.151 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.145+0000 7f61620e9640 1 -- 10.20.193.68:0/2544974844 shutdown_connections 2026-02-18T21:02:25.151 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.145+0000 7f61620e9640 1 -- 10.20.193.68:0/2544974844 wait complete. 2026-02-18T21:02:25.151 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f61620e9640 1 Processor -- start 2026-02-18T21:02:25.151 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f61620e9640 1 -- start start 2026-02-18T21:02:25.151 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f61620e9640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f615c114bb0 0x7f615c11eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.151 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f61620e9640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f615c1154d0 0x7f615c11f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.151 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f61620e9640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f615c1309e0 0x7f615c11fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.151 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f61620e9640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f615c1376f0 con 0x7f615c1154d0 2026-02-18T21:02:25.151 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f61620e9640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f615c1158e0 con 0x7f615c114bb0 2026-02-18T21:02:25.152 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f61620e9640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f615c137870 con 0x7f615c1309e0 2026-02-18T21:02:25.152 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f615b7fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f615c114bb0 0x7f615c11eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.152 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f615affd640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f615c1154d0 0x7f615c11f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.152 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f615bfff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f615c1309e0 0x7f615c11fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.152 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f615affd640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f615c1154d0 0x7f615c11f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:38724/0 (socket says 10.20.193.68:38724) 2026-02-18T21:02:25.152 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f615affd640 1 -- 10.20.193.68:0/2841216687 learned_addr learned my addr 10.20.193.68:0/2841216687 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.152 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f615b7fe640 1 -- 10.20.193.68:0/2841216687 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f615c1309e0 msgr2=0x7f615c11fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.152 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f615b7fe640 1 --2- 10.20.193.68:0/2841216687 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f615c1309e0 0x7f615c11fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.152 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f615b7fe640 1 -- 10.20.193.68:0/2841216687 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f615c1154d0 msgr2=0x7f615c11f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.152 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f615b7fe640 1 --2- 10.20.193.68:0/2841216687 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f615c1154d0 0x7f615c11f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.152 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f615b7fe640 1 -- 10.20.193.68:0/2841216687 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f615c121980 con 0x7f615c114bb0 2026-02-18T21:02:25.152 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f615affd640 1 --2- 10.20.193.68:0/2841216687 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f615c1154d0 0x7f615c11f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:25.153 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f615bfff640 1 --2- 10.20.193.68:0/2841216687 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f615c1309e0 0x7f615c11fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:25.153 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f615b7fe640 1 --2- 10.20.193.68:0/2841216687 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f615c114bb0 0x7f615c11eff0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f614800e9b0 tx=0x7f614800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.153 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f6137fff640 1 -- 10.20.193.68:0/2841216687 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6148017070 con 0x7f615c114bb0 2026-02-18T21:02:25.153 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f6137fff640 1 -- 10.20.193.68:0/2841216687 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f614800ca00 con 0x7f615c114bb0 2026-02-18T21:02:25.153 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f61620e9640 1 -- 10.20.193.68:0/2841216687 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f615c073760 con 0x7f615c114bb0 2026-02-18T21:02:25.153 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f6137fff640 1 -- 10.20.193.68:0/2841216687 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614800cdf0 con 0x7f615c114bb0 2026-02-18T21:02:25.153 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.146+0000 7f61620e9640 1 -- 10.20.193.68:0/2841216687 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f615c121190 con 0x7f615c114bb0 2026-02-18T21:02:25.153 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.147+0000 7f61620e9640 1 -- 10.20.193.68:0/2841216687 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f615c1304a0 con 0x7f615c114bb0 2026-02-18T21:02:25.153 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.147+0000 7f6137fff640 1 -- 10.20.193.68:0/2841216687 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f6148024060 con 0x7f615c114bb0 2026-02-18T21:02:25.153 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.148+0000 7f6137fff640 1 -- 10.20.193.68:0/2841216687 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f6148066b60 con 0x7f615c114bb0 2026-02-18T21:02:25.154 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.149+0000 7f6137fff640 1 -- 10.20.193.68:0/2841216687 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f615c121980 con 0x7f615c114bb0 2026-02-18T21:02:25.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.234+0000 7f61620e9640 1 -- 10.20.193.68:0/2841216687 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f615c069ef0 con 0x7f615c114bb0 2026-02-18T21:02:25.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.235+0000 7f6137fff640 1 -- 10.20.193.68:0/2841216687 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v10) ==== 74+0+121454 (secure 0 0 0) 0x7f6148040950 con 0x7f615c114bb0 2026-02-18T21:02:25.237 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:25.238 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.236+0000 7f61620e9640 1 -- 10.20.193.68:0/2841216687 >> v1:10.20.193.68:6816/2904515774 conn(0x7f612c04f7c0 legacy=0x7f612c051c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.238 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.236+0000 7f61620e9640 1 -- 10.20.193.68:0/2841216687 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f615c114bb0 msgr2=0x7f615c11eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.238 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.236+0000 7f61620e9640 1 --2- 10.20.193.68:0/2841216687 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f615c114bb0 0x7f615c11eff0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f614800e9b0 tx=0x7f614800ee80 comp rx=0 tx=0).stop 2026-02-18T21:02:25.238 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.236+0000 7f61620e9640 1 -- 10.20.193.68:0/2841216687 shutdown_connections 2026-02-18T21:02:25.238 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.236+0000 7f61620e9640 1 --2- 10.20.193.68:0/2841216687 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f615c1309e0 0x7f615c11fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.239 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.236+0000 7f61620e9640 1 --2- 10.20.193.68:0/2841216687 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f615c1154d0 0x7f615c11f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.239 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.236+0000 7f61620e9640 1 --2- 10.20.193.68:0/2841216687 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f615c114bb0 0x7f615c11eff0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.239 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.236+0000 7f61620e9640 1 -- 10.20.193.68:0/2841216687 >> 10.20.193.68:0/2841216687 conn(0x7f615c09cee0 msgr2=0x7f615c06fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.239 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.236+0000 7f61620e9640 1 -- 10.20.193.68:0/2841216687 shutdown_connections 2026-02-18T21:02:25.239 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.236+0000 7f61620e9640 1 -- 10.20.193.68:0/2841216687 wait complete. 2026-02-18T21:02:25.245 INFO:teuthology.orchestra.run.trial068.stdout:{"epoch":10,"flags":0,"active_gid":14114,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6816","nonce":2904515774}]},"active_addr":"10.20.193.68:6816/2904515774","active_change":"2026-02-18T21:02:04.994512+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14098,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":20,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.68:0","nonce":3190848129}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.68:0","nonce":1922569099}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.68:0","nonce":831028752}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.68:0","nonce":89311403}]}]} 2026-02-18T21:02:25.249 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-18T21:02:25.249 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-18T21:02:25.250 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-18T21:02:25.321 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.316+0000 7f839fc66640 1 Processor -- start 2026-02-18T21:02:25.321 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.316+0000 7f839fc66640 1 -- start start 2026-02-18T21:02:25.321 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.317+0000 7f839fc66640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8398114bb0 0x7f8398114f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.321 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.317+0000 7f839fc66640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f83981154d0 0x7f83981304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.321 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.317+0000 7f839fc66640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f83981309e0 0x7f8398130e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.321 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.317+0000 7f839fc66640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f83980716e0 con 0x7f83981309e0 2026-02-18T21:02:25.321 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.317+0000 7f839fc66640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f8398071400 con 0x7f83981154d0 2026-02-18T21:02:25.321 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.317+0000 7f839fc66640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f839809e090 con 0x7f8398114bb0 2026-02-18T21:02:25.322 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.317+0000 7f839d1da640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f83981154d0 0x7f83981304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.322 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.317+0000 7f839d9db640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8398114bb0 0x7f8398114f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.322 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.317+0000 7f839e1dc640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f83981309e0 0x7f8398130e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.322 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.317+0000 7f839d1da640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f83981154d0 0x7f83981304a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42324/0 (socket says 10.20.193.68:42324) 2026-02-18T21:02:25.322 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.317+0000 7f839d1da640 1 -- 10.20.193.68:0/4003181139 learned_addr learned my addr 10.20.193.68:0/4003181139 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.322 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.317+0000 7f839d1da640 1 -- 10.20.193.68:0/4003181139 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8398114bb0 msgr2=0x7f8398114f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:25.322 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.317+0000 7f839d1da640 1 --2- 10.20.193.68:0/4003181139 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8398114bb0 0x7f8398114f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.322 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.317+0000 7f839d1da640 1 -- 10.20.193.68:0/4003181139 >> v2:10.20.193.68:3300/0 conn(0x7f83981309e0 msgr2=0x7f8398130e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:25.322 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.317+0000 7f839d1da640 1 --2- 10.20.193.68:0/4003181139 >> v2:10.20.193.68:3300/0 conn(0x7f83981309e0 0x7f8398130e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.322 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.317+0000 7f839d1da640 1 -- 10.20.193.68:0/4003181139 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8398071ca0 con 0x7f83981154d0 2026-02-18T21:02:25.322 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.317+0000 7f839d9db640 1 --2- 10.20.193.68:0/4003181139 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8398114bb0 0x7f8398114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:25.323 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.317+0000 7f839d1da640 1 --2- 10.20.193.68:0/4003181139 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f83981154d0 0x7f83981304a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f838c009970 tx=0x7f838c02ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=113e8e7cfeff7a79 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.323 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.318+0000 7f839c9d9640 1 -- 10.20.193.68:0/4003181139 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c03c070 con 0x7f83981154d0 2026-02-18T21:02:25.323 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.318+0000 7f839c9d9640 1 -- 10.20.193.68:0/4003181139 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f838c02fac0 con 0x7f83981154d0 2026-02-18T21:02:25.323 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.318+0000 7f839c9d9640 1 -- 10.20.193.68:0/4003181139 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f838c037440 con 0x7f83981154d0 2026-02-18T21:02:25.323 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.318+0000 7f839fc66640 1 -- 10.20.193.68:0/4003181139 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f83981154d0 msgr2=0x7f83981304a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.323 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.318+0000 7f839fc66640 1 --2- 10.20.193.68:0/4003181139 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f83981154d0 0x7f83981304a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f838c009970 tx=0x7f838c02ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:25.323 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.318+0000 7f839fc66640 1 -- 10.20.193.68:0/4003181139 shutdown_connections 2026-02-18T21:02:25.323 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.318+0000 7f839fc66640 1 --2- 10.20.193.68:0/4003181139 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f83981154d0 0x7f83981304a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.323 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.318+0000 7f839fc66640 1 --2- 10.20.193.68:0/4003181139 >> v2:10.20.193.68:3300/0 conn(0x7f83981309e0 0x7f8398130e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.323 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.318+0000 7f839fc66640 1 --2- 10.20.193.68:0/4003181139 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8398114bb0 0x7f8398114f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.323 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.318+0000 7f839fc66640 1 -- 10.20.193.68:0/4003181139 >> 10.20.193.68:0/4003181139 conn(0x7f839809cee0 msgr2=0x7f839809d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.323 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.318+0000 7f839fc66640 1 -- 10.20.193.68:0/4003181139 shutdown_connections 2026-02-18T21:02:25.324 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.318+0000 7f839fc66640 1 -- 10.20.193.68:0/4003181139 wait complete. 2026-02-18T21:02:25.324 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.318+0000 7f839fc66640 1 Processor -- start 2026-02-18T21:02:25.324 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.318+0000 7f839fc66640 1 -- start start 2026-02-18T21:02:25.324 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f839fc66640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8398114bb0 0x7f839811ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.324 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f839fc66640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f83981154d0 0x7f839811f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.324 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f839fc66640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f83981309e0 0x7f839811f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.324 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f839fc66640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f83981158b0 con 0x7f83981154d0 2026-02-18T21:02:25.324 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f839fc66640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f83981376f0 con 0x7f83981309e0 2026-02-18T21:02:25.324 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f839fc66640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f8398073760 con 0x7f8398114bb0 2026-02-18T21:02:25.324 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f839d9db640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8398114bb0 0x7f839811ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.324 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f839d9db640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8398114bb0 0x7f839811ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60556/0 (socket says 10.20.193.68:60556) 2026-02-18T21:02:25.325 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f839d9db640 1 -- 10.20.193.68:0/10941996 learned_addr learned my addr 10.20.193.68:0/10941996 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.325 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f839d1da640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f83981154d0 0x7f839811f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.325 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f839e1dc640 1 --2- 10.20.193.68:0/10941996 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f83981309e0 0x7f839811f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.325 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f839d9db640 1 -- 10.20.193.68:0/10941996 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f83981309e0 msgr2=0x7f839811f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.325 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f839d9db640 1 --2- 10.20.193.68:0/10941996 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f83981309e0 0x7f839811f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.325 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f839d9db640 1 -- 10.20.193.68:0/10941996 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f83981154d0 msgr2=0x7f839811f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.325 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f839d9db640 1 --2- 10.20.193.68:0/10941996 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f83981154d0 0x7f839811f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.325 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f839d9db640 1 -- 10.20.193.68:0/10941996 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8398120710 con 0x7f8398114bb0 2026-02-18T21:02:25.325 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f839d1da640 1 --2- 10.20.193.68:0/10941996 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f83981154d0 0x7f839811f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:25.325 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f839d9db640 1 --2- 10.20.193.68:0/10941996 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8398114bb0 0x7f839811ee10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f838800ebe0 tx=0x7f838800c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.325 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f83867fc640 1 -- 10.20.193.68:0/10941996 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388017070 con 0x7f8398114bb0 2026-02-18T21:02:25.325 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f83867fc640 1 -- 10.20.193.68:0/10941996 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f838800cc40 con 0x7f8398114bb0 2026-02-18T21:02:25.326 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f839fc66640 1 -- 10.20.193.68:0/10941996 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839811fdd0 con 0x7f8398114bb0 2026-02-18T21:02:25.326 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f83867fc640 1 -- 10.20.193.68:0/10941996 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8388013470 con 0x7f8398114bb0 2026-02-18T21:02:25.326 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.319+0000 7f839fc66640 1 -- 10.20.193.68:0/10941996 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f8398121a90 con 0x7f8398114bb0 2026-02-18T21:02:25.326 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.320+0000 7f839fc66640 1 -- 10.20.193.68:0/10941996 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83981304a0 con 0x7f8398114bb0 2026-02-18T21:02:25.326 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.320+0000 7f83867fc640 1 -- 10.20.193.68:0/10941996 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f8388013610 con 0x7f8398114bb0 2026-02-18T21:02:25.326 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.320+0000 7f83867fc640 1 -- 10.20.193.68:0/10941996 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f8388067550 con 0x7f8398114bb0 2026-02-18T21:02:25.326 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.322+0000 7f83867fc640 1 -- 10.20.193.68:0/10941996 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f83880413c0 con 0x7f8398114bb0 2026-02-18T21:02:25.392 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.392+0000 7f839fc66640 1 -- 10.20.193.68:0/10941996 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f839811ffa0 con 0x7f8398114bb0 2026-02-18T21:02:25.393 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.393+0000 7f83867fc640 1 -- 10.20.193.68:0/10941996 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+9171 (secure 0 0 0) 0x7f8388065ea0 con 0x7f8398114bb0 2026-02-18T21:02:25.393 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:25.393 INFO:teuthology.orchestra.run.trial068.stdout:{"epoch":33,"fsid":"73558818-cfd1-494a-84aa-56d128598ef4","created":"2026-02-18T21:01:11.071818+0000","modified":"2026-02-18T21:02:25.044997+0000","last_up_change":"2026-02-18T21:02:20.031260+0000","last_in_change":"2026-02-18T21:01:11.803245+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-18T21:01:20.913845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-18T21:01:25.650381+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5f8e54-3a43-41d6-b266-aa412a7f170e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":26,"up_thru":26,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6800","nonce":2637053487}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6801","nonce":2637053487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6803","nonce":2637053487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6802","nonce":2637053487}]},"public_addr":"10.20.193.68:6800/2637053487","cluster_addr":"10.20.193.68:6801/2637053487","heartbeat_back_addr":"10.20.193.68:6803/2637053487","heartbeat_front_addr":"10.20.193.68:6802/2637053487","state":["exists","up"]},{"osd":1,"uuid":"e26d8762-250e-42e7-8768-23caa22edb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":27,"up_thru":27,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6804","nonce":4160428224}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6805","nonce":4160428224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6807","nonce":4160428224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6806","nonce":4160428224}]},"public_addr":"10.20.193.68:6804/4160428224","cluster_addr":"10.20.193.68:6805/4160428224","heartbeat_back_addr":"10.20.193.68:6807/4160428224","heartbeat_front_addr":"10.20.193.68:6806/4160428224","state":["exists","up"]},{"osd":2,"uuid":"568ee96d-39ac-4d79-92bb-d1f3f12601b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":28,"up_thru":29,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6808","nonce":3642986683}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6809","nonce":3642986683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6811","nonce":3642986683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6810","nonce":3642986683}]},"public_addr":"10.20.193.68:6808/3642986683","cluster_addr":"10.20.193.68:6809/3642986683","heartbeat_back_addr":"10.20.193.68:6811/3642986683","heartbeat_front_addr":"10.20.193.68:6810/3642986683","state":["exists","up"]},{"osd":3,"uuid":"765a38cd-f526-4aba-b94e-c57076ca6c72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":29,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6812","nonce":1687218919}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6813","nonce":1687218919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6815","nonce":1687218919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6814","nonce":1687218919}]},"public_addr":"10.20.193.68:6812/1687218919","cluster_addr":"10.20.193.68:6813/1687218919","heartbeat_back_addr":"10.20.193.68:6815/1687218919","heartbeat_front_addr":"10.20.193.68:6814/1687218919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.873205+0000","dead_epoch":21},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.929452+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.863830+0000","dead_epoch":23},{"osd":3,"down_stamp":"2026-02-18T21:02:12.008626+0000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.949895+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.68:0/991885778":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/4112610678":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/4267957295":"2026-02-19T21:02:04.994407+0000","10.20.193.68:6816/24610":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/3536457986":"2026-02-19T21:02:04.994407+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T21:02:25.394 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.393+0000 7f839fc66640 1 -- 10.20.193.68:0/10941996 >> v1:10.20.193.68:6816/2904515774 conn(0x7f836804f790 legacy=0x7f8368051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.394 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.393+0000 7f839fc66640 1 -- 10.20.193.68:0/10941996 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8398114bb0 msgr2=0x7f839811ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.395 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.393+0000 7f839fc66640 1 --2- 10.20.193.68:0/10941996 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8398114bb0 0x7f839811ee10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f838800ebe0 tx=0x7f838800c520 comp rx=0 tx=0).stop 2026-02-18T21:02:25.395 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.393+0000 7f839fc66640 1 -- 10.20.193.68:0/10941996 shutdown_connections 2026-02-18T21:02:25.395 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.393+0000 7f839fc66640 1 --2- 10.20.193.68:0/10941996 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f83981309e0 0x7f839811f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.395 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.393+0000 7f839fc66640 1 --2- 10.20.193.68:0/10941996 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f83981154d0 0x7f839811f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.395 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.393+0000 7f839fc66640 1 --2- 10.20.193.68:0/10941996 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f8398114bb0 0x7f839811ee10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.395 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.393+0000 7f839fc66640 1 -- 10.20.193.68:0/10941996 >> 10.20.193.68:0/10941996 conn(0x7f839809cee0 msgr2=0x7f839806fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.395 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.394+0000 7f839fc66640 1 -- 10.20.193.68:0/10941996 shutdown_connections 2026-02-18T21:02:25.395 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.394+0000 7f839fc66640 1 -- 10.20.193.68:0/10941996 wait complete. 2026-02-18T21:02:25.401 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-18T21:02:25.402 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-18T21:02:25.474 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.470+0000 7f14b7ab3640 1 Processor -- start 2026-02-18T21:02:25.474 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.470+0000 7f14b7ab3640 1 -- start start 2026-02-18T21:02:25.474 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.470+0000 7f14b7ab3640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f14b0072e00 0x7f14b00731e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.474 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.470+0000 7f14b7ab3640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f14b0073720 0x7f14b0122f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.474 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.470+0000 7f14b7ab3640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f14b0123460 0x7f14b01238f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.474 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.470+0000 7f14b7ab3640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f14b0115760 con 0x7f14b0072e00 2026-02-18T21:02:25.475 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.470+0000 7f14b7ab3640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f14b009e090 con 0x7f14b0073720 2026-02-18T21:02:25.475 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.470+0000 7f14b7ab3640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f14b0071a00 con 0x7f14b0123460 2026-02-18T21:02:25.475 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.470+0000 7f14b5828640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f14b0072e00 0x7f14b00731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.475 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.470+0000 7f14b5027640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f14b0073720 0x7f14b0122f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.475 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.470+0000 7f14b5828640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f14b0072e00 0x7f14b00731e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:38742/0 (socket says 10.20.193.68:38742) 2026-02-18T21:02:25.475 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.470+0000 7f14b6029640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f14b0123460 0x7f14b01238f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.475 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.470+0000 7f14b5828640 1 -- 10.20.193.68:0/2686847300 learned_addr learned my addr 10.20.193.68:0/2686847300 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.475 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.470+0000 7f14b5828640 1 -- 10.20.193.68:0/2686847300 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f14b0123460 msgr2=0x7f14b01238f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:25.475 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.470+0000 7f14b5828640 1 --2- 10.20.193.68:0/2686847300 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f14b0123460 0x7f14b01238f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.475 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.470+0000 7f14b5828640 1 -- 10.20.193.68:0/2686847300 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f14b0073720 msgr2=0x7f14b0122f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:25.475 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.470+0000 7f14b5828640 1 --2- 10.20.193.68:0/2686847300 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f14b0073720 0x7f14b0122f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.476 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.470+0000 7f14b5828640 1 -- 10.20.193.68:0/2686847300 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b0073b40 con 0x7f14b0072e00 2026-02-18T21:02:25.476 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.470+0000 7f14b5027640 1 --2- 10.20.193.68:0/2686847300 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f14b0073720 0x7f14b0122f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:25.476 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.471+0000 7f14b5828640 1 --2- 10.20.193.68:0/2686847300 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f14b0072e00 0x7f14b00731e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009970 tx=0x7f14a002ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2ac11ef130130c server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.476 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.471+0000 7f14b4826640 1 -- 10.20.193.68:0/2686847300 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a003c070 con 0x7f14b0072e00 2026-02-18T21:02:25.476 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.471+0000 7f14b4826640 1 -- 10.20.193.68:0/2686847300 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14a002fac0 con 0x7f14b0072e00 2026-02-18T21:02:25.476 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.471+0000 7f14b4826640 1 -- 10.20.193.68:0/2686847300 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a0037440 con 0x7f14b0072e00 2026-02-18T21:02:25.476 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.471+0000 7f14b7ab3640 1 -- 10.20.193.68:0/2686847300 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f14b0072e00 msgr2=0x7f14b00731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.476 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.471+0000 7f14b7ab3640 1 --2- 10.20.193.68:0/2686847300 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f14b0072e00 0x7f14b00731e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f14a0009970 tx=0x7f14a002ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:25.476 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.471+0000 7f14b7ab3640 1 -- 10.20.193.68:0/2686847300 shutdown_connections 2026-02-18T21:02:25.476 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.471+0000 7f14b7ab3640 1 --2- 10.20.193.68:0/2686847300 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f14b0073720 0x7f14b0122f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.476 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.471+0000 7f14b7ab3640 1 --2- 10.20.193.68:0/2686847300 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f14b0123460 0x7f14b01238f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.476 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.471+0000 7f14b7ab3640 1 --2- 10.20.193.68:0/2686847300 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f14b0072e00 0x7f14b00731e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.477 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.471+0000 7f14b7ab3640 1 -- 10.20.193.68:0/2686847300 >> 10.20.193.68:0/2686847300 conn(0x7f14b009cee0 msgr2=0x7f14b009d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.477 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.471+0000 7f14b7ab3640 1 -- 10.20.193.68:0/2686847300 shutdown_connections 2026-02-18T21:02:25.477 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.471+0000 7f14b7ab3640 1 -- 10.20.193.68:0/2686847300 wait complete. 2026-02-18T21:02:25.477 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b7ab3640 1 Processor -- start 2026-02-18T21:02:25.477 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b7ab3640 1 -- start start 2026-02-18T21:02:25.477 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b7ab3640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f14b0072e00 0x7f14b01c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.477 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b7ab3640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f14b0073720 0x7f14b01c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.477 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b7ab3640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f14b0123460 0x7f14b0130bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.477 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b7ab3640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f14b01342a0 con 0x7f14b0073720 2026-02-18T21:02:25.477 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b7ab3640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f14b0134120 con 0x7f14b0123460 2026-02-18T21:02:25.477 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b7ab3640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f14b0134420 con 0x7f14b0072e00 2026-02-18T21:02:25.477 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b5027640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f14b0073720 0x7f14b01c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b5828640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f14b0072e00 0x7f14b01c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b6029640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f14b0123460 0x7f14b0130bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b5027640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f14b0073720 0x7f14b01c59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:38746/0 (socket says 10.20.193.68:38746) 2026-02-18T21:02:25.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b5027640 1 -- 10.20.193.68:0/1108354642 learned_addr learned my addr 10.20.193.68:0/1108354642 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b5027640 1 -- 10.20.193.68:0/1108354642 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f14b0072e00 msgr2=0x7f14b01c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b5027640 1 --2- 10.20.193.68:0/1108354642 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f14b0072e00 0x7f14b01c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b5027640 1 -- 10.20.193.68:0/1108354642 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f14b0123460 msgr2=0x7f14b0130bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b5027640 1 --2- 10.20.193.68:0/1108354642 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f14b0123460 0x7f14b0130bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b5027640 1 -- 10.20.193.68:0/1108354642 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b0115ce0 con 0x7f14b0073720 2026-02-18T21:02:25.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b6029640 1 --2- 10.20.193.68:0/1108354642 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f14b0123460 0x7f14b0130bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:25.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b5027640 1 --2- 10.20.193.68:0/1108354642 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f14b0073720 0x7f14b01c59b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f14a400ebe0 tx=0x7f14a400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.478 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f149e7fc640 1 -- 10.20.193.68:0/1108354642 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a4017070 con 0x7f14b0073720 2026-02-18T21:02:25.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f149e7fc640 1 -- 10.20.193.68:0/1108354642 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14a400cc40 con 0x7f14b0073720 2026-02-18T21:02:25.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b7ab3640 1 -- 10.20.193.68:0/1108354642 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14b0132dc0 con 0x7f14b0073720 2026-02-18T21:02:25.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f149e7fc640 1 -- 10.20.193.68:0/1108354642 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a4013470 con 0x7f14b0073720 2026-02-18T21:02:25.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.472+0000 7f14b7ab3640 1 -- 10.20.193.68:0/1108354642 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14b01c5ef0 con 0x7f14b0073720 2026-02-18T21:02:25.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.473+0000 7f14b7ab3640 1 -- 10.20.193.68:0/1108354642 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14b0122f20 con 0x7f14b0073720 2026-02-18T21:02:25.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.473+0000 7f149e7fc640 1 -- 10.20.193.68:0/1108354642 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f14a4013610 con 0x7f14b0073720 2026-02-18T21:02:25.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.473+0000 7f149e7fc640 1 -- 10.20.193.68:0/1108354642 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f14a4067560 con 0x7f14b0073720 2026-02-18T21:02:25.479 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.475+0000 7f149e7fc640 1 -- 10.20.193.68:0/1108354642 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f14a40412f0 con 0x7f14b0073720 2026-02-18T21:02:25.545 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.545+0000 7f14b7ab3640 1 -- 10.20.193.68:0/1108354642 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14b0069ef0 con 0x7f14b0073720 2026-02-18T21:02:25.546 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.545+0000 7f149e7fc640 1 -- 10.20.193.68:0/1108354642 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+9171 (secure 0 0 0) 0x7f14a4066610 con 0x7f14b0073720 2026-02-18T21:02:25.546 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:25.546 INFO:teuthology.orchestra.run.trial068.stdout:{"epoch":33,"fsid":"73558818-cfd1-494a-84aa-56d128598ef4","created":"2026-02-18T21:01:11.071818+0000","modified":"2026-02-18T21:02:25.044997+0000","last_up_change":"2026-02-18T21:02:20.031260+0000","last_in_change":"2026-02-18T21:01:11.803245+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-18T21:01:20.913845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-18T21:01:25.650381+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5f8e54-3a43-41d6-b266-aa412a7f170e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":26,"up_thru":26,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6800","nonce":2637053487}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6801","nonce":2637053487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6803","nonce":2637053487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6802","nonce":2637053487}]},"public_addr":"10.20.193.68:6800/2637053487","cluster_addr":"10.20.193.68:6801/2637053487","heartbeat_back_addr":"10.20.193.68:6803/2637053487","heartbeat_front_addr":"10.20.193.68:6802/2637053487","state":["exists","up"]},{"osd":1,"uuid":"e26d8762-250e-42e7-8768-23caa22edb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":27,"up_thru":27,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6804","nonce":4160428224}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6805","nonce":4160428224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6807","nonce":4160428224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6806","nonce":4160428224}]},"public_addr":"10.20.193.68:6804/4160428224","cluster_addr":"10.20.193.68:6805/4160428224","heartbeat_back_addr":"10.20.193.68:6807/4160428224","heartbeat_front_addr":"10.20.193.68:6806/4160428224","state":["exists","up"]},{"osd":2,"uuid":"568ee96d-39ac-4d79-92bb-d1f3f12601b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":28,"up_thru":29,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6808","nonce":3642986683}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6809","nonce":3642986683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6811","nonce":3642986683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6810","nonce":3642986683}]},"public_addr":"10.20.193.68:6808/3642986683","cluster_addr":"10.20.193.68:6809/3642986683","heartbeat_back_addr":"10.20.193.68:6811/3642986683","heartbeat_front_addr":"10.20.193.68:6810/3642986683","state":["exists","up"]},{"osd":3,"uuid":"765a38cd-f526-4aba-b94e-c57076ca6c72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":29,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6812","nonce":1687218919}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6813","nonce":1687218919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6815","nonce":1687218919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6814","nonce":1687218919}]},"public_addr":"10.20.193.68:6812/1687218919","cluster_addr":"10.20.193.68:6813/1687218919","heartbeat_back_addr":"10.20.193.68:6815/1687218919","heartbeat_front_addr":"10.20.193.68:6814/1687218919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.873205+0000","dead_epoch":21},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.929452+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.863830+0000","dead_epoch":23},{"osd":3,"down_stamp":"2026-02-18T21:02:12.008626+0000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.949895+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.68:0/991885778":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/4112610678":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/4267957295":"2026-02-19T21:02:04.994407+0000","10.20.193.68:6816/24610":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/3536457986":"2026-02-19T21:02:04.994407+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T21:02:25.547 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.546+0000 7f14b7ab3640 1 -- 10.20.193.68:0/1108354642 >> v1:10.20.193.68:6816/2904515774 conn(0x7f148004f790 legacy=0x7f1480051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.547 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.546+0000 7f14b7ab3640 1 -- 10.20.193.68:0/1108354642 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f14b0073720 msgr2=0x7f14b01c59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.548 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.546+0000 7f14b7ab3640 1 --2- 10.20.193.68:0/1108354642 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f14b0073720 0x7f14b01c59b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f14a400ebe0 tx=0x7f14a400c520 comp rx=0 tx=0).stop 2026-02-18T21:02:25.548 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.546+0000 7f14b7ab3640 1 -- 10.20.193.68:0/1108354642 shutdown_connections 2026-02-18T21:02:25.548 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.546+0000 7f14b7ab3640 1 --2- 10.20.193.68:0/1108354642 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f14b0123460 0x7f14b0130bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.548 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.546+0000 7f14b7ab3640 1 --2- 10.20.193.68:0/1108354642 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f14b0073720 0x7f14b01c59b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.548 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.546+0000 7f14b7ab3640 1 --2- 10.20.193.68:0/1108354642 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f14b0072e00 0x7f14b01c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.548 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.546+0000 7f14b7ab3640 1 -- 10.20.193.68:0/1108354642 >> 10.20.193.68:0/1108354642 conn(0x7f14b009cee0 msgr2=0x7f14b00724d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.548 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.546+0000 7f14b7ab3640 1 -- 10.20.193.68:0/1108354642 shutdown_connections 2026-02-18T21:02:25.548 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.546+0000 7f14b7ab3640 1 -- 10.20.193.68:0/1108354642 wait complete. 2026-02-18T21:02:25.555 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-18T21:02:25.556 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-18T21:02:25.556 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-18T21:02:25.557 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-18T21:02:25.629 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.627+0000 7f6f2937b640 1 Processor -- start 2026-02-18T21:02:25.629 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.627+0000 7f6f2937b640 1 -- start start 2026-02-18T21:02:25.629 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.627+0000 7f6f2937b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f6f24072e20 0x7f6f24073200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.629 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f2937b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6f24073740 0x7f6f24122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.629 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f2937b640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f6f24123430 0x7f6f241238e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.629 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f2937b640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f6f24071520 con 0x7f6f24123430 2026-02-18T21:02:25.630 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f2937b640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f6f2409e050 con 0x7f6f24073740 2026-02-18T21:02:25.630 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f2937b640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f6f24115730 con 0x7f6f24072e20 2026-02-18T21:02:25.630 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f227fc640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6f24073740 0x7f6f24122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.630 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f22ffd640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f6f24072e20 0x7f6f24073200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.630 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f237fe640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f6f24123430 0x7f6f241238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.630 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f22ffd640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f6f24072e20 0x7f6f24073200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60586/0 (socket says 10.20.193.68:60586) 2026-02-18T21:02:25.630 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f227fc640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6f24073740 0x7f6f24122ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42346/0 (socket says 10.20.193.68:42346) 2026-02-18T21:02:25.630 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f227fc640 1 -- 10.20.193.68:0/2553231254 learned_addr learned my addr 10.20.193.68:0/2553231254 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.630 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f237fe640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f6f24123430 0x7f6f241238e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:38760/0 (socket says 10.20.193.68:38760) 2026-02-18T21:02:25.630 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f227fc640 1 -- 10.20.193.68:0/2553231254 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f6f24072e20 msgr2=0x7f6f24073200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:25.630 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f227fc640 1 --2- 10.20.193.68:0/2553231254 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f6f24072e20 0x7f6f24073200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.631 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f227fc640 1 -- 10.20.193.68:0/2553231254 >> v2:10.20.193.68:3300/0 conn(0x7f6f24123430 msgr2=0x7f6f241238e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:25.631 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f227fc640 1 --2- 10.20.193.68:0/2553231254 >> v2:10.20.193.68:3300/0 conn(0x7f6f24123430 0x7f6f241238e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.631 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f227fc640 1 -- 10.20.193.68:0/2553231254 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f241159f0 con 0x7f6f24073740 2026-02-18T21:02:25.631 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f237fe640 1 --2- 10.20.193.68:0/2553231254 >> v2:10.20.193.68:3300/0 conn(0x7f6f24123430 0x7f6f241238e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:25.631 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f68c2e9b640 1 Processor -- start 2026-02-18T21:02:25.632 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f68c2e9b640 1 -- start start 2026-02-18T21:02:25.632 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f227fc640 1 --2- 10.20.193.68:0/2553231254 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6f24073740 0x7f6f24122ef0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009970 tx=0x7f6f0c031120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dddd5df1e9137205 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.632 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f21ffb640 1 -- 10.20.193.68:0/2553231254 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c03e070 con 0x7f6f24073740 2026-02-18T21:02:25.632 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f21ffb640 1 -- 10.20.193.68:0/2553231254 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f0c031d50 con 0x7f6f24073740 2026-02-18T21:02:25.633 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.628+0000 7f6f21ffb640 1 -- 10.20.193.68:0/2553231254 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c039660 con 0x7f6f24073740 2026-02-18T21:02:25.633 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f68c2e9b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f68bc073680 0x7f68bc133050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.633 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f68c2e9b640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f68bc133590 0x7f68bc135980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.633 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f68c2e9b640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68bc12a7b0 con 0x7f68bc12ac90 2026-02-18T21:02:25.633 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f68c2e9b640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f68bc073e60 con 0x7f68bc133590 2026-02-18T21:02:25.634 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f68c2e9b640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f68bc072d10 con 0x7f68bc073680 2026-02-18T21:02:25.634 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f3c14681640 1 Processor -- start 2026-02-18T21:02:25.634 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f68c0c10640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f68bc12ac90 0x7f68bc12b070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:44680/0 (socket says 10.20.193.68:44680) 2026-02-18T21:02:25.635 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f68c0c10640 1 -- 10.20.193.68:0/3978056099 learned_addr learned my addr 10.20.193.68:0/3978056099 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:25.635 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f68b3fff640 1 --2- 10.20.193.68:0/3978056099 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f68bc073680 0x7f68bc133050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.635 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f3c14681640 1 -- start start 2026-02-18T21:02:25.636 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f68c1411640 1 --2- 10.20.193.68:0/3978056099 >> v2:10.20.193.68:3300/0 conn(0x7f68bc133590 0x7f68bc135980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.636 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f68b37fe640 1 -- 10.20.193.68:0/3978056099 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 678472793 0 0) 0x7f68bc12a7b0 con 0x7f68bc12ac90 2026-02-18T21:02:25.636 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f68b37fe640 1 -- 10.20.193.68:0/3978056099 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68a8003620 con 0x7f68bc12ac90 2026-02-18T21:02:25.636 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f68b3fff640 1 -- 10.20.193.68:0/3978056099 >> v2:10.20.193.68:3300/0 conn(0x7f68bc133590 msgr2=0x7f68bc135980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:25.636 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f68b3fff640 1 --2- 10.20.193.68:0/3978056099 >> v2:10.20.193.68:3300/0 conn(0x7f68bc133590 0x7f68bc135980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.636 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f68b3fff640 1 -- 10.20.193.68:0/3978056099 >> v1:10.20.193.68:6789/0 conn(0x7f68bc12ac90 legacy=0x7f68bc12b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.637 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f6f2937b640 1 -- 10.20.193.68:0/2553231254 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6f24073740 msgr2=0x7f6f24122ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.637 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f6f2937b640 1 --2- 10.20.193.68:0/2553231254 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6f24073740 0x7f6f24122ef0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009970 tx=0x7f6f0c031120 comp rx=0 tx=0).stop 2026-02-18T21:02:25.637 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f68b3fff640 1 -- 10.20.193.68:0/3978056099 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68bc136ed0 con 0x7f68bc073680 2026-02-18T21:02:25.638 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f6f2937b640 1 -- 10.20.193.68:0/2553231254 shutdown_connections 2026-02-18T21:02:25.638 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f6f2937b640 1 --2- 10.20.193.68:0/2553231254 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6f24073740 0x7f6f24122ef0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.638 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f6f2937b640 1 --2- 10.20.193.68:0/2553231254 >> v2:10.20.193.68:3300/0 conn(0x7f6f24123430 0x7f6f241238e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.638 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f6f2937b640 1 --2- 10.20.193.68:0/2553231254 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f6f24072e20 0x7f6f24073200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.638 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f6f2937b640 1 -- 10.20.193.68:0/2553231254 >> 10.20.193.68:0/2553231254 conn(0x7f6f2409cea0 msgr2=0x7f6f2409d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.638 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f6f2937b640 1 -- 10.20.193.68:0/2553231254 shutdown_connections 2026-02-18T21:02:25.638 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f6f2937b640 1 -- 10.20.193.68:0/2553231254 wait complete. 2026-02-18T21:02:25.638 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f71fd729640 1 Processor -- start 2026-02-18T21:02:25.639 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f3c14681640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f3c0c1311b0 0x7f3c0c131590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.639 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f3c14681640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f3c0c131ad0 0x7f3c0c134480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.639 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f71fd729640 1 -- start start 2026-02-18T21:02:25.641 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f3c14681640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f3c0c1349c0 0x7f3c0c134e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.641 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f3c14681640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f3c0c0a08a0 con 0x7f3c0c131ad0 2026-02-18T21:02:25.641 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f3c14681640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0c135370 con 0x7f3c0c1311b0 2026-02-18T21:02:25.641 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f3c14681640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f3c0c06f800 con 0x7f3c0c1349c0 2026-02-18T21:02:25.641 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f3c123f6640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f3c0c1311b0 0x7f3c0c131590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.641 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f3c11bf5640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f3c0c131ad0 0x7f3c0c134480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.641 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f3c123f6640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f3c0c1311b0 0x7f3c0c131590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42348/0 (socket says 10.20.193.68:42348) 2026-02-18T21:02:25.641 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f3c123f6640 1 -- 10.20.193.68:0/441008500 learned_addr learned my addr 10.20.193.68:0/441008500 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.641 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f3c12bf7640 1 --2- 10.20.193.68:0/441008500 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f3c0c1349c0 0x7f3c0c134e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.641 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f3c123f6640 1 -- 10.20.193.68:0/441008500 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f3c0c1349c0 msgr2=0x7f3c0c134e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:25.642 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f3c123f6640 1 --2- 10.20.193.68:0/441008500 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f3c0c1349c0 0x7f3c0c134e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.642 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f3c123f6640 1 -- 10.20.193.68:0/441008500 >> v2:10.20.193.68:3300/0 conn(0x7f3c0c131ad0 msgr2=0x7f3c0c134480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:25.642 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f3c123f6640 1 --2- 10.20.193.68:0/441008500 >> v2:10.20.193.68:3300/0 conn(0x7f3c0c131ad0 0x7f3c0c134480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.642 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f3c123f6640 1 -- 10.20.193.68:0/441008500 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0c06e6e0 con 0x7f3c0c1311b0 2026-02-18T21:02:25.642 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f68b3fff640 1 --2- 10.20.193.68:0/3978056099 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f68bc073680 0x7f68bc133050 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f68a40098a0 tx=0x7f68a402ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cc011c3589ceea0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.643 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f71fd729640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f71f812ac90 0x7f71f812b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.643 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f71fd729640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f71f8073680 0x7f71f8071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.643 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f71fd729640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f71f8071960 0x7f71f8071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.643 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f71fd729640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f71f812a7b0 con 0x7f71f812ac90 2026-02-18T21:02:25.643 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f71fd729640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f71f8073e60 con 0x7f71f8071960 2026-02-18T21:02:25.644 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f71fd729640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f71f8072d10 con 0x7f71f8073680 2026-02-18T21:02:25.644 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f71f6ffd640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f71f812ac90 0x7f71f812b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.644 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f71f6ffd640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f71f812ac90 0x7f71f812b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:38790/0 (socket says 10.20.193.68:38790) 2026-02-18T21:02:25.644 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f71f6ffd640 1 -- 10.20.193.68:0/384638933 learned_addr learned my addr 10.20.193.68:0/384638933 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.644 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f71f67fc640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f71f8073680 0x7f71f8071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.644 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f68b37fe640 1 -- 10.20.193.68:0/3978056099 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a403c070 con 0x7f68bc073680 2026-02-18T21:02:25.645 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.629+0000 7f71f77fe640 1 --2- 10.20.193.68:0/384638933 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f71f8071960 0x7f71f8071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.645 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f68b37fe640 1 -- 10.20.193.68:0/3978056099 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a402fa40 con 0x7f68bc073680 2026-02-18T21:02:25.645 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f68b37fe640 1 -- 10.20.193.68:0/3978056099 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a402fe10 con 0x7f68bc073680 2026-02-18T21:02:25.645 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f2937b640 1 Processor -- start 2026-02-18T21:02:25.646 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f71f6ffd640 1 -- 10.20.193.68:0/384638933 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f71f8073680 msgr2=0x7f71f8071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:25.646 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f71f6ffd640 1 --2- 10.20.193.68:0/384638933 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f71f8073680 0x7f71f8071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.646 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f71f6ffd640 1 -- 10.20.193.68:0/384638933 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f71f8071960 msgr2=0x7f71f8071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:25.646 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f71f6ffd640 1 --2- 10.20.193.68:0/384638933 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f71f8071960 0x7f71f8071dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.646 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f71f6ffd640 1 -- 10.20.193.68:0/384638933 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f812b5b0 con 0x7f71f812ac90 2026-02-18T21:02:25.647 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f2937b640 1 -- start start 2026-02-18T21:02:25.647 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f3c123f6640 1 --2- 10.20.193.68:0/441008500 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f3c0c1311b0 0x7f3c0c131590 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc009970 tx=0x7f3bfc02ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96517b04258300e3 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.648 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f68c2e9b640 1 -- 10.20.193.68:0/3978056099 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f68bc073680 msgr2=0x7f68bc133050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.648 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f68c2e9b640 1 --2- 10.20.193.68:0/3978056099 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f68bc073680 0x7f68bc133050 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f68a40098a0 tx=0x7f68a402ed80 comp rx=0 tx=0).stop 2026-02-18T21:02:25.648 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f68c2e9b640 1 -- 10.20.193.68:0/3978056099 shutdown_connections 2026-02-18T21:02:25.648 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f68c2e9b640 1 --2- 10.20.193.68:0/3978056099 >> v2:10.20.193.68:3300/0 conn(0x7f68bc133590 0x7f68bc135980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.648 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f68c2e9b640 1 --2- 10.20.193.68:0/3978056099 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f68bc073680 0x7f68bc133050 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.648 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f68c2e9b640 1 -- 10.20.193.68:0/3978056099 >> 10.20.193.68:0/3978056099 conn(0x7f68bc09cea0 msgr2=0x7f68bc09d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.648 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f3c113f4640 1 -- 10.20.193.68:0/441008500 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc03c070 con 0x7f3c0c1311b0 2026-02-18T21:02:25.649 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f68c2e9b640 1 -- 10.20.193.68:0/3978056099 shutdown_connections 2026-02-18T21:02:25.649 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f68c2e9b640 1 -- 10.20.193.68:0/3978056099 wait complete. 2026-02-18T21:02:25.649 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f3c113f4640 1 -- 10.20.193.68:0/441008500 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bfc02fac0 con 0x7f3c0c1311b0 2026-02-18T21:02:25.649 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f3c113f4640 1 -- 10.20.193.68:0/441008500 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc037440 con 0x7f3c0c1311b0 2026-02-18T21:02:25.650 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f2937b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6f24072e20 0x7f6f241c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.650 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f2937b640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f6f24073740 0x7f6f241c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.650 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f2937b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f6f24123430 0x7f6f2411abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.651 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f2937b640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f6f24071ba0 con 0x7f6f24073740 2026-02-18T21:02:25.651 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f2937b640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f6f24071a20 con 0x7f6f24072e20 2026-02-18T21:02:25.651 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f2937b640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f6f24071d20 con 0x7f6f24123430 2026-02-18T21:02:25.651 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f22ffd640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6f24072e20 0x7f6f241c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.651 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f237fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f6f24123430 0x7f6f2411abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.651 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f71f6ffd640 1 --2- 10.20.193.68:0/384638933 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f71f812ac90 0x7f71f812b070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009970 tx=0x7f71ec02ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56115bc2c2faae40 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.652 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f22ffd640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6f24072e20 0x7f6f241c7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42360/0 (socket says 10.20.193.68:42360) 2026-02-18T21:02:25.652 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f227fc640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f6f24073740 0x7f6f241c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.652 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f237fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f6f24123430 0x7f6f2411abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60620/0 (socket says 10.20.193.68:60620) 2026-02-18T21:02:25.652 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f22ffd640 1 -- 10.20.193.68:0/2111016997 learned_addr learned my addr 10.20.193.68:0/2111016997 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.653 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f71f5ffb640 1 -- 10.20.193.68:0/384638933 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec03c070 con 0x7f71f812ac90 2026-02-18T21:02:25.653 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f71f5ffb640 1 -- 10.20.193.68:0/384638933 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71ec02fac0 con 0x7f71f812ac90 2026-02-18T21:02:25.653 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f71f5ffb640 1 -- 10.20.193.68:0/384638933 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec037440 con 0x7f71f812ac90 2026-02-18T21:02:25.653 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f237fe640 1 -- 10.20.193.68:0/2111016997 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6f24072e20 msgr2=0x7f6f241c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.653 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f237fe640 1 --2- 10.20.193.68:0/2111016997 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6f24072e20 0x7f6f241c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.654 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f237fe640 1 -- 10.20.193.68:0/2111016997 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f6f24073740 msgr2=0x7f6f241c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.654 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f237fe640 1 --2- 10.20.193.68:0/2111016997 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f6f24073740 0x7f6f241c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.654 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f237fe640 1 -- 10.20.193.68:0/2111016997 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f241272a0 con 0x7f6f24123430 2026-02-18T21:02:25.654 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f22ffd640 1 --2- 10.20.193.68:0/2111016997 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f6f24072e20 0x7f6f241c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:25.654 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f237fe640 1 --2- 10.20.193.68:0/2111016997 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f6f24123430 0x7f6f2411abb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400efc0 tx=0x7f6f1400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.654 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f3c14681640 1 -- 10.20.193.68:0/441008500 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f3c0c1311b0 msgr2=0x7f3c0c131590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.655 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f3c14681640 1 --2- 10.20.193.68:0/441008500 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f3c0c1311b0 0x7f3c0c131590 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc009970 tx=0x7f3bfc02ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:25.655 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f3c14681640 1 -- 10.20.193.68:0/441008500 shutdown_connections 2026-02-18T21:02:25.655 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f3c14681640 1 --2- 10.20.193.68:0/441008500 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f3c0c1349c0 0x7f3c0c134e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.655 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f3c14681640 1 --2- 10.20.193.68:0/441008500 >> v2:10.20.193.68:3300/0 conn(0x7f3c0c131ad0 0x7f3c0c134480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.655 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f3c14681640 1 --2- 10.20.193.68:0/441008500 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f3c0c1311b0 0x7f3c0c131590 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.655 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f3c14681640 1 -- 10.20.193.68:0/441008500 >> 10.20.193.68:0/441008500 conn(0x7f3c0c0a1930 msgr2=0x7f3c0c0a1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.655 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f037fe640 1 -- 10.20.193.68:0/2111016997 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14018030 con 0x7f6f24123430 2026-02-18T21:02:25.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f3c14681640 1 -- 10.20.193.68:0/441008500 shutdown_connections 2026-02-18T21:02:25.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f68c2e9b640 1 Processor -- start 2026-02-18T21:02:25.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f037fe640 1 -- 10.20.193.68:0/2111016997 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f1400ce00 con 0x7f6f24123430 2026-02-18T21:02:25.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f2937b640 1 -- 10.20.193.68:0/2111016997 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2411d770 con 0x7f6f24123430 2026-02-18T21:02:25.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f3c14681640 1 -- 10.20.193.68:0/441008500 wait complete. 2026-02-18T21:02:25.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f68c2e9b640 1 -- start start 2026-02-18T21:02:25.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f71fd729640 1 -- 10.20.193.68:0/384638933 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f71f812ac90 msgr2=0x7f71f812b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f71fd729640 1 --2- 10.20.193.68:0/384638933 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f71f812ac90 0x7f71f812b070 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009970 tx=0x7f71ec02ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:25.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f037fe640 1 -- 10.20.193.68:0/2111016997 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14003cb0 con 0x7f6f24123430 2026-02-18T21:02:25.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f6f2937b640 1 -- 10.20.193.68:0/2111016997 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f241c7a90 con 0x7f6f24123430 2026-02-18T21:02:25.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f71fd729640 1 -- 10.20.193.68:0/384638933 shutdown_connections 2026-02-18T21:02:25.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.630+0000 7f71fd729640 1 --2- 10.20.193.68:0/384638933 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f71f8071960 0x7f71f8071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f71fd729640 1 --2- 10.20.193.68:0/384638933 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f71f8073680 0x7f71f8071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f71fd729640 1 --2- 10.20.193.68:0/384638933 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f71f812ac90 0x7f71f812b070 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f71fd729640 1 -- 10.20.193.68:0/384638933 >> 10.20.193.68:0/384638933 conn(0x7f71f809cea0 msgr2=0x7f71f809d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f71fd729640 1 -- 10.20.193.68:0/384638933 shutdown_connections 2026-02-18T21:02:25.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f71fd729640 1 -- 10.20.193.68:0/384638933 wait complete. 2026-02-18T21:02:25.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68c2e9b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f68bc073680 0x7f68bc114bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68c2e9b640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f68bc12ac90 0x7f68bc1150f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68c2e9b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f68bc133590 0x7f68bc115630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68c2e9b640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f68bc136250 con 0x7f68bc12ac90 2026-02-18T21:02:25.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68c2e9b640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f68bc1360d0 con 0x7f68bc073680 2026-02-18T21:02:25.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68c2e9b640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f68bc1363d0 con 0x7f68bc133590 2026-02-18T21:02:25.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68c0c10640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f68bc073680 0x7f68bc114bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68b3fff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f68bc12ac90 0x7f68bc1150f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68c0c10640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f68bc073680 0x7f68bc114bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42368/0 (socket says 10.20.193.68:42368) 2026-02-18T21:02:25.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68c0c10640 1 -- 10.20.193.68:0/3299735405 learned_addr learned my addr 10.20.193.68:0/3299735405 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f6f2937b640 1 -- 10.20.193.68:0/2111016997 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f24122ef0 con 0x7f6f24123430 2026-02-18T21:02:25.662 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68b3fff640 1 -- 10.20.193.68:0/3299735405 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f68bc133590 msgr2=0x7f68bc115630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.662 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68b3fff640 1 --2- 10.20.193.68:0/3299735405 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f68bc133590 0x7f68bc115630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.662 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68b3fff640 1 -- 10.20.193.68:0/3299735405 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f68bc073680 msgr2=0x7f68bc114bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.662 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68b3fff640 1 --2- 10.20.193.68:0/3299735405 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f68bc073680 0x7f68bc114bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.662 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68b3fff640 1 -- 10.20.193.68:0/3299735405 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68bc1284d0 con 0x7f68bc12ac90 2026-02-18T21:02:25.662 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68c0c10640 1 --2- 10.20.193.68:0/3299735405 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f68bc073680 0x7f68bc114bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:25.663 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f3c14681640 1 Processor -- start 2026-02-18T21:02:25.663 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f3c14681640 1 -- start start 2026-02-18T21:02:25.663 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f71fd729640 1 Processor -- start 2026-02-18T21:02:25.663 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68b3fff640 1 --2- 10.20.193.68:0/3299735405 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f68bc12ac90 0x7f68bc1150f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f68a4036000 tx=0x7f68a40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.664 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f71fd729640 1 -- start start 2026-02-18T21:02:25.664 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68b17fa640 1 -- 10.20.193.68:0/3299735405 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a4046020 con 0x7f68bc12ac90 2026-02-18T21:02:25.664 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68b17fa640 1 -- 10.20.193.68:0/3299735405 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a4042630 con 0x7f68bc12ac90 2026-02-18T21:02:25.664 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68c2e9b640 1 -- 10.20.193.68:0/3299735405 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68bc116af0 con 0x7f68bc12ac90 2026-02-18T21:02:25.664 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68b17fa640 1 -- 10.20.193.68:0/3299735405 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a403c040 con 0x7f68bc12ac90 2026-02-18T21:02:25.664 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f68c2e9b640 1 -- 10.20.193.68:0/3299735405 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68bc1320c0 con 0x7f68bc12ac90 2026-02-18T21:02:25.665 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f3c14681640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f3c0c1311b0 0x7f3c0c12df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.665 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f3c14681640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f3c0c131ad0 0x7f3c0c12e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.665 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f3c14681640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f3c0c1349c0 0x7f3c0c137100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.665 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f3c14681640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c13b810 con 0x7f3c0c131ad0 2026-02-18T21:02:25.665 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f6f037fe640 1 -- 10.20.193.68:0/2111016997 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f6f14014480 con 0x7f6f24123430 2026-02-18T21:02:25.666 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f71fd729640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f71f8071960 0x7f71f81319a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.666 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f71fd729640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f71f8073680 0x7f71f8131ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.666 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f3c14681640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0c06f260 con 0x7f3c0c1349c0 2026-02-18T21:02:25.666 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f3c14681640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f3c0c13b990 con 0x7f3c0c1311b0 2026-02-18T21:02:25.666 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f71fd729640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f71f812ac90 0x7f71f8132420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f71fd729640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f71f81353f0 con 0x7f71f8073680 2026-02-18T21:02:25.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f71fd729640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f71f8135270 con 0x7f71f8071960 2026-02-18T21:02:25.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f71fd729640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f71f8135570 con 0x7f71f812ac90 2026-02-18T21:02:25.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f71f77fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f71f812ac90 0x7f71f8132420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f3c11bf5640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f3c0c131ad0 0x7f3c0c12e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f3c123f6640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f3c0c1311b0 0x7f3c0c12df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f3c11bf5640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f3c0c131ad0 0x7f3c0c12e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:38824/0 (socket says 10.20.193.68:38824) 2026-02-18T21:02:25.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f3c12bf7640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f3c0c1349c0 0x7f3c0c137100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.667 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f3c11bf5640 1 -- 10.20.193.68:0/2099472337 learned_addr learned my addr 10.20.193.68:0/2099472337 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.668 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f71f77fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f71f812ac90 0x7f71f8132420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60652/0 (socket says 10.20.193.68:60652) 2026-02-18T21:02:25.668 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f71f77fe640 1 -- 10.20.193.68:0/2405594410 learned_addr learned my addr 10.20.193.68:0/2405594410 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.668 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f71f6ffd640 1 --2- 10.20.193.68:0/2405594410 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f71f8071960 0x7f71f81319a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.668 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.631+0000 7f71f67fc640 1 --2- 10.20.193.68:0/2405594410 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f71f8073680 0x7f71f8131ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.668 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f3c11bf5640 1 -- 10.20.193.68:0/2099472337 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f3c0c1311b0 msgr2=0x7f3c0c12df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.668 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f3c11bf5640 1 --2- 10.20.193.68:0/2099472337 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f3c0c1311b0 0x7f3c0c12df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.668 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f3c11bf5640 1 -- 10.20.193.68:0/2099472337 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f3c0c1349c0 msgr2=0x7f3c0c137100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.668 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f3c11bf5640 1 --2- 10.20.193.68:0/2099472337 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f3c0c1349c0 0x7f3c0c137100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.669 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f71f77fe640 1 -- 10.20.193.68:0/2405594410 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f71f8071960 msgr2=0x7f71f81319a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.669 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f71f77fe640 1 --2- 10.20.193.68:0/2405594410 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f71f8071960 0x7f71f81319a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.669 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f71f77fe640 1 -- 10.20.193.68:0/2405594410 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f71f8073680 msgr2=0x7f71f8131ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.669 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f71f77fe640 1 --2- 10.20.193.68:0/2405594410 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f71f8073680 0x7f71f8131ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.669 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f71f77fe640 1 -- 10.20.193.68:0/2405594410 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f8133740 con 0x7f71f812ac90 2026-02-18T21:02:25.669 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f3c11bf5640 1 -- 10.20.193.68:0/2099472337 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0c138c70 con 0x7f3c0c131ad0 2026-02-18T21:02:25.669 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f71f6ffd640 1 --2- 10.20.193.68:0/2405594410 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f71f8071960 0x7f71f81319a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:25.670 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f3c11bf5640 1 --2- 10.20.193.68:0/2099472337 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f3c0c131ad0 0x7f3c0c12e440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000ebe0 tx=0x7f3c0000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.670 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f71f77fe640 1 --2- 10.20.193.68:0/2405594410 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f71f812ac90 0x7f71f8132420 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009dd0 tx=0x7f71e800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.670 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f3bf2ffd640 1 -- 10.20.193.68:0/2099472337 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c00017070 con 0x7f3c0c131ad0 2026-02-18T21:02:25.670 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f6f037fe640 1 -- 10.20.193.68:0/2111016997 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f6f140680c0 con 0x7f6f24123430 2026-02-18T21:02:25.670 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f71d77fe640 1 -- 10.20.193.68:0/2405594410 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e8018020 con 0x7f71f812ac90 2026-02-18T21:02:25.671 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f71d77fe640 1 -- 10.20.193.68:0/2405594410 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71e8014480 con 0x7f71f812ac90 2026-02-18T21:02:25.671 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f3bf2ffd640 1 -- 10.20.193.68:0/2099472337 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c0000cc40 con 0x7f3c0c131ad0 2026-02-18T21:02:25.671 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f71d77fe640 1 -- 10.20.193.68:0/2405594410 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e8014870 con 0x7f71f812ac90 2026-02-18T21:02:25.671 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f3bf2ffd640 1 -- 10.20.193.68:0/2099472337 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c00013470 con 0x7f3c0c131ad0 2026-02-18T21:02:25.671 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f71fd729640 1 -- 10.20.193.68:0/2405594410 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f8117140 con 0x7f71f812ac90 2026-02-18T21:02:25.672 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f3c14681640 1 -- 10.20.193.68:0/2099472337 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c0c1393c0 con 0x7f3c0c131ad0 2026-02-18T21:02:25.672 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f71fd729640 1 -- 10.20.193.68:0/2405594410 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f8132960 con 0x7f71f812ac90 2026-02-18T21:02:25.672 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f6f037fe640 1 -- 10.20.193.68:0/2111016997 --> v1:10.20.193.68:6808/3642986683 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f14012e50 con 0x7f6ef0056080 2026-02-18T21:02:25.672 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f6f037fe640 1 -- 10.20.193.68:0/2111016997 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f6f14068550 con 0x7f6f24123430 2026-02-18T21:02:25.672 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f68c2e9b640 1 -- 10.20.193.68:0/3299735405 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f68bc136830 con 0x7f68bc12ac90 2026-02-18T21:02:25.673 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f3c14681640 1 -- 10.20.193.68:0/2099472337 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c0c139e70 con 0x7f3c0c131ad0 2026-02-18T21:02:25.673 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f68b17fa640 1 -- 10.20.193.68:0/3299735405 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f68a4042a20 con 0x7f68bc12ac90 2026-02-18T21:02:25.673 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f71fd729640 1 -- 10.20.193.68:0/2405594410 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f71f8071420 con 0x7f71f812ac90 2026-02-18T21:02:25.673 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f3c14681640 1 -- 10.20.193.68:0/2099472337 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3c0c134480 con 0x7f3c0c131ad0 2026-02-18T21:02:25.674 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f68b17fa640 1 -- 10.20.193.68:0/3299735405 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f68a408bb60 con 0x7f68bc12ac90 2026-02-18T21:02:25.674 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f3bf2ffd640 1 -- 10.20.193.68:0/2099472337 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f3c00024060 con 0x7f3c0c131ad0 2026-02-18T21:02:25.674 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f68b17fa640 1 -- 10.20.193.68:0/3299735405 --> v1:10.20.193.68:6804/4160428224 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68a4038e50 con 0x7f688c056010 2026-02-18T21:02:25.674 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.632+0000 7f68b17fa640 1 -- 10.20.193.68:0/3299735405 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f68a40902c0 con 0x7f68bc12ac90 2026-02-18T21:02:25.674 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.633+0000 7f6f037fe640 1 -- 10.20.193.68:0/2111016997 <== osd.2 v1:10.20.193.68:6808/3642986683 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f6f14012e50 con 0x7f6ef0056080 2026-02-18T21:02:25.675 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.633+0000 7f71d77fe640 1 -- 10.20.193.68:0/2405594410 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f71e8014a10 con 0x7f71f812ac90 2026-02-18T21:02:25.675 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.633+0000 7f3bf2ffd640 1 -- 10.20.193.68:0/2099472337 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f3c00066c20 con 0x7f3c0c131ad0 2026-02-18T21:02:25.675 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.633+0000 7f3bf2ffd640 1 -- 10.20.193.68:0/2099472337 --> v1:10.20.193.68:6800/2637053487 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c0000e020 con 0x7f3bdc056010 2026-02-18T21:02:25.675 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.633+0000 7f3bf2ffd640 1 -- 10.20.193.68:0/2099472337 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3c00069320 con 0x7f3c0c131ad0 2026-02-18T21:02:25.675 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.633+0000 7f71d77fe640 1 -- 10.20.193.68:0/2405594410 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f71e8068010 con 0x7f71f812ac90 2026-02-18T21:02:25.675 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.633+0000 7f71d77fe640 1 -- 10.20.193.68:0/2405594410 --> v1:10.20.193.68:6812/1687218919 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f71c4059d30 con 0x7f71c4056080 2026-02-18T21:02:25.676 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.633+0000 7f71d77fe640 1 -- 10.20.193.68:0/2405594410 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f71e80684a0 con 0x7f71f812ac90 2026-02-18T21:02:25.676 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.633+0000 7f68b17fa640 1 -- 10.20.193.68:0/3299735405 <== osd.1 v1:10.20.193.68:6804/4160428224 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f68a4038e50 con 0x7f688c056010 2026-02-18T21:02:25.676 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.633+0000 7f3bf2ffd640 1 -- 10.20.193.68:0/2099472337 <== osd.0 v1:10.20.193.68:6800/2637053487 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f3c0000e020 con 0x7f3bdc056010 2026-02-18T21:02:25.676 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.634+0000 7f71d77fe640 1 -- 10.20.193.68:0/2405594410 <== osd.3 v1:10.20.193.68:6812/1687218919 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f71c4059d30 con 0x7f71c4056080 2026-02-18T21:02:25.676 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.639+0000 7f6f2937b640 1 -- 10.20.193.68:0/2111016997 --> v1:10.20.193.68:6808/3642986683 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6f2411b370 con 0x7f6ef0056080 2026-02-18T21:02:25.676 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f6f037fe640 1 -- 10.20.193.68:0/2111016997 <== osd.2 v1:10.20.193.68:6808/3642986683 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 3556540785) 0x7f6f2411b370 con 0x7f6ef0056080 2026-02-18T21:02:25.677 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f6f2937b640 1 -- 10.20.193.68:0/2111016997 >> v1:10.20.193.68:6808/3642986683 conn(0x7f6ef0056080 legacy=0x7f6ef00584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.677 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f6f2937b640 1 -- 10.20.193.68:0/2111016997 >> v1:10.20.193.68:6816/2904515774 conn(0x7f6ef004f790 legacy=0x7f6ef0051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.677 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f6f2937b640 1 -- 10.20.193.68:0/2111016997 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f6f24123430 msgr2=0x7f6f2411abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.677 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f6f2937b640 1 --2- 10.20.193.68:0/2111016997 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f6f24123430 0x7f6f2411abb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6f1400efc0 tx=0x7f6f1400c490 comp rx=0 tx=0).stop 2026-02-18T21:02:25.677 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f6f237fe640 1 -- 10.20.193.68:0/2111016997 reap_dead start 2026-02-18T21:02:25.677 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f6f2937b640 1 -- 10.20.193.68:0/2111016997 shutdown_connections 2026-02-18T21:02:25.677 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f6f2937b640 1 -- 10.20.193.68:0/2111016997 >> 10.20.193.68:0/2111016997 conn(0x7f6f2409cea0 msgr2=0x7f6f2412a930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.678 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f6f2937b640 1 -- 10.20.193.68:0/2111016997 shutdown_connections 2026-02-18T21:02:25.678 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f6f2937b640 1 -- 10.20.193.68:0/2111016997 wait complete. 2026-02-18T21:02:25.678 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f3c14681640 1 -- 10.20.193.68:0/2099472337 --> v1:10.20.193.68:6800/2637053487 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3c0c137890 con 0x7f3bdc056010 2026-02-18T21:02:25.678 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f3bf2ffd640 1 -- 10.20.193.68:0/2099472337 <== osd.0 v1:10.20.193.68:6800/2637053487 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 795413372) 0x7f3c0c137890 con 0x7f3bdc056010 2026-02-18T21:02:25.678 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f68c2e9b640 1 -- 10.20.193.68:0/3299735405 --> v1:10.20.193.68:6804/4160428224 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f68bc127b50 con 0x7f688c056010 2026-02-18T21:02:25.678 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f68b17fa640 1 -- 10.20.193.68:0/3299735405 <== osd.1 v1:10.20.193.68:6804/4160428224 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 3324758384) 0x7f68bc127b50 con 0x7f688c056010 2026-02-18T21:02:25.679 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f71fd729640 1 -- 10.20.193.68:0/2405594410 --> v1:10.20.193.68:6812/1687218919 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f71f8063340 con 0x7f71c4056080 2026-02-18T21:02:25.679 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f3c14681640 1 -- 10.20.193.68:0/2099472337 >> v1:10.20.193.68:6800/2637053487 conn(0x7f3bdc056010 legacy=0x7f3bdc058450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.679 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f3c14681640 1 -- 10.20.193.68:0/2099472337 >> v1:10.20.193.68:6816/2904515774 conn(0x7f3bdc04f790 legacy=0x7f3bdc051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.679 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f3c14681640 1 -- 10.20.193.68:0/2099472337 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f3c0c131ad0 msgr2=0x7f3c0c12e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.679 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f3c14681640 1 --2- 10.20.193.68:0/2099472337 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f3c0c131ad0 0x7f3c0c12e440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000ebe0 tx=0x7f3c0000c520 comp rx=0 tx=0).stop 2026-02-18T21:02:25.679 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f3c12bf7640 1 -- 10.20.193.68:0/2099472337 reap_dead start 2026-02-18T21:02:25.679 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f3c14681640 1 -- 10.20.193.68:0/2099472337 shutdown_connections 2026-02-18T21:02:25.680 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f3c14681640 1 -- 10.20.193.68:0/2099472337 >> 10.20.193.68:0/2099472337 conn(0x7f3c0c0a1930 msgr2=0x7f3c0c132de0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.680 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f3c14681640 1 -- 10.20.193.68:0/2099472337 shutdown_connections 2026-02-18T21:02:25.680 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f71d77fe640 1 -- 10.20.193.68:0/2405594410 <== osd.3 v1:10.20.193.68:6812/1687218919 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (unknown 0 0 1318614166) 0x7f71f8063340 con 0x7f71c4056080 2026-02-18T21:02:25.680 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f3c14681640 1 -- 10.20.193.68:0/2099472337 wait complete. 2026-02-18T21:02:25.680 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.640+0000 7f68c2e9b640 1 -- 10.20.193.68:0/3299735405 >> v1:10.20.193.68:6804/4160428224 conn(0x7f688c056010 legacy=0x7f688c058450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.681 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.641+0000 7f68c2e9b640 1 -- 10.20.193.68:0/3299735405 >> v1:10.20.193.68:6816/2904515774 conn(0x7f688c04f790 legacy=0x7f688c051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.681 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.641+0000 7f68c2e9b640 1 -- 10.20.193.68:0/3299735405 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f68bc12ac90 msgr2=0x7f68bc1150f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.681 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.641+0000 7f68c2e9b640 1 --2- 10.20.193.68:0/3299735405 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f68bc12ac90 0x7f68bc1150f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f68a4036000 tx=0x7f68a40047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.681 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.641+0000 7f68c1411640 1 -- 10.20.193.68:0/3299735405 reap_dead start 2026-02-18T21:02:25.681 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.641+0000 7f68c2e9b640 1 -- 10.20.193.68:0/3299735405 shutdown_connections 2026-02-18T21:02:25.681 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.641+0000 7f68c2e9b640 1 -- 10.20.193.68:0/3299735405 >> 10.20.193.68:0/3299735405 conn(0x7f68bc09cea0 msgr2=0x7f68bc127440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.681 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.641+0000 7f68c2e9b640 1 -- 10.20.193.68:0/3299735405 shutdown_connections 2026-02-18T21:02:25.681 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.641+0000 7f68c2e9b640 1 -- 10.20.193.68:0/3299735405 wait complete. 2026-02-18T21:02:25.682 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.641+0000 7f71fd729640 1 -- 10.20.193.68:0/2405594410 >> v1:10.20.193.68:6812/1687218919 conn(0x7f71c4056080 legacy=0x7f71c40584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.682 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.641+0000 7f71fd729640 1 -- 10.20.193.68:0/2405594410 >> v1:10.20.193.68:6816/2904515774 conn(0x7f71c404f790 legacy=0x7f71c4051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.682 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.641+0000 7f71fd729640 1 -- 10.20.193.68:0/2405594410 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f71f812ac90 msgr2=0x7f71f8132420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.682 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.641+0000 7f71fd729640 1 --2- 10.20.193.68:0/2405594410 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f71f812ac90 0x7f71f8132420 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009dd0 tx=0x7f71e800c490 comp rx=0 tx=0).stop 2026-02-18T21:02:25.682 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.641+0000 7f71f77fe640 1 -- 10.20.193.68:0/2405594410 reap_dead start 2026-02-18T21:02:25.682 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.641+0000 7f71fd729640 1 -- 10.20.193.68:0/2405594410 shutdown_connections 2026-02-18T21:02:25.682 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.641+0000 7f71fd729640 1 -- 10.20.193.68:0/2405594410 >> 10.20.193.68:0/2405594410 conn(0x7f71f809cea0 msgr2=0x7f71f806edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.682 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.641+0000 7f71fd729640 1 -- 10.20.193.68:0/2405594410 shutdown_connections 2026-02-18T21:02:25.682 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.641+0000 7f71fd729640 1 -- 10.20.193.68:0/2405594410 wait complete. 2026-02-18T21:02:25.682 INFO:teuthology.orchestra.run.trial068.stdout:111669149699 2026-02-18T21:02:25.683 INFO:teuthology.orchestra.run.trial068.stdout:120259084291 2026-02-18T21:02:25.683 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-18T21:02:25.683 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-18T21:02:25.684 INFO:teuthology.orchestra.run.trial068.stdout:115964116995 2026-02-18T21:02:25.684 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-18T21:02:25.685 INFO:teuthology.orchestra.run.trial068.stdout:124554051587 2026-02-18T21:02:25.685 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-18T21:02:25.791 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.791+0000 7f754657b640 1 Processor -- start 2026-02-18T21:02:25.791 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.791+0000 7f754657b640 1 -- start start 2026-02-18T21:02:25.792 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f754657b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f754012d090 0x7f754012d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.792 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f754657b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7540130060 0x7f75401304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.792 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f754657b640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f75401309e0 0x7f75401373f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.792 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f486c40c640 1 Processor -- start 2026-02-18T21:02:25.793 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f754657b640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f75400730a0 con 0x7f75401309e0 2026-02-18T21:02:25.793 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f754657b640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f7540130e90 con 0x7f7540130060 2026-02-18T21:02:25.793 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f754657b640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f75400726d0 con 0x7f754012d090 2026-02-18T21:02:25.794 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f486c40c640 1 -- start start 2026-02-18T21:02:25.794 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f753ffff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f754012d090 0x7f754012d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.795 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f7544af1640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f75401309e0 0x7f75401373f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.795 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f753f7fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7540130060 0x7f75401304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.795 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f753ffff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f754012d090 0x7f754012d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60654/0 (socket says 10.20.193.68:60654) 2026-02-18T21:02:25.795 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f753f7fe640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7540130060 0x7f75401304a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42388/0 (socket says 10.20.193.68:42388) 2026-02-18T21:02:25.795 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f753ffff640 1 -- 10.20.193.68:0/3368785279 learned_addr learned my addr 10.20.193.68:0/3368785279 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.795 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f7544af1640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f75401309e0 0x7f75401373f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:38838/0 (socket says 10.20.193.68:38838) 2026-02-18T21:02:25.795 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f7544af1640 1 -- 10.20.193.68:0/3368785279 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f754012d090 msgr2=0x7f754012d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:25.795 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f7544af1640 1 --2- 10.20.193.68:0/3368785279 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f754012d090 0x7f754012d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.795 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f7544af1640 1 -- 10.20.193.68:0/3368785279 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7540130060 msgr2=0x7f75401304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:25.796 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f486c40c640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f486412d090 0x7f486412d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.796 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f7544af1640 1 --2- 10.20.193.68:0/3368785279 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7540130060 0x7f75401304a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.796 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f7544af1640 1 -- 10.20.193.68:0/3368785279 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7540074190 con 0x7f75401309e0 2026-02-18T21:02:25.797 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f486c40c640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f4864130bb0 0x7f4864138400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.797 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f486c40c640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48640726d0 con 0x7f4864130060 2026-02-18T21:02:25.797 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f486c40c640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f48640730a0 con 0x7f4864130bb0 2026-02-18T21:02:25.797 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f486c40c640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f4864074190 con 0x7f486412d090 2026-02-18T21:02:25.797 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f486a181640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f486412d090 0x7f486412d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.797 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f486a181640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f486412d090 0x7f486412d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60664/0 (socket says 10.20.193.68:60664) 2026-02-18T21:02:25.798 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f486a181640 1 -- 10.20.193.68:0/13110062 learned_addr learned my addr 10.20.193.68:0/13110062 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.798 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f4869980640 1 --1- 10.20.193.68:0/13110062 >> v1:10.20.193.68:6789/0 conn(0x7f4864130060 0x7f48641304a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:44692/0 (socket says 10.20.193.68:44692) 2026-02-18T21:02:25.798 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f486a982640 1 --2- 10.20.193.68:0/13110062 >> v2:10.20.193.68:3300/0 conn(0x7f4864130bb0 0x7f4864138400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.798 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f96907d7640 1 Processor -- start 2026-02-18T21:02:25.798 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f486a181640 1 -- 10.20.193.68:0/13110062 >> v2:10.20.193.68:3300/0 conn(0x7f4864130bb0 msgr2=0x7f4864138400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:25.798 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f486a181640 1 --2- 10.20.193.68:0/13110062 >> v2:10.20.193.68:3300/0 conn(0x7f4864130bb0 0x7f4864138400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.799 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f486a181640 1 -- 10.20.193.68:0/13110062 >> v1:10.20.193.68:6789/0 conn(0x7f4864130060 legacy=0x7f48641304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.799 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f96907d7640 1 -- start start 2026-02-18T21:02:25.799 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f486917f640 1 -- 10.20.193.68:0/13110062 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2888189043 0 0) 0x7f48640726d0 con 0x7f4864130060 2026-02-18T21:02:25.799 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f486a181640 1 -- 10.20.193.68:0/13110062 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4864073e80 con 0x7f486412d090 2026-02-18T21:02:25.799 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f7544af1640 1 --2- 10.20.193.68:0/3368785279 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f75401309e0 0x7f75401373f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7534009d90 tx=0x7f753402f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffefffc3cb59d8e server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.800 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.792+0000 7f96907d7640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f968812d090 0x7f968812d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.800 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f96907d7640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9688130bb0 0x7f9688138400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.800 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f96907d7640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96880726d0 con 0x7f9688130060 2026-02-18T21:02:25.800 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f96907d7640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f96880730a0 con 0x7f9688130bb0 2026-02-18T21:02:25.800 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f96907d7640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f9688074190 con 0x7f968812d090 2026-02-18T21:02:25.801 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f753effd640 1 -- 10.20.193.68:0/3368785279 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753403c070 con 0x7f75401309e0 2026-02-18T21:02:25.801 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f968e54c640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f968812d090 0x7f968812d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.801 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f968e54c640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f968812d090 0x7f968812d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60678/0 (socket says 10.20.193.68:60678) 2026-02-18T21:02:25.801 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f968dd4b640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f9688130060 0x7f96881304a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:44706/0 (socket says 10.20.193.68:44706) 2026-02-18T21:02:25.801 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f968ed4d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9688130bb0 0x7f9688138400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.802 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f968e54c640 1 -- 10.20.193.68:0/1228489336 learned_addr learned my addr 10.20.193.68:0/1228489336 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.802 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f753effd640 1 -- 10.20.193.68:0/3368785279 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f753402fdf0 con 0x7f75401309e0 2026-02-18T21:02:25.802 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f753effd640 1 -- 10.20.193.68:0/3368785279 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7534037660 con 0x7f75401309e0 2026-02-18T21:02:25.802 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f968e54c640 1 -- 10.20.193.68:0/1228489336 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9688130bb0 msgr2=0x7f9688138400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:25.803 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f968e54c640 1 --2- 10.20.193.68:0/1228489336 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9688130bb0 0x7f9688138400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.803 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f968e54c640 1 -- 10.20.193.68:0/1228489336 >> v1:10.20.193.68:6789/0 conn(0x7f9688130060 legacy=0x7f96881304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.803 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f968d54a640 1 -- 10.20.193.68:0/1228489336 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 474976166 0 0) 0x7f96880726d0 con 0x7f9688130060 2026-02-18T21:02:25.803 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f968e54c640 1 -- 10.20.193.68:0/1228489336 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9688073e80 con 0x7f968812d090 2026-02-18T21:02:25.803 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f486a181640 1 --2- 10.20.193.68:0/13110062 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f486412d090 0x7f486412d470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f48540099a0 tx=0x7f485402ef50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85164e9962ad5748 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.803 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f486917f640 1 -- 10.20.193.68:0/13110062 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485403c070 con 0x7f486412d090 2026-02-18T21:02:25.804 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7fe4ccb1d640 1 Processor -- start 2026-02-18T21:02:25.804 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f754657b640 1 -- 10.20.193.68:0/3368785279 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f75401309e0 msgr2=0x7f75401373f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.804 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f754657b640 1 --2- 10.20.193.68:0/3368785279 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f75401309e0 0x7f75401373f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7534009d90 tx=0x7f753402f180 comp rx=0 tx=0).stop 2026-02-18T21:02:25.804 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f486917f640 1 -- 10.20.193.68:0/13110062 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f485402fbd0 con 0x7f486412d090 2026-02-18T21:02:25.805 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f486917f640 1 -- 10.20.193.68:0/13110062 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854037440 con 0x7f486412d090 2026-02-18T21:02:25.805 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7fe4ccb1d640 1 -- start start 2026-02-18T21:02:25.806 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f754657b640 1 -- 10.20.193.68:0/3368785279 shutdown_connections 2026-02-18T21:02:25.806 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f754657b640 1 --2- 10.20.193.68:0/3368785279 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7540130060 0x7f75401304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.806 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f754657b640 1 --2- 10.20.193.68:0/3368785279 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f75401309e0 0x7f75401373f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.806 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f754657b640 1 --2- 10.20.193.68:0/3368785279 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f754012d090 0x7f754012d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.806 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f754657b640 1 -- 10.20.193.68:0/3368785279 >> 10.20.193.68:0/3368785279 conn(0x7f75400a1c00 msgr2=0x7f75400a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.806 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f754657b640 1 -- 10.20.193.68:0/3368785279 shutdown_connections 2026-02-18T21:02:25.806 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f754657b640 1 -- 10.20.193.68:0/3368785279 wait complete. 2026-02-18T21:02:25.806 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f968e54c640 1 --2- 10.20.193.68:0/1228489336 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f968812d090 0x7f968812d470 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f96780099d0 tx=0x7f967802ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c282a0e915c19 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7fe4ccb1d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe4c812ac90 0x7fe4c812b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7fe4ccb1d640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fe4c8073680 0x7fe4c8071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7fe4ccb1d640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4c812a7b0 con 0x7fe4c8071960 2026-02-18T21:02:25.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7fe4ccb1d640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7fe4c8073e60 con 0x7fe4c8073680 2026-02-18T21:02:25.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7fe4ccb1d640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c8072d10 con 0x7fe4c812ac90 2026-02-18T21:02:25.808 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f968d54a640 1 -- 10.20.193.68:0/1228489336 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967803c070 con 0x7f968812d090 2026-02-18T21:02:25.808 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f968d54a640 1 -- 10.20.193.68:0/1228489336 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f967802fb90 con 0x7f968812d090 2026-02-18T21:02:25.808 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f968d54a640 1 -- 10.20.193.68:0/1228489336 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678037440 con 0x7f968812d090 2026-02-18T21:02:25.808 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7fe4c6575640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe4c812ac90 0x7fe4c812b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.808 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7fe4c5d74640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fe4c8073680 0x7fe4c8071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.809 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7fe4c6575640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe4c812ac90 0x7fe4c812b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42400/0 (socket says 10.20.193.68:42400) 2026-02-18T21:02:25.809 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f486c40c640 1 -- 10.20.193.68:0/13110062 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f486412d090 msgr2=0x7f486412d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.809 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f486c40c640 1 --2- 10.20.193.68:0/13110062 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f486412d090 0x7f486412d470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f48540099a0 tx=0x7f485402ef50 comp rx=0 tx=0).stop 2026-02-18T21:02:25.809 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7fe4c6575640 1 -- 10.20.193.68:0/3687422789 learned_addr learned my addr 10.20.193.68:0/3687422789 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.810 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f486c40c640 1 -- 10.20.193.68:0/13110062 shutdown_connections 2026-02-18T21:02:25.810 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f486c40c640 1 --2- 10.20.193.68:0/13110062 >> v2:10.20.193.68:3300/0 conn(0x7f4864130bb0 0x7f4864138400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.810 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f486c40c640 1 --2- 10.20.193.68:0/13110062 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f486412d090 0x7f486412d470 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.810 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f486c40c640 1 -- 10.20.193.68:0/13110062 >> 10.20.193.68:0/13110062 conn(0x7f48640a1c00 msgr2=0x7f48640a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.810 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f486c40c640 1 -- 10.20.193.68:0/13110062 shutdown_connections 2026-02-18T21:02:25.810 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7fe4c6575640 1 -- 10.20.193.68:0/3687422789 >> v2:10.20.193.68:3300/0 conn(0x7fe4c8073680 msgr2=0x7fe4c8071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:25.810 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7fe4c6575640 1 --2- 10.20.193.68:0/3687422789 >> v2:10.20.193.68:3300/0 conn(0x7fe4c8073680 0x7fe4c8071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.810 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7fe4c6575640 1 -- 10.20.193.68:0/3687422789 >> v1:10.20.193.68:6789/0 conn(0x7fe4c8071960 legacy=0x7fe4c8135060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.811 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f486c40c640 1 -- 10.20.193.68:0/13110062 wait complete. 2026-02-18T21:02:25.811 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7fe4c5573640 1 -- 10.20.193.68:0/3687422789 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4165415903 0 0) 0x7fe4c812a7b0 con 0x7fe4c8071960 2026-02-18T21:02:25.811 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7fe4c6575640 1 -- 10.20.193.68:0/3687422789 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c812b5b0 con 0x7fe4c812ac90 2026-02-18T21:02:25.811 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f96907d7640 1 -- 10.20.193.68:0/1228489336 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f968812d090 msgr2=0x7f968812d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.812 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.793+0000 7f96907d7640 1 --2- 10.20.193.68:0/1228489336 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f968812d090 0x7f968812d470 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f96780099d0 tx=0x7f967802ef60 comp rx=0 tx=0).stop 2026-02-18T21:02:25.812 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f754657b640 1 Processor -- start 2026-02-18T21:02:25.812 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f96907d7640 1 -- 10.20.193.68:0/1228489336 shutdown_connections 2026-02-18T21:02:25.812 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f96907d7640 1 --2- 10.20.193.68:0/1228489336 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9688130bb0 0x7f9688138400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.813 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f96907d7640 1 --2- 10.20.193.68:0/1228489336 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f968812d090 0x7f968812d470 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.813 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f96907d7640 1 -- 10.20.193.68:0/1228489336 >> 10.20.193.68:0/1228489336 conn(0x7f96880a1c00 msgr2=0x7f96880a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.813 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f96907d7640 1 -- 10.20.193.68:0/1228489336 shutdown_connections 2026-02-18T21:02:25.813 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f96907d7640 1 -- 10.20.193.68:0/1228489336 wait complete. 2026-02-18T21:02:25.813 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f754657b640 1 -- start start 2026-02-18T21:02:25.813 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7fe4c6575640 1 --2- 10.20.193.68:0/3687422789 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe4c812ac90 0x7fe4c812b070 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009970 tx=0x7fe4bc02ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb729763f29b5015 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.814 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f754657b640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f754012d090 0x7f754011c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.814 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f486c40c640 1 Processor -- start 2026-02-18T21:02:25.814 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f754657b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7540130060 0x7f754011cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.814 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f754657b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f75401309e0 0x7f75401c7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.815 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7fe4c5573640 1 -- 10.20.193.68:0/3687422789 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc03c070 con 0x7fe4c812ac90 2026-02-18T21:02:25.815 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7fe4c5573640 1 -- 10.20.193.68:0/3687422789 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4bc02fb10 con 0x7fe4c812ac90 2026-02-18T21:02:25.815 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7fe4c5573640 1 -- 10.20.193.68:0/3687422789 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc037440 con 0x7fe4c812ac90 2026-02-18T21:02:25.815 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f753ffff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f754012d090 0x7f754011c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.815 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f753ffff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f754012d090 0x7f754011c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:38882/0 (socket says 10.20.193.68:38882) 2026-02-18T21:02:25.815 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f753f7fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7540130060 0x7f754011cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.816 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f486c40c640 1 -- start start 2026-02-18T21:02:25.816 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f96907d7640 1 Processor -- start 2026-02-18T21:02:25.816 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f96907d7640 1 -- start start 2026-02-18T21:02:25.817 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7fe4ccb1d640 1 -- 10.20.193.68:0/3687422789 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe4c812ac90 msgr2=0x7fe4c812b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.817 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7fe4ccb1d640 1 --2- 10.20.193.68:0/3687422789 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe4c812ac90 0x7fe4c812b070 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009970 tx=0x7fe4bc02ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:25.817 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f486c40c640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f486412d090 0x7f48641260f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.817 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f486c40c640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4864130060 0x7f4864126630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.817 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f486c40c640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4864130bb0 0x7f486408fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.818 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7fe4ccb1d640 1 -- 10.20.193.68:0/3687422789 shutdown_connections 2026-02-18T21:02:25.818 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7fe4ccb1d640 1 --2- 10.20.193.68:0/3687422789 >> v2:10.20.193.68:3300/0 conn(0x7fe4c8073680 0x7fe4c8071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.818 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7fe4ccb1d640 1 --2- 10.20.193.68:0/3687422789 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe4c812ac90 0x7fe4c812b070 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.818 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7fe4ccb1d640 1 -- 10.20.193.68:0/3687422789 >> 10.20.193.68:0/3687422789 conn(0x7fe4c809cea0 msgr2=0x7fe4c809d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.818 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f486a181640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f486412d090 0x7f48641260f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.818 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f486a181640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f486412d090 0x7f48641260f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42428/0 (socket says 10.20.193.68:42428) 2026-02-18T21:02:25.819 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f96907d7640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f968812d090 0x7f9688126710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.819 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f96907d7640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9688130060 0x7f9688126c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.819 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f96907d7640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9688130bb0 0x7f9688121bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.819 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7fe4ccb1d640 1 -- 10.20.193.68:0/3687422789 shutdown_connections 2026-02-18T21:02:25.819 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f486a181640 1 -- 10.20.193.68:0/2239894928 learned_addr learned my addr 10.20.193.68:0/2239894928 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.819 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f486c40c640 1 -- 10.20.193.68:0/2239894928 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f4864072aa0 con 0x7f4864130060 2026-02-18T21:02:25.819 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f486c40c640 1 -- 10.20.193.68:0/2239894928 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f486412cdb0 con 0x7f486412d090 2026-02-18T21:02:25.820 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f486c40c640 1 -- 10.20.193.68:0/2239894928 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f4864072c20 con 0x7f4864130bb0 2026-02-18T21:02:25.820 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7fe4ccb1d640 1 -- 10.20.193.68:0/3687422789 wait complete. 2026-02-18T21:02:25.820 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f4869980640 1 --2- 10.20.193.68:0/2239894928 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4864130060 0x7f4864126630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.820 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f486a982640 1 --2- 10.20.193.68:0/2239894928 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4864130bb0 0x7f486408fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.821 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f96907d7640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f9688072aa0 con 0x7f968812d090 2026-02-18T21:02:25.821 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f96907d7640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f968812cdb0 con 0x7f9688130bb0 2026-02-18T21:02:25.821 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f96907d7640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f9688072c20 con 0x7f9688130060 2026-02-18T21:02:25.821 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f968ed4d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9688130bb0 0x7f9688121bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.821 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f968dd4b640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9688130060 0x7f9688126c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.821 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f968ed4d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9688130bb0 0x7f9688121bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42438/0 (socket says 10.20.193.68:42438) 2026-02-18T21:02:25.821 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f968ed4d640 1 -- 10.20.193.68:0/2067957865 learned_addr learned my addr 10.20.193.68:0/2067957865 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.821 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f968e54c640 1 --2- 10.20.193.68:0/2067957865 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f968812d090 0x7f9688126710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.822 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f486a181640 1 -- 10.20.193.68:0/2239894928 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4864130bb0 msgr2=0x7f486408fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.822 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f486a181640 1 --2- 10.20.193.68:0/2239894928 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4864130bb0 0x7f486408fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.822 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f486a181640 1 -- 10.20.193.68:0/2239894928 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4864130060 msgr2=0x7f4864126630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.822 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f486a181640 1 --2- 10.20.193.68:0/2239894928 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4864130060 0x7f4864126630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.822 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f486a181640 1 -- 10.20.193.68:0/2239894928 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4864122e30 con 0x7f486412d090 2026-02-18T21:02:25.822 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f968ed4d640 1 -- 10.20.193.68:0/2067957865 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9688130060 msgr2=0x7f9688126c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.823 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f968ed4d640 1 --2- 10.20.193.68:0/2067957865 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9688130060 0x7f9688126c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.823 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f968ed4d640 1 -- 10.20.193.68:0/2067957865 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f968812d090 msgr2=0x7f9688126710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.823 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f968ed4d640 1 --2- 10.20.193.68:0/2067957865 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f968812d090 0x7f9688126710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.823 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f968ed4d640 1 -- 10.20.193.68:0/2067957865 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96880904a0 con 0x7f9688130bb0 2026-02-18T21:02:25.823 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f753f7fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7540130060 0x7f754011cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60686/0 (socket says 10.20.193.68:60686) 2026-02-18T21:02:25.823 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f7544af1640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f75401309e0 0x7f75401c7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.823 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f754657b640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f754012cdb0 con 0x7f754012d090 2026-02-18T21:02:25.824 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f754657b640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f7540073f40 con 0x7f75401309e0 2026-02-18T21:02:25.824 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f754657b640 1 -- 10.20.193.68:0/4032682109 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f7540072aa0 con 0x7f7540130060 2026-02-18T21:02:25.824 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f753ffff640 1 -- 10.20.193.68:0/4032682109 learned_addr learned my addr 10.20.193.68:0/4032682109 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.824 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f486a181640 1 --2- 10.20.193.68:0/2239894928 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f486412d090 0x7f48641260f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f48540098f0 tx=0x7f48540047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.824 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f753ffff640 1 -- 10.20.193.68:0/4032682109 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7540130060 msgr2=0x7f754011cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.824 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f753ffff640 1 --2- 10.20.193.68:0/4032682109 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7540130060 0x7f754011cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.825 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f753ffff640 1 -- 10.20.193.68:0/4032682109 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f75401309e0 msgr2=0x7f75401c7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.825 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f753ffff640 1 --2- 10.20.193.68:0/4032682109 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f75401309e0 0x7f75401c7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.825 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f753ffff640 1 -- 10.20.193.68:0/4032682109 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f754011f840 con 0x7f754012d090 2026-02-18T21:02:25.825 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.794+0000 7f7544af1640 1 --2- 10.20.193.68:0/4032682109 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f75401309e0 0x7f75401c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:25.825 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f753ffff640 1 --2- 10.20.193.68:0/4032682109 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f754012d090 0x7f754011c6c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f752c00e930 tx=0x7f752c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.825 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f753cff9640 1 -- 10.20.193.68:0/4032682109 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c017070 con 0x7f754012d090 2026-02-18T21:02:25.825 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f968ed4d640 1 --2- 10.20.193.68:0/2067957865 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9688130bb0 0x7f9688121bd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f968400efc0 tx=0x7f968400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.825 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f968e54c640 1 --2- 10.20.193.68:0/2067957865 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f968812d090 0x7f9688126710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-18T21:02:25.826 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f753cff9640 1 -- 10.20.193.68:0/4032682109 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752c00ca00 con 0x7f754012d090 2026-02-18T21:02:25.826 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f754657b640 1 -- 10.20.193.68:0/4032682109 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f754011e820 con 0x7f754012d090 2026-02-18T21:02:25.826 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f753cff9640 1 -- 10.20.193.68:0/4032682109 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c00cdf0 con 0x7f754012d090 2026-02-18T21:02:25.826 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f754657b640 1 -- 10.20.193.68:0/4032682109 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f754011d140 con 0x7f754012d090 2026-02-18T21:02:25.827 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f484affd640 1 -- 10.20.193.68:0/2239894928 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485403c040 con 0x7f486412d090 2026-02-18T21:02:25.827 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f484affd640 1 -- 10.20.193.68:0/2239894928 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4854004030 con 0x7f486412d090 2026-02-18T21:02:25.827 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f486c40c640 1 -- 10.20.193.68:0/2239894928 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4864090dc0 con 0x7f486412d090 2026-02-18T21:02:25.827 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f484affd640 1 -- 10.20.193.68:0/2239894928 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854004420 con 0x7f486412d090 2026-02-18T21:02:25.827 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f966effd640 1 -- 10.20.193.68:0/2067957865 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684018020 con 0x7f9688130bb0 2026-02-18T21:02:25.827 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f966effd640 1 -- 10.20.193.68:0/2067957865 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9684014480 con 0x7f9688130bb0 2026-02-18T21:02:25.828 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f966effd640 1 -- 10.20.193.68:0/2067957865 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684014870 con 0x7f9688130bb0 2026-02-18T21:02:25.828 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f486c40c640 1 -- 10.20.193.68:0/2239894928 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4864122620 con 0x7f486412d090 2026-02-18T21:02:25.828 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f96907d7640 1 -- 10.20.193.68:0/2067957865 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9688122c50 con 0x7f9688130bb0 2026-02-18T21:02:25.828 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f96907d7640 1 -- 10.20.193.68:0/2067957865 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9688123630 con 0x7f9688130bb0 2026-02-18T21:02:25.829 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7fe4ccb1d640 1 Processor -- start 2026-02-18T21:02:25.829 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7fe4ccb1d640 1 -- start start 2026-02-18T21:02:25.829 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f754657b640 1 -- 10.20.193.68:0/4032682109 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75400687c0 con 0x7f754012d090 2026-02-18T21:02:25.829 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7f486c40c640 1 -- 10.20.193.68:0/2239894928 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48640687c0 con 0x7f486412d090 2026-02-18T21:02:25.830 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7fe4ccb1d640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fe4c8071960 0x7fe4c811adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.830 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7fe4ccb1d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe4c8073680 0x7fe4c811b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.830 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7fe4ccb1d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe4c812ac90 0x7fe4c811b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:25.830 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7fe4ccb1d640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c80721c0 con 0x7fe4c8071960 2026-02-18T21:02:25.830 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7fe4ccb1d640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c8072040 con 0x7fe4c8073680 2026-02-18T21:02:25.830 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7fe4ccb1d640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fe4c8114bb0 con 0x7fe4c812ac90 2026-02-18T21:02:25.830 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.795+0000 7fe4c6d76640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe4c812ac90 0x7fe4c811b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.830 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7f753cff9640 1 -- 10.20.193.68:0/4032682109 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f752c024060 con 0x7f754012d090 2026-02-18T21:02:25.831 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7fe4c6d76640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe4c812ac90 0x7fe4c811b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60708/0 (socket says 10.20.193.68:60708) 2026-02-18T21:02:25.831 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7fe4c6d76640 1 -- 10.20.193.68:0/3284000160 learned_addr learned my addr 10.20.193.68:0/3284000160 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:25.831 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7f96907d7640 1 -- 10.20.193.68:0/2067957865 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96880687c0 con 0x7f9688130bb0 2026-02-18T21:02:25.832 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7fe4c6575640 1 --2- 10.20.193.68:0/3284000160 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fe4c8071960 0x7fe4c811adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.832 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7fe4c5d74640 1 --2- 10.20.193.68:0/3284000160 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe4c8073680 0x7fe4c811b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:25.832 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7fe4c6d76640 1 -- 10.20.193.68:0/3284000160 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe4c8073680 msgr2=0x7fe4c811b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.832 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7fe4c6d76640 1 --2- 10.20.193.68:0/3284000160 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe4c8073680 0x7fe4c811b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.832 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7fe4c6d76640 1 -- 10.20.193.68:0/3284000160 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fe4c8071960 msgr2=0x7fe4c811adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.832 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7fe4c6d76640 1 --2- 10.20.193.68:0/3284000160 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fe4c8071960 0x7fe4c811adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.832 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7fe4c6d76640 1 -- 10.20.193.68:0/3284000160 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c811d200 con 0x7fe4c812ac90 2026-02-18T21:02:25.832 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7fe4c6d76640 1 --2- 10.20.193.68:0/3284000160 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe4c812ac90 0x7fe4c811b830 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800cc50 tx=0x7fe4b800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:25.832 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7f753cff9640 1 -- 10.20.193.68:0/4032682109 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f752c066ac0 con 0x7f754012d090 2026-02-18T21:02:25.833 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7fe4aeffd640 1 -- 10.20.193.68:0/3284000160 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8017070 con 0x7fe4c812ac90 2026-02-18T21:02:25.833 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7fe4aeffd640 1 -- 10.20.193.68:0/3284000160 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b8003a70 con 0x7fe4c812ac90 2026-02-18T21:02:25.833 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7fe4ccb1d640 1 -- 10.20.193.68:0/3284000160 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c81c2870 con 0x7fe4c812ac90 2026-02-18T21:02:25.833 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7fe4aeffd640 1 -- 10.20.193.68:0/3284000160 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8003e60 con 0x7fe4c812ac90 2026-02-18T21:02:25.833 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7fe4ccb1d640 1 -- 10.20.193.68:0/3284000160 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c81c2d70 con 0x7fe4c812ac90 2026-02-18T21:02:25.833 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7f966effd640 1 -- 10.20.193.68:0/2067957865 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f9684014a10 con 0x7f9688130bb0 2026-02-18T21:02:25.834 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7f484affd640 1 -- 10.20.193.68:0/2239894928 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f4854003710 con 0x7f486412d090 2026-02-18T21:02:25.834 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7f484affd640 1 -- 10.20.193.68:0/2239894928 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f485408bf00 con 0x7f486412d090 2026-02-18T21:02:25.834 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7f966effd640 1 -- 10.20.193.68:0/2067957865 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f9684068000 con 0x7f9688130bb0 2026-02-18T21:02:25.834 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.796+0000 7fe4ccb1d640 1 -- 10.20.193.68:0/3284000160 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c8074de0 con 0x7fe4c812ac90 2026-02-18T21:02:25.834 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.797+0000 7fe4aeffd640 1 -- 10.20.193.68:0/3284000160 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fe4b8005070 con 0x7fe4c812ac90 2026-02-18T21:02:25.834 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.797+0000 7fe4aeffd640 1 -- 10.20.193.68:0/3284000160 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7fe4b8066980 con 0x7fe4c812ac90 2026-02-18T21:02:25.835 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.798+0000 7f753cff9640 1 -- 10.20.193.68:0/4032682109 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f752c0408b0 con 0x7f754012d090 2026-02-18T21:02:25.835 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.798+0000 7f966effd640 1 -- 10.20.193.68:0/2067957865 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f9684022070 con 0x7f9688130bb0 2026-02-18T21:02:25.835 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.799+0000 7fe4aeffd640 1 -- 10.20.193.68:0/3284000160 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fe4b8040770 con 0x7fe4c812ac90 2026-02-18T21:02:25.835 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.800+0000 7f484affd640 1 -- 10.20.193.68:0/2239894928 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f4854065da0 con 0x7f486412d090 2026-02-18T21:02:25.869 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.869+0000 7fe4ccb1d640 1 -- 10.20.193.68:0/3284000160 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe4c811e620 con 0x7fe4c812ac90 2026-02-18T21:02:25.869 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.869+0000 7fe4aeffd640 1 -- 10.20.193.68:0/3284000160 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe4b8065a30 con 0x7fe4c812ac90 2026-02-18T21:02:25.869 INFO:teuthology.orchestra.run.trial068.stdout:124554051586 2026-02-18T21:02:25.870 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.870+0000 7f754657b640 1 -- 10.20.193.68:0/4032682109 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f754012d470 con 0x7f754012d090 2026-02-18T21:02:25.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.870+0000 7fe4ccb1d640 1 -- 10.20.193.68:0/3284000160 >> v1:10.20.193.68:6816/2904515774 conn(0x7fe49404f790 legacy=0x7fe494051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.870+0000 7fe4ccb1d640 1 -- 10.20.193.68:0/3284000160 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe4c812ac90 msgr2=0x7fe4c811b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.870+0000 7fe4ccb1d640 1 --2- 10.20.193.68:0/3284000160 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe4c812ac90 0x7fe4c811b830 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800cc50 tx=0x7fe4b800a430 comp rx=0 tx=0).stop 2026-02-18T21:02:25.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.870+0000 7fe4ccb1d640 1 -- 10.20.193.68:0/3284000160 shutdown_connections 2026-02-18T21:02:25.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.870+0000 7fe4ccb1d640 1 --2- 10.20.193.68:0/3284000160 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fe4c812ac90 0x7fe4c811b830 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.870+0000 7fe4ccb1d640 1 --2- 10.20.193.68:0/3284000160 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fe4c8073680 0x7fe4c811b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.870+0000 7fe4ccb1d640 1 --2- 10.20.193.68:0/3284000160 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fe4c8071960 0x7fe4c811adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.870+0000 7fe4ccb1d640 1 -- 10.20.193.68:0/3284000160 >> 10.20.193.68:0/3284000160 conn(0x7fe4c809cea0 msgr2=0x7fe4c806e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.871 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.870+0000 7f753cff9640 1 -- 10.20.193.68:0/4032682109 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f752c065b70 con 0x7f754012d090 2026-02-18T21:02:25.872 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.870+0000 7fe4ccb1d640 1 -- 10.20.193.68:0/3284000160 shutdown_connections 2026-02-18T21:02:25.872 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.871+0000 7fe4ccb1d640 1 -- 10.20.193.68:0/3284000160 wait complete. 2026-02-18T21:02:25.872 INFO:teuthology.orchestra.run.trial068.stdout:115964116994 2026-02-18T21:02:25.872 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.872+0000 7f96907d7640 1 -- 10.20.193.68:0/2067957865 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f968812e660 con 0x7f9688130bb0 2026-02-18T21:02:25.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.872+0000 7f754657b640 1 -- 10.20.193.68:0/4032682109 >> v1:10.20.193.68:6816/2904515774 conn(0x7f751004f7c0 legacy=0x7f7510051c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.872+0000 7f754657b640 1 -- 10.20.193.68:0/4032682109 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f754012d090 msgr2=0x7f754011c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.872+0000 7f754657b640 1 --2- 10.20.193.68:0/4032682109 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f754012d090 0x7f754011c6c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f752c00e930 tx=0x7f752c00ee00 comp rx=0 tx=0).stop 2026-02-18T21:02:25.873 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.872+0000 7f966effd640 1 -- 10.20.193.68:0/2067957865 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f968812e660 con 0x7f9688130bb0 2026-02-18T21:02:25.874 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.872+0000 7f754657b640 1 -- 10.20.193.68:0/4032682109 shutdown_connections 2026-02-18T21:02:25.874 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.872+0000 7f754657b640 1 --2- 10.20.193.68:0/4032682109 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f75401309e0 0x7f75401c7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.874 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.872+0000 7f754657b640 1 --2- 10.20.193.68:0/4032682109 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7540130060 0x7f754011cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.874 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.872+0000 7f754657b640 1 --2- 10.20.193.68:0/4032682109 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f754012d090 0x7f754011c6c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.874 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.872+0000 7f754657b640 1 -- 10.20.193.68:0/4032682109 >> 10.20.193.68:0/4032682109 conn(0x7f75400a1c00 msgr2=0x7f754006e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.874 INFO:teuthology.orchestra.run.trial068.stdout:111669149698 2026-02-18T21:02:25.875 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.872+0000 7f754657b640 1 -- 10.20.193.68:0/4032682109 shutdown_connections 2026-02-18T21:02:25.875 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.872+0000 7f754657b640 1 -- 10.20.193.68:0/4032682109 wait complete. 2026-02-18T21:02:25.875 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.873+0000 7f486c40c640 1 -- 10.20.193.68:0/2239894928 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f48641282a0 con 0x7f486412d090 2026-02-18T21:02:25.875 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.873+0000 7f484affd640 1 -- 10.20.193.68:0/2239894928 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f48641282a0 con 0x7f486412d090 2026-02-18T21:02:25.876 INFO:teuthology.orchestra.run.trial068.stdout:120259084290 2026-02-18T21:02:25.876 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.874+0000 7f96907d7640 1 -- 10.20.193.68:0/2067957865 >> v1:10.20.193.68:6816/2904515774 conn(0x7f965804f860 legacy=0x7f9658051d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.876 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.874+0000 7f96907d7640 1 -- 10.20.193.68:0/2067957865 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9688130bb0 msgr2=0x7f9688121bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.876 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.874+0000 7f96907d7640 1 --2- 10.20.193.68:0/2067957865 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9688130bb0 0x7f9688121bd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f968400efc0 tx=0x7f968400c490 comp rx=0 tx=0).stop 2026-02-18T21:02:25.877 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.874+0000 7f96907d7640 1 -- 10.20.193.68:0/2067957865 shutdown_connections 2026-02-18T21:02:25.877 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.874+0000 7f96907d7640 1 --2- 10.20.193.68:0/2067957865 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9688130bb0 0x7f9688121bd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.877 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.874+0000 7f96907d7640 1 --2- 10.20.193.68:0/2067957865 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9688130060 0x7f9688126c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.877 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.874+0000 7f96907d7640 1 --2- 10.20.193.68:0/2067957865 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f968812d090 0x7f9688126710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.877 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.874+0000 7f96907d7640 1 -- 10.20.193.68:0/2067957865 >> 10.20.193.68:0/2067957865 conn(0x7f96880a1c00 msgr2=0x7f968812eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.877 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.874+0000 7f96907d7640 1 -- 10.20.193.68:0/2067957865 shutdown_connections 2026-02-18T21:02:25.877 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.874+0000 7f96907d7640 1 -- 10.20.193.68:0/2067957865 wait complete. 2026-02-18T21:02:25.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.875+0000 7f486c40c640 1 -- 10.20.193.68:0/2239894928 >> v1:10.20.193.68:6816/2904515774 conn(0x7f483404f790 legacy=0x7f4834051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.875+0000 7f486c40c640 1 -- 10.20.193.68:0/2239894928 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f486412d090 msgr2=0x7f48641260f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:25.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.875+0000 7f486c40c640 1 --2- 10.20.193.68:0/2239894928 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f486412d090 0x7f48641260f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f48540098f0 tx=0x7f48540047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.875+0000 7f486c40c640 1 -- 10.20.193.68:0/2239894928 shutdown_connections 2026-02-18T21:02:25.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.875+0000 7f486c40c640 1 --2- 10.20.193.68:0/2239894928 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4864130bb0 0x7f486408fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.875+0000 7f486c40c640 1 --2- 10.20.193.68:0/2239894928 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4864130060 0x7f4864126630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.875+0000 7f486c40c640 1 --2- 10.20.193.68:0/2239894928 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f486412d090 0x7f48641260f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:25.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.875+0000 7f486c40c640 1 -- 10.20.193.68:0/2239894928 >> 10.20.193.68:0/2239894928 conn(0x7f48640a1c00 msgr2=0x7f486412de40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:25.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.875+0000 7f486c40c640 1 -- 10.20.193.68:0/2239894928 shutdown_connections 2026-02-18T21:02:25.878 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:25.875+0000 7f486c40c640 1 -- 10.20.193.68:0/2239894928 wait complete. 2026-02-18T21:02:25.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.3 2026-02-18T21:02:25.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964116995 got 115964116994 for osd.1 2026-02-18T21:02:25.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149699 got 111669149698 for osd.0 2026-02-18T21:02:25.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.2 2026-02-18T21:02:26.882 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-18T21:02:26.883 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-18T21:02:26.884 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-18T21:02:26.884 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-18T21:02:26.955 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.952+0000 7f29dedb4640 1 Processor -- start 2026-02-18T21:02:26.956 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.952+0000 7f29dedb4640 1 -- start start 2026-02-18T21:02:26.956 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.952+0000 7f29dedb4640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f29d8072e20 0x7f29d8073200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:26.956 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.952+0000 7f29dedb4640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f29d8073740 0x7f29d8122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:26.956 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.952+0000 7f29dedb4640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f29d8123430 0x7f29d81238a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:26.956 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.952+0000 7f29dedb4640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f29d8071520 con 0x7f29d8073740 2026-02-18T21:02:26.956 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.952+0000 7f29dedb4640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f29d809e050 con 0x7f29d8072e20 2026-02-18T21:02:26.956 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.952+0000 7f29dedb4640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f29d8115730 con 0x7f29d8123430 2026-02-18T21:02:26.956 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f29dcb29640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f29d8072e20 0x7f29d8073200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:26.956 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f29cffff640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f29d8073740 0x7f29d8122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:26.956 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f29dd32a640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f29d8123430 0x7f29d81238a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:26.957 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f29dd32a640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f29d8123430 0x7f29d81238a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60716/0 (socket says 10.20.193.68:60716) 2026-02-18T21:02:26.957 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f29dd32a640 1 -- 10.20.193.68:0/4194027454 learned_addr learned my addr 10.20.193.68:0/4194027454 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:26.957 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f29dcb29640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f29d8072e20 0x7f29d8073200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42460/0 (socket says 10.20.193.68:42460) 2026-02-18T21:02:26.957 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f29dd32a640 1 -- 10.20.193.68:0/4194027454 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f29d8072e20 msgr2=0x7f29d8073200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:26.957 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f29dd32a640 1 --2- 10.20.193.68:0/4194027454 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f29d8072e20 0x7f29d8073200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:26.957 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f29dd32a640 1 -- 10.20.193.68:0/4194027454 >> v2:10.20.193.68:3300/0 conn(0x7f29d8073740 msgr2=0x7f29d8122ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:26.957 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f29dd32a640 1 --2- 10.20.193.68:0/4194027454 >> v2:10.20.193.68:3300/0 conn(0x7f29d8073740 0x7f29d8122ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:26.957 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f29dd32a640 1 -- 10.20.193.68:0/4194027454 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d81159f0 con 0x7f29d8123430 2026-02-18T21:02:26.958 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f9349182640 1 Processor -- start 2026-02-18T21:02:26.958 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f9349182640 1 -- start start 2026-02-18T21:02:26.958 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7fb757c3f640 1 Processor -- start 2026-02-18T21:02:26.959 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7fb757c3f640 1 -- start start 2026-02-18T21:02:26.959 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f29dd32a640 1 --2- 10.20.193.68:0/4194027454 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f29d8123430 0x7f29d81238a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f29d4009e50 tx=0x7f29d402f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad54dae9068f4156 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:26.960 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f9349182640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9344072e20 0x7f9344073200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:26.960 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f9349182640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9344073740 0x7f9344122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:26.960 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f9349182640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f934409e050 con 0x7f9344123430 2026-02-18T21:02:26.960 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f9349182640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f9344071520 con 0x7f9344072e20 2026-02-18T21:02:26.961 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f9349182640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f9344115730 con 0x7f9344073740 2026-02-18T21:02:26.961 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f9342d76640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9344072e20 0x7f9344073200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:26.961 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f9342d76640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9344072e20 0x7f9344073200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42476/0 (socket says 10.20.193.68:42476) 2026-02-18T21:02:26.961 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f9343577640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f9344123430 0x7f93441340f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:44710/0 (socket says 10.20.193.68:44710) 2026-02-18T21:02:26.961 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f9342575640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9344073740 0x7f9344122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:26.961 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f9342d76640 1 -- 10.20.193.68:0/1544670680 learned_addr learned my addr 10.20.193.68:0/1544670680 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:26.961 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f29cf7fe640 1 -- 10.20.193.68:0/4194027454 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d402fc70 con 0x7f29d8123430 2026-02-18T21:02:26.962 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f29cf7fe640 1 -- 10.20.193.68:0/4194027454 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d402fe10 con 0x7f29d8123430 2026-02-18T21:02:26.962 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7fb757c3f640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fb75012d090 0x7fb75012d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:26.962 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7fb757c3f640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb750130be0 0x7fb750138400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:26.963 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f29cf7fe640 1 -- 10.20.193.68:0/4194027454 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d4037610 con 0x7f29d8123430 2026-02-18T21:02:26.963 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7fb757c3f640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7500726d0 con 0x7fb750130060 2026-02-18T21:02:26.964 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7fb757c3f640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7fb7500730a0 con 0x7fb75012d090 2026-02-18T21:02:26.964 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7fb757c3f640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fb750074190 con 0x7fb750130be0 2026-02-18T21:02:26.964 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7fb7559b4640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fb75012d090 0x7fb75012d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:26.964 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7fb7551b3640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fb750130060 0x7fb7501304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:44720/0 (socket says 10.20.193.68:44720) 2026-02-18T21:02:26.965 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f9342d76640 1 -- 10.20.193.68:0/1544670680 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9344073740 msgr2=0x7f9344122ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:26.965 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f9342d76640 1 --2- 10.20.193.68:0/1544670680 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9344073740 0x7f9344122ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:26.965 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7fb7551b3640 1 -- 10.20.193.68:0/3562124782 learned_addr learned my addr 10.20.193.68:0/3562124782 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:26.966 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f9342d76640 1 -- 10.20.193.68:0/1544670680 >> v1:10.20.193.68:6789/0 conn(0x7f9344123430 legacy=0x7f93441340f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:26.966 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f9342d76640 1 -- 10.20.193.68:0/1544670680 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93441159f0 con 0x7f9344072e20 2026-02-18T21:02:26.966 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7f9341d74640 1 -- 10.20.193.68:0/1544670680 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2124712206 0 0) 0x7f934409e050 con 0x7f9344123430 2026-02-18T21:02:26.967 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.953+0000 7fb7561b5640 1 --2- 10.20.193.68:0/3562124782 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb750130be0 0x7fb750138400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:26.967 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f29dedb4640 1 -- 10.20.193.68:0/4194027454 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f29d8123430 msgr2=0x7f29d81238a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:26.968 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f29dedb4640 1 --2- 10.20.193.68:0/4194027454 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f29d8123430 0x7f29d81238a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f29d4009e50 tx=0x7f29d402f210 comp rx=0 tx=0).stop 2026-02-18T21:02:26.968 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7fb7559b4640 1 -- 10.20.193.68:0/3562124782 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb750130be0 msgr2=0x7fb750138400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:26.968 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7fb7559b4640 1 --2- 10.20.193.68:0/3562124782 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb750130be0 0x7fb750138400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:26.969 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7fb7559b4640 1 -- 10.20.193.68:0/3562124782 >> v1:10.20.193.68:6789/0 conn(0x7fb750130060 legacy=0x7fb7501304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:26.969 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7fb7559b4640 1 -- 10.20.193.68:0/3562124782 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb750073e80 con 0x7fb75012d090 2026-02-18T21:02:26.970 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f29dedb4640 1 -- 10.20.193.68:0/4194027454 shutdown_connections 2026-02-18T21:02:26.970 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f29dedb4640 1 --2- 10.20.193.68:0/4194027454 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f29d8123430 0x7f29d81238a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:26.970 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f29dedb4640 1 --2- 10.20.193.68:0/4194027454 >> v2:10.20.193.68:3300/0 conn(0x7f29d8073740 0x7f29d8122ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:26.970 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f29dedb4640 1 --2- 10.20.193.68:0/4194027454 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f29d8072e20 0x7f29d8073200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:26.970 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f29dedb4640 1 -- 10.20.193.68:0/4194027454 >> 10.20.193.68:0/4194027454 conn(0x7f29d809cea0 msgr2=0x7f29d809d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:26.970 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f29dedb4640 1 -- 10.20.193.68:0/4194027454 shutdown_connections 2026-02-18T21:02:26.970 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f29dedb4640 1 -- 10.20.193.68:0/4194027454 wait complete. 2026-02-18T21:02:26.972 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f9342d76640 1 --2- 10.20.193.68:0/1544670680 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9344072e20 0x7f9344073200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f93380099a0 tx=0x7f933802ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6797f624b50b047 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:26.972 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f9341d74640 1 -- 10.20.193.68:0/1544670680 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933803c070 con 0x7f9344072e20 2026-02-18T21:02:26.972 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f9341d74640 1 -- 10.20.193.68:0/1544670680 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f933802fb00 con 0x7f9344072e20 2026-02-18T21:02:26.973 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f9341d74640 1 -- 10.20.193.68:0/1544670680 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9338037440 con 0x7f9344072e20 2026-02-18T21:02:26.973 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7fb7559b4640 1 --2- 10.20.193.68:0/3562124782 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fb75012d090 0x7fb75012d470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb7400098a0 tx=0x7fb74002ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04c5e00ca311571 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:26.973 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7fb7549b2640 1 -- 10.20.193.68:0/3562124782 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74003c070 con 0x7fb75012d090 2026-02-18T21:02:26.973 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7fb7549b2640 1 -- 10.20.193.68:0/3562124782 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb74002fad0 con 0x7fb75012d090 2026-02-18T21:02:26.974 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f29dedb4640 1 Processor -- start 2026-02-18T21:02:26.974 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7fb7549b2640 1 -- 10.20.193.68:0/3562124782 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb740037440 con 0x7fb75012d090 2026-02-18T21:02:26.974 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f29dedb4640 1 -- start start 2026-02-18T21:02:26.975 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f9349182640 1 -- 10.20.193.68:0/1544670680 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9344072e20 msgr2=0x7f9344073200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:26.975 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f9349182640 1 --2- 10.20.193.68:0/1544670680 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9344072e20 0x7f9344073200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f93380099a0 tx=0x7f933802ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:26.975 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f9349182640 1 -- 10.20.193.68:0/1544670680 shutdown_connections 2026-02-18T21:02:26.975 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f9349182640 1 --2- 10.20.193.68:0/1544670680 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9344073740 0x7f9344122ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:26.975 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f9349182640 1 --2- 10.20.193.68:0/1544670680 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9344072e20 0x7f9344073200 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:26.976 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f29dedb4640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f29d8072e20 0x7f29d81c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:26.976 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f29dedb4640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f29d8073740 0x7f29d81c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:26.976 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f9349182640 1 -- 10.20.193.68:0/1544670680 >> 10.20.193.68:0/1544670680 conn(0x7f934409cea0 msgr2=0x7f934409d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:26.977 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f29dedb4640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f29d8123430 0x7f29d81c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:26.977 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f29dedb4640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f29d81340f0 con 0x7f29d8072e20 2026-02-18T21:02:26.977 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f29dedb4640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f29d8073b40 con 0x7f29d8073740 2026-02-18T21:02:26.977 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f29dedb4640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f29d8134270 con 0x7f29d8123430 2026-02-18T21:02:26.978 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f9349182640 1 -- 10.20.193.68:0/1544670680 shutdown_connections 2026-02-18T21:02:26.978 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7f9349182640 1 -- 10.20.193.68:0/1544670680 wait complete. 2026-02-18T21:02:26.979 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.954+0000 7fce7e25e640 1 Processor -- start 2026-02-18T21:02:26.980 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f29dcb29640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f29d8072e20 0x7f29d81c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:26.980 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fb757c3f640 1 -- 10.20.193.68:0/3562124782 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fb75012d090 msgr2=0x7fb75012d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:26.980 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f29dcb29640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f29d8072e20 0x7f29d81c7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:38958/0 (socket says 10.20.193.68:38958) 2026-02-18T21:02:26.981 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f29dcb29640 1 -- 10.20.193.68:0/1662362429 learned_addr learned my addr 10.20.193.68:0/1662362429 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:26.981 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f29cffff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f29d8073740 0x7f29d81c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:26.981 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fb757c3f640 1 --2- 10.20.193.68:0/3562124782 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fb75012d090 0x7fb75012d470 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb7400098a0 tx=0x7fb74002ee10 comp rx=0 tx=0).stop 2026-02-18T21:02:26.981 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f29dd32a640 1 --2- 10.20.193.68:0/1662362429 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f29d8123430 0x7f29d81c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:26.982 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fce7e25e640 1 -- start start 2026-02-18T21:02:26.982 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fb757c3f640 1 -- 10.20.193.68:0/3562124782 shutdown_connections 2026-02-18T21:02:26.982 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fb757c3f640 1 --2- 10.20.193.68:0/3562124782 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb750130be0 0x7fb750138400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:26.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fb757c3f640 1 --2- 10.20.193.68:0/3562124782 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fb75012d090 0x7fb75012d470 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:26.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fb757c3f640 1 -- 10.20.193.68:0/3562124782 >> 10.20.193.68:0/3562124782 conn(0x7fb7500a1c00 msgr2=0x7fb7500a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:26.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fb757c3f640 1 -- 10.20.193.68:0/3562124782 shutdown_connections 2026-02-18T21:02:26.983 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fb757c3f640 1 -- 10.20.193.68:0/3562124782 wait complete. 2026-02-18T21:02:26.984 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f29dcb29640 1 -- 10.20.193.68:0/1662362429 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f29d8123430 msgr2=0x7f29d81c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:26.984 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f29dcb29640 1 --2- 10.20.193.68:0/1662362429 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f29d8123430 0x7f29d81c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:26.984 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f29dcb29640 1 -- 10.20.193.68:0/1662362429 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f29d8073740 msgr2=0x7f29d81c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:26.984 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f29dcb29640 1 --2- 10.20.193.68:0/1662362429 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f29d8073740 0x7f29d81c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:26.984 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f29dcb29640 1 -- 10.20.193.68:0/1662362429 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d81177f0 con 0x7f29d8072e20 2026-02-18T21:02:26.984 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f29dd32a640 1 --2- 10.20.193.68:0/1662362429 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f29d8123430 0x7f29d81c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:26.985 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f29cffff640 1 --2- 10.20.193.68:0/1662362429 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f29d8073740 0x7f29d81c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:26.985 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f29dcb29640 1 --2- 10.20.193.68:0/1662362429 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f29d8072e20 0x7f29d81c7100 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f29c800ebe0 tx=0x7f29c800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:26.985 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f29cd7fa640 1 -- 10.20.193.68:0/1662362429 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8017070 con 0x7f29d8072e20 2026-02-18T21:02:26.985 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f29cd7fa640 1 -- 10.20.193.68:0/1662362429 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29c800cc40 con 0x7f29d8072e20 2026-02-18T21:02:26.985 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f29dedb4640 1 -- 10.20.193.68:0/1662362429 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d8125ed0 con 0x7f29d8072e20 2026-02-18T21:02:26.985 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f29cd7fa640 1 -- 10.20.193.68:0/1662362429 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8013470 con 0x7f29d8072e20 2026-02-18T21:02:26.986 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fce7e25e640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fce781333d0 0x7fce781357c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:26.987 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fce7e25e640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fce78135d00 0x7fce781380f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:26.987 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fce7e25e640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce780726d0 con 0x7fce7812d090 2026-02-18T21:02:26.987 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f29dedb4640 1 -- 10.20.193.68:0/1662362429 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d8115cb0 con 0x7f29d8072e20 2026-02-18T21:02:26.988 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fce7e25e640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7fce780730a0 con 0x7fce781333d0 2026-02-18T21:02:26.988 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fce7e25e640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fce78074190 con 0x7fce78135d00 2026-02-18T21:02:26.988 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fce777fe640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fce7812d090 0x7fce7812d470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:44724/0 (socket says 10.20.193.68:44724) 2026-02-18T21:02:26.989 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fce777fe640 1 -- 10.20.193.68:0/2115062647 learned_addr learned my addr 10.20.193.68:0/2115062647 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:26.989 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fce76ffd640 1 --2- 10.20.193.68:0/2115062647 >> v2:10.20.193.68:3300/0 conn(0x7fce781333d0 0x7fce781357c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:26.989 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fce77fff640 1 --2- 10.20.193.68:0/2115062647 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fce78135d00 0x7fce781380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:26.989 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f9349182640 1 Processor -- start 2026-02-18T21:02:26.990 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fce76ffd640 1 -- 10.20.193.68:0/2115062647 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fce78135d00 msgr2=0x7fce781380f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:26.990 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fce76ffd640 1 --2- 10.20.193.68:0/2115062647 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fce78135d00 0x7fce781380f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:26.990 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fce76ffd640 1 -- 10.20.193.68:0/2115062647 >> v1:10.20.193.68:6789/0 conn(0x7fce7812d090 legacy=0x7fce7812d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:26.991 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fb757c3f640 1 Processor -- start 2026-02-18T21:02:26.991 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f9349182640 1 -- start start 2026-02-18T21:02:26.991 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fce76ffd640 1 -- 10.20.193.68:0/2115062647 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce78073e80 con 0x7fce781333d0 2026-02-18T21:02:26.992 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fce77fff640 1 --2- 10.20.193.68:0/2115062647 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fce78135d00 0x7fce781380f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:26.992 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fb757c3f640 1 -- start start 2026-02-18T21:02:26.992 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f9349182640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9344072e20 0x7f9344119b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:26.992 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f9349182640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9344073740 0x7f934411a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:26.992 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f9349182640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9344123430 0x7f934411a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:26.993 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f9349182640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f93441238e0 con 0x7f9344072e20 2026-02-18T21:02:26.993 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f9349182640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f9344073b40 con 0x7f9344123430 2026-02-18T21:02:26.993 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f9349182640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f9344123a60 con 0x7f9344073740 2026-02-18T21:02:26.993 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fb757c3f640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fb75012d090 0x7fb750133f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:26.993 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fb757c3f640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb750130060 0x7fb7501344b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:26.993 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fb757c3f640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fb750130be0 0x7fb7501349f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:26.993 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fb757c3f640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fb750072aa0 con 0x7fb75012d090 2026-02-18T21:02:26.994 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fb757c3f640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fb75012cdb0 con 0x7fb750130060 2026-02-18T21:02:26.994 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7fb757c3f640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fb750072c20 con 0x7fb750130be0 2026-02-18T21:02:26.994 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.955+0000 7f29dedb4640 1 -- 10.20.193.68:0/1662362429 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29d8122ef0 con 0x7f29d8072e20 2026-02-18T21:02:26.994 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7f9342575640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9344073740 0x7f934411a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:26.994 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7f9342575640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9344073740 0x7f934411a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60734/0 (socket says 10.20.193.68:60734) 2026-02-18T21:02:26.994 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7f9342575640 1 -- 10.20.193.68:0/2785018206 learned_addr learned my addr 10.20.193.68:0/2785018206 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:26.995 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7f9343577640 1 --2- 10.20.193.68:0/2785018206 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9344123430 0x7f934411a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:26.995 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fb7551b3640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb750130060 0x7fb7501344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:26.995 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fb7559b4640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fb75012d090 0x7fb750133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:26.995 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7f9342d76640 1 --2- 10.20.193.68:0/2785018206 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9344072e20 0x7f9344119b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:26.995 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fb7551b3640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb750130060 0x7fb7501344b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42508/0 (socket says 10.20.193.68:42508) 2026-02-18T21:02:26.995 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fb7551b3640 1 -- 10.20.193.68:0/2722886136 learned_addr learned my addr 10.20.193.68:0/2722886136 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:26.996 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fb7561b5640 1 --2- 10.20.193.68:0/2722886136 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fb750130be0 0x7fb7501349f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:26.996 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fce76ffd640 1 --2- 10.20.193.68:0/2115062647 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fce781333d0 0x7fce781357c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fce680098a0 tx=0x7fce6802ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10352ba5e4e1c2c server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:26.996 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7f9342575640 1 -- 10.20.193.68:0/2785018206 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9344123430 msgr2=0x7f934411a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:26.996 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7f9342575640 1 --2- 10.20.193.68:0/2785018206 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9344123430 0x7f934411a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:26.996 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7f9342575640 1 -- 10.20.193.68:0/2785018206 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9344072e20 msgr2=0x7f9344119b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:26.996 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7f9342575640 1 --2- 10.20.193.68:0/2785018206 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9344072e20 0x7f9344119b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:26.996 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7f9342575640 1 -- 10.20.193.68:0/2785018206 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9344071f70 con 0x7f9344073740 2026-02-18T21:02:26.997 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fb7559b4640 1 -- 10.20.193.68:0/2722886136 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fb750130be0 msgr2=0x7fb7501349f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:26.997 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fb7559b4640 1 --2- 10.20.193.68:0/2722886136 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fb750130be0 0x7fb7501349f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:26.997 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fb7559b4640 1 -- 10.20.193.68:0/2722886136 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb750130060 msgr2=0x7fb7501344b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:26.997 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fb7559b4640 1 --2- 10.20.193.68:0/2722886136 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb750130060 0x7fb7501344b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:26.997 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fce767fc640 1 -- 10.20.193.68:0/2115062647 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6803c070 con 0x7fce781333d0 2026-02-18T21:02:26.997 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fb7559b4640 1 -- 10.20.193.68:0/2722886136 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb750136470 con 0x7fb75012d090 2026-02-18T21:02:26.997 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7f9342575640 1 --2- 10.20.193.68:0/2785018206 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9344073740 0x7f934411a040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f932c00ebb0 tx=0x7f932c00c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:26.998 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7f29cd7fa640 1 -- 10.20.193.68:0/1662362429 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f29c8024060 con 0x7f29d8072e20 2026-02-18T21:02:26.998 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fce767fc640 1 -- 10.20.193.68:0/2115062647 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6802fad0 con 0x7fce781333d0 2026-02-18T21:02:26.998 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fce767fc640 1 -- 10.20.193.68:0/2115062647 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce68037440 con 0x7fce781333d0 2026-02-18T21:02:26.998 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7f93237fe640 1 -- 10.20.193.68:0/2785018206 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c017070 con 0x7f9344073740 2026-02-18T21:02:26.998 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7f93237fe640 1 -- 10.20.193.68:0/2785018206 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f932c00cc40 con 0x7f9344073740 2026-02-18T21:02:26.999 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7f9349182640 1 -- 10.20.193.68:0/2785018206 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934411b150 con 0x7f9344073740 2026-02-18T21:02:26.999 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7f93237fe640 1 -- 10.20.193.68:0/2785018206 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c013470 con 0x7f9344073740 2026-02-18T21:02:26.999 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fb7559b4640 1 --2- 10.20.193.68:0/2722886136 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fb75012d090 0x7fb750133f70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb740036000 tx=0x7fb7400047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:26.999 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7f9349182640 1 -- 10.20.193.68:0/2785018206 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f93441c4e10 con 0x7f9344073740 2026-02-18T21:02:26.999 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7f29cd7fa640 1 -- 10.20.193.68:0/1662362429 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f29c8066c20 con 0x7f29d8072e20 2026-02-18T21:02:27.000 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fce7e25e640 1 -- 10.20.193.68:0/2115062647 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fce781333d0 msgr2=0x7fce781357c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:27.000 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fce7e25e640 1 --2- 10.20.193.68:0/2115062647 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fce781333d0 0x7fce781357c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fce680098a0 tx=0x7fce6802ee10 comp rx=0 tx=0).stop 2026-02-18T21:02:27.000 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fce7e25e640 1 -- 10.20.193.68:0/2115062647 shutdown_connections 2026-02-18T21:02:27.000 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fce7e25e640 1 --2- 10.20.193.68:0/2115062647 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fce78135d00 0x7fce781380f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:27.000 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fce7e25e640 1 --2- 10.20.193.68:0/2115062647 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fce781333d0 0x7fce781357c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:27.000 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fce7e25e640 1 -- 10.20.193.68:0/2115062647 >> 10.20.193.68:0/2115062647 conn(0x7fce780a1c00 msgr2=0x7fce780a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:27.000 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fce7e25e640 1 -- 10.20.193.68:0/2115062647 shutdown_connections 2026-02-18T21:02:27.000 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7fce7e25e640 1 -- 10.20.193.68:0/2115062647 wait complete. 2026-02-18T21:02:27.000 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.956+0000 7f9349182640 1 -- 10.20.193.68:0/2785018206 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9344073200 con 0x7f9344073740 2026-02-18T21:02:27.000 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7f93237fe640 1 -- 10.20.193.68:0/2785018206 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f932c024060 con 0x7f9344073740 2026-02-18T21:02:27.001 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7f93237fe640 1 -- 10.20.193.68:0/2785018206 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f932c066bc0 con 0x7f9344073740 2026-02-18T21:02:27.002 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7fce7e25e640 1 Processor -- start 2026-02-18T21:02:27.002 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7fce7e25e640 1 -- start start 2026-02-18T21:02:27.002 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7fce7e25e640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fce7812d090 0x7fce78126500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:27.002 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7fce7e25e640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fce781333d0 0x7fce78126a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:27.002 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7fce7e25e640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fce78135d00 0x7fce7812ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:27.002 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7fce7e25e640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fce78072c20 con 0x7fce78135d00 2026-02-18T21:02:27.002 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7fce7e25e640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fce78072aa0 con 0x7fce781333d0 2026-02-18T21:02:27.002 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7fce7e25e640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fce78138630 con 0x7fce7812d090 2026-02-18T21:02:27.002 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7fce777fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fce7812d090 0x7fce78126500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:27.002 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7fce76ffd640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fce781333d0 0x7fce78126a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:27.002 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7fce777fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fce7812d090 0x7fce78126500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60748/0 (socket says 10.20.193.68:60748) 2026-02-18T21:02:27.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7fce777fe640 1 -- 10.20.193.68:0/1106029234 learned_addr learned my addr 10.20.193.68:0/1106029234 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:27.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7fce77fff640 1 --2- 10.20.193.68:0/1106029234 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fce78135d00 0x7fce7812ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:27.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7fce76ffd640 1 -- 10.20.193.68:0/1106029234 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fce7812d090 msgr2=0x7fce78126500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:27.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7fce76ffd640 1 --2- 10.20.193.68:0/1106029234 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fce7812d090 0x7fce78126500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:27.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7fce76ffd640 1 -- 10.20.193.68:0/1106029234 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fce78135d00 msgr2=0x7fce7812ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:27.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7fce76ffd640 1 --2- 10.20.193.68:0/1106029234 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fce78135d00 0x7fce7812ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:27.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7fce76ffd640 1 -- 10.20.193.68:0/1106029234 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce78131200 con 0x7fce781333d0 2026-02-18T21:02:27.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.957+0000 7fce76ffd640 1 --2- 10.20.193.68:0/1106029234 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fce781333d0 0x7fce78126a40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fce68036000 tx=0x7fce680047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:27.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.958+0000 7fce53fff640 1 -- 10.20.193.68:0/1106029234 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce68046070 con 0x7fce781333d0 2026-02-18T21:02:27.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.958+0000 7fce53fff640 1 -- 10.20.193.68:0/1106029234 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce68042650 con 0x7fce781333d0 2026-02-18T21:02:27.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.958+0000 7fce53fff640 1 -- 10.20.193.68:0/1106029234 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6803c040 con 0x7fce781333d0 2026-02-18T21:02:27.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.958+0000 7fce7e25e640 1 -- 10.20.193.68:0/1106029234 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce781316e0 con 0x7fce781333d0 2026-02-18T21:02:27.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.958+0000 7fce7e25e640 1 -- 10.20.193.68:0/1106029234 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fce7812efd0 con 0x7fce781333d0 2026-02-18T21:02:27.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.958+0000 7f29cd7fa640 1 -- 10.20.193.68:0/1662362429 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f29c8040a10 con 0x7f29d8072e20 2026-02-18T21:02:27.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.958+0000 7fb73e7fc640 1 -- 10.20.193.68:0/2722886136 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb740046070 con 0x7fb75012d090 2026-02-18T21:02:27.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.958+0000 7fb73e7fc640 1 -- 10.20.193.68:0/2722886136 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb740042670 con 0x7fb75012d090 2026-02-18T21:02:27.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.958+0000 7fb757c3f640 1 -- 10.20.193.68:0/2722886136 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb750134f30 con 0x7fb75012d090 2026-02-18T21:02:27.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.958+0000 7fb73e7fc640 1 -- 10.20.193.68:0/2722886136 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74003c040 con 0x7fb75012d090 2026-02-18T21:02:27.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.958+0000 7fb757c3f640 1 -- 10.20.193.68:0/2722886136 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7501cd7b0 con 0x7fb75012d090 2026-02-18T21:02:27.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.958+0000 7fce7e25e640 1 -- 10.20.193.68:0/1106029234 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce780687c0 con 0x7fce781333d0 2026-02-18T21:02:27.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.958+0000 7fce53fff640 1 -- 10.20.193.68:0/1106029234 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fce6802f950 con 0x7fce781333d0 2026-02-18T21:02:27.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.959+0000 7fce53fff640 1 -- 10.20.193.68:0/1106029234 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7fce6808b350 con 0x7fce781333d0 2026-02-18T21:02:27.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.959+0000 7f93237fe640 1 -- 10.20.193.68:0/2785018206 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f932c0409b0 con 0x7f9344073740 2026-02-18T21:02:27.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.959+0000 7fb757c3f640 1 -- 10.20.193.68:0/2722886136 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7500687c0 con 0x7fb75012d090 2026-02-18T21:02:27.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.959+0000 7fb73e7fc640 1 -- 10.20.193.68:0/2722886136 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fb7400413b0 con 0x7fb75012d090 2026-02-18T21:02:27.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.959+0000 7fb73e7fc640 1 -- 10.20.193.68:0/2722886136 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7fb74008b5c0 con 0x7fb75012d090 2026-02-18T21:02:27.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.960+0000 7fce53fff640 1 -- 10.20.193.68:0/1106029234 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fce78131200 con 0x7fce781333d0 2026-02-18T21:02:27.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:26.961+0000 7fb73e7fc640 1 -- 10.20.193.68:0/2722886136 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fb74004f080 con 0x7fb75012d090 2026-02-18T21:02:27.031 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.030+0000 7fce7e25e640 1 -- 10.20.193.68:0/1106029234 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fce7812d470 con 0x7fce781333d0 2026-02-18T21:02:27.031 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.031+0000 7fce53fff640 1 -- 10.20.193.68:0/1106029234 <== mon.1 v2:10.20.193.68:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fce680651b0 con 0x7fce781333d0 2026-02-18T21:02:27.031 INFO:teuthology.orchestra.run.trial068.stdout:111669149698 2026-02-18T21:02:27.032 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.031+0000 7f29dedb4640 1 -- 10.20.193.68:0/1662362429 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f29d8069ef0 con 0x7f29d8072e20 2026-02-18T21:02:27.032 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.031+0000 7f29cd7fa640 1 -- 10.20.193.68:0/1662362429 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f29c8065cd0 con 0x7f29d8072e20 2026-02-18T21:02:27.032 INFO:teuthology.orchestra.run.trial068.stdout:124554051586 2026-02-18T21:02:27.032 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.032+0000 7fb757c3f640 1 -- 10.20.193.68:0/2722886136 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb75012ed70 con 0x7fb75012d090 2026-02-18T21:02:27.032 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.032+0000 7fb73e7fc640 1 -- 10.20.193.68:0/2722886136 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb75012ed70 con 0x7fb75012d090 2026-02-18T21:02:27.032 INFO:teuthology.orchestra.run.trial068.stdout:120259084290 2026-02-18T21:02:27.033 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.032+0000 7fce7e25e640 1 -- 10.20.193.68:0/1106029234 >> v1:10.20.193.68:6816/2904515774 conn(0x7fce4804f790 legacy=0x7fce48051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:27.033 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.032+0000 7fce7e25e640 1 -- 10.20.193.68:0/1106029234 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fce781333d0 msgr2=0x7fce78126a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:27.033 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.032+0000 7fce7e25e640 1 --2- 10.20.193.68:0/1106029234 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fce781333d0 0x7fce78126a40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fce68036000 tx=0x7fce680047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:27.033 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.032+0000 7f9349182640 1 -- 10.20.193.68:0/2785018206 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9344069ef0 con 0x7f9344073740 2026-02-18T21:02:27.033 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.032+0000 7fce7e25e640 1 -- 10.20.193.68:0/1106029234 shutdown_connections 2026-02-18T21:02:27.033 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.032+0000 7fce7e25e640 1 --2- 10.20.193.68:0/1106029234 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fce78135d00 0x7fce7812ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:27.034 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.032+0000 7fce7e25e640 1 --2- 10.20.193.68:0/1106029234 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fce781333d0 0x7fce78126a40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:27.034 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.032+0000 7fce7e25e640 1 --2- 10.20.193.68:0/1106029234 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fce7812d090 0x7fce78126500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:27.034 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.032+0000 7fce7e25e640 1 -- 10.20.193.68:0/1106029234 >> 10.20.193.68:0/1106029234 conn(0x7fce780a1c00 msgr2=0x7fce78133fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:27.034 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.032+0000 7fce7e25e640 1 -- 10.20.193.68:0/1106029234 shutdown_connections 2026-02-18T21:02:27.034 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.032+0000 7fce7e25e640 1 -- 10.20.193.68:0/1106029234 wait complete. 2026-02-18T21:02:27.034 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.032+0000 7f93237fe640 1 -- 10.20.193.68:0/2785018206 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f932c065c70 con 0x7f9344073740 2026-02-18T21:02:27.034 INFO:teuthology.orchestra.run.trial068.stdout:115964116994 2026-02-18T21:02:27.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.033+0000 7f29dedb4640 1 -- 10.20.193.68:0/1662362429 >> v1:10.20.193.68:6816/2904515774 conn(0x7f29a804f790 legacy=0x7f29a8051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:27.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.033+0000 7f29dedb4640 1 -- 10.20.193.68:0/1662362429 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f29d8072e20 msgr2=0x7f29d81c7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:27.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.033+0000 7f29dedb4640 1 --2- 10.20.193.68:0/1662362429 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f29d8072e20 0x7f29d81c7100 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f29c800ebe0 tx=0x7f29c800c520 comp rx=0 tx=0).stop 2026-02-18T21:02:27.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.033+0000 7f29dedb4640 1 -- 10.20.193.68:0/1662362429 shutdown_connections 2026-02-18T21:02:27.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.033+0000 7f29dedb4640 1 --2- 10.20.193.68:0/1662362429 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f29d8123430 0x7f29d81c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:27.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.033+0000 7f29dedb4640 1 --2- 10.20.193.68:0/1662362429 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f29d8073740 0x7f29d81c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:27.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.033+0000 7f29dedb4640 1 --2- 10.20.193.68:0/1662362429 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f29d8072e20 0x7f29d81c7100 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:27.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.033+0000 7f29dedb4640 1 -- 10.20.193.68:0/1662362429 >> 10.20.193.68:0/1662362429 conn(0x7f29d809cea0 msgr2=0x7f29d81326e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:27.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.033+0000 7f29dedb4640 1 -- 10.20.193.68:0/1662362429 shutdown_connections 2026-02-18T21:02:27.035 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.033+0000 7f29dedb4640 1 -- 10.20.193.68:0/1662362429 wait complete. 2026-02-18T21:02:27.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.033+0000 7fb757c3f640 1 -- 10.20.193.68:0/2722886136 >> v1:10.20.193.68:6816/2904515774 conn(0x7fb72004f7e0 legacy=0x7fb720051ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:27.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.033+0000 7fb757c3f640 1 -- 10.20.193.68:0/2722886136 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fb75012d090 msgr2=0x7fb750133f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:27.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.033+0000 7fb757c3f640 1 --2- 10.20.193.68:0/2722886136 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fb75012d090 0x7fb750133f70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb740036000 tx=0x7fb7400047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:27.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.033+0000 7fb757c3f640 1 -- 10.20.193.68:0/2722886136 shutdown_connections 2026-02-18T21:02:27.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.033+0000 7fb757c3f640 1 --2- 10.20.193.68:0/2722886136 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fb750130be0 0x7fb7501349f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:27.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.033+0000 7fb757c3f640 1 --2- 10.20.193.68:0/2722886136 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fb750130060 0x7fb7501344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:27.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.033+0000 7fb757c3f640 1 --2- 10.20.193.68:0/2722886136 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fb75012d090 0x7fb750133f70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:27.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.033+0000 7fb757c3f640 1 -- 10.20.193.68:0/2722886136 >> 10.20.193.68:0/2722886136 conn(0x7fb7500a1c00 msgr2=0x7fb75012e660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:27.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.033+0000 7fb757c3f640 1 -- 10.20.193.68:0/2722886136 shutdown_connections 2026-02-18T21:02:27.036 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.033+0000 7fb757c3f640 1 -- 10.20.193.68:0/2722886136 wait complete. 2026-02-18T21:02:27.037 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.034+0000 7f9349182640 1 -- 10.20.193.68:0/2785018206 >> v1:10.20.193.68:6816/2904515774 conn(0x7f931004f7c0 legacy=0x7f9310051c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:27.037 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.034+0000 7f9349182640 1 -- 10.20.193.68:0/2785018206 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9344073740 msgr2=0x7f934411a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:27.037 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.034+0000 7f9349182640 1 --2- 10.20.193.68:0/2785018206 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9344073740 0x7f934411a040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f932c00ebb0 tx=0x7f932c00c520 comp rx=0 tx=0).stop 2026-02-18T21:02:27.037 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.034+0000 7f9349182640 1 -- 10.20.193.68:0/2785018206 shutdown_connections 2026-02-18T21:02:27.037 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.034+0000 7f9349182640 1 --2- 10.20.193.68:0/2785018206 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9344123430 0x7f934411a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:27.037 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.034+0000 7f9349182640 1 --2- 10.20.193.68:0/2785018206 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9344073740 0x7f934411a040 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:27.037 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.034+0000 7f9349182640 1 --2- 10.20.193.68:0/2785018206 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9344072e20 0x7f9344119b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:27.037 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.034+0000 7f9349182640 1 -- 10.20.193.68:0/2785018206 >> 10.20.193.68:0/2785018206 conn(0x7f934409cea0 msgr2=0x7f93441294c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:27.037 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.034+0000 7f9349182640 1 -- 10.20.193.68:0/2785018206 shutdown_connections 2026-02-18T21:02:27.037 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:27.034+0000 7f9349182640 1 -- 10.20.193.68:0/2785018206 wait complete. 2026-02-18T21:02:27.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149699 got 111669149698 for osd.0 2026-02-18T21:02:27.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084290 for osd.2 2026-02-18T21:02:27.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051586 for osd.3 2026-02-18T21:02:27.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964116995 got 115964116994 for osd.1 2026-02-18T21:02:28.042 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-18T21:02:28.043 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-18T21:02:28.044 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-18T21:02:28.046 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-18T21:02:28.114 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.113+0000 7f24ff742640 1 Processor -- start 2026-02-18T21:02:28.114 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.113+0000 7f24ff742640 1 -- start start 2026-02-18T21:02:28.115 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f24ff742640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f24f812d090 0x7f24f812d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.115 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f24ff742640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f24f8130060 0x7f24f81304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.115 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f24ff742640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24f80726d0 con 0x7f24f81309e0 2026-02-18T21:02:28.115 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f24ff742640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f24f80730a0 con 0x7f24f812d090 2026-02-18T21:02:28.115 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f24ff742640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f24f8074190 con 0x7f24f8130060 2026-02-18T21:02:28.116 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f495fa3d640 1 Processor -- start 2026-02-18T21:02:28.116 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f24fd4b7640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f24f812d090 0x7f24f812d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.116 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f24fccb6640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f24f8130060 0x7f24f81304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.116 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f24fdcb8640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f24f81309e0 0x7f24f81373f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:44734/0 (socket says 10.20.193.68:44734) 2026-02-18T21:02:28.117 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f24fdcb8640 1 -- 10.20.193.68:0/593797820 learned_addr learned my addr 10.20.193.68:0/593797820 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:28.117 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f495fa3d640 1 -- start start 2026-02-18T21:02:28.117 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f7d3a866640 1 Processor -- start 2026-02-18T21:02:28.118 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f7d3a866640 1 -- start start 2026-02-18T21:02:28.119 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f24e7fff640 1 -- 10.20.193.68:0/593797820 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2129010140 0 0) 0x7f24f80726d0 con 0x7f24f81309e0 2026-02-18T21:02:28.119 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f24e7fff640 1 -- 10.20.193.68:0/593797820 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24e0003620 con 0x7f24f81309e0 2026-02-18T21:02:28.119 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f24fd4b7640 1 -- 10.20.193.68:0/593797820 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f24f8130060 msgr2=0x7f24f81304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:28.119 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f24fd4b7640 1 --2- 10.20.193.68:0/593797820 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f24f8130060 0x7f24f81304a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.119 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f24fd4b7640 1 -- 10.20.193.68:0/593797820 >> v1:10.20.193.68:6789/0 conn(0x7f24f81309e0 legacy=0x7f24f81373f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.119 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f24fd4b7640 1 -- 10.20.193.68:0/593797820 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f8130e50 con 0x7f24f812d090 2026-02-18T21:02:28.119 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f24fccb6640 1 --2- 10.20.193.68:0/593797820 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f24f8130060 0x7f24f81304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:28.120 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f495fa3d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f495812d090 0x7f495812d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.120 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f495fa3d640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f4958130060 0x7f49581304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.120 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f495fa3d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f49581309e0 0x7f49581373f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.120 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f495fa3d640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f49580730a0 con 0x7f4958130060 2026-02-18T21:02:28.120 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f495fa3d640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f49580726d0 con 0x7f49581309e0 2026-02-18T21:02:28.121 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f495fa3d640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f4958074190 con 0x7f495812d090 2026-02-18T21:02:28.121 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f495cfb1640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f4958130060 0x7f49581304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.121 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f495d7b2640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f495812d090 0x7f495812d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.121 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f495dfb3640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f49581309e0 0x7f49581373f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.121 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f7d3a866640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7d3412d090 0x7f7d3412d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.121 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f7d3a866640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7d34130060 0x7f7d341304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.122 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f495dfb3640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f49581309e0 0x7f49581373f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42534/0 (socket says 10.20.193.68:42534) 2026-02-18T21:02:28.122 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f495d7b2640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f495812d090 0x7f495812d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60762/0 (socket says 10.20.193.68:60762) 2026-02-18T21:02:28.122 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f495cfb1640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f4958130060 0x7f49581304a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:39020/0 (socket says 10.20.193.68:39020) 2026-02-18T21:02:28.122 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f495dfb3640 1 -- 10.20.193.68:0/3397507038 learned_addr learned my addr 10.20.193.68:0/3397507038 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:28.123 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f7d3a866640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d34130e90 con 0x7f7d341309e0 2026-02-18T21:02:28.123 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f7d3a866640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f7d340730a0 con 0x7f7d34130060 2026-02-18T21:02:28.123 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f7d3a866640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f7d340726d0 con 0x7f7d3412d090 2026-02-18T21:02:28.123 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f7d33fff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7d3412d090 0x7f7d3412d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.123 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f7d33fff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7d3412d090 0x7f7d3412d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60768/0 (socket says 10.20.193.68:60768) 2026-02-18T21:02:28.123 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f7d33fff640 1 -- 10.20.193.68:0/1888797891 learned_addr learned my addr 10.20.193.68:0/1888797891 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:28.123 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f7d337fe640 1 --2- 10.20.193.68:0/1888797891 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7d34130060 0x7f7d341304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.124 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.114+0000 7f495cfb1640 1 -- 10.20.193.68:0/3397507038 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f495812d090 msgr2=0x7f495812d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:28.124 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f495cfb1640 1 --2- 10.20.193.68:0/3397507038 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f495812d090 0x7f495812d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.124 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f495cfb1640 1 -- 10.20.193.68:0/3397507038 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f49581309e0 msgr2=0x7f49581373f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:28.124 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f495cfb1640 1 --2- 10.20.193.68:0/3397507038 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f49581309e0 0x7f49581373f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.124 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f495cfb1640 1 -- 10.20.193.68:0/3397507038 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4958130e50 con 0x7f4958130060 2026-02-18T21:02:28.124 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f495dfb3640 1 --2- 10.20.193.68:0/3397507038 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f49581309e0 0x7f49581373f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:28.125 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f7d32ffd640 1 -- 10.20.193.68:0/1888797891 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 286578056 0 0) 0x7f7d28002ca0 con 0x7f7d341309e0 2026-02-18T21:02:28.125 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f7d33fff640 1 -- 10.20.193.68:0/1888797891 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7d34130060 msgr2=0x7f7d341304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:28.125 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f7d33fff640 1 --2- 10.20.193.68:0/1888797891 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7d34130060 0x7f7d341304a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.125 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f7d33fff640 1 -- 10.20.193.68:0/1888797891 >> v1:10.20.193.68:6789/0 conn(0x7f7d341309e0 legacy=0x7f7d341373f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.125 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f7d33fff640 1 -- 10.20.193.68:0/1888797891 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d34074190 con 0x7f7d3412d090 2026-02-18T21:02:28.126 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f24fd4b7640 1 --2- 10.20.193.68:0/593797820 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f24f812d090 0x7f24f812d470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f24e80098a0 tx=0x7f24e802ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690c1dbd90ba4546 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:28.126 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f24e7fff640 1 -- 10.20.193.68:0/593797820 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e803c070 con 0x7f24f812d090 2026-02-18T21:02:28.126 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f24e7fff640 1 -- 10.20.193.68:0/593797820 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e802fad0 con 0x7f24f812d090 2026-02-18T21:02:28.126 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f24e7fff640 1 -- 10.20.193.68:0/593797820 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e8037440 con 0x7f24f812d090 2026-02-18T21:02:28.126 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f495cfb1640 1 --2- 10.20.193.68:0/3397507038 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4958130060 0x7f49581304a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f494c0098a0 tx=0x7f494c02ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6135d251a4302c04 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:28.127 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f7d33fff640 1 --2- 10.20.193.68:0/1888797891 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7d3412d090 0x7f7d3412d470 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7d200099d0 tx=0x7f7d2002ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37f7bed7f4466f25 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:28.127 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f24ff742640 1 -- 10.20.193.68:0/593797820 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f24f812d090 msgr2=0x7f24f812d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.127 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f24ff742640 1 --2- 10.20.193.68:0/593797820 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f24f812d090 0x7f24f812d470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f24e80098a0 tx=0x7f24e802ee10 comp rx=0 tx=0).stop 2026-02-18T21:02:28.127 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f24ff742640 1 -- 10.20.193.68:0/593797820 shutdown_connections 2026-02-18T21:02:28.128 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f24ff742640 1 --2- 10.20.193.68:0/593797820 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f24f8130060 0x7f24f81304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.128 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f24ff742640 1 --2- 10.20.193.68:0/593797820 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f24f812d090 0x7f24f812d470 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.128 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f7d32ffd640 1 -- 10.20.193.68:0/1888797891 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2003c070 con 0x7f7d3412d090 2026-02-18T21:02:28.128 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f24ff742640 1 -- 10.20.193.68:0/593797820 >> 10.20.193.68:0/593797820 conn(0x7f24f80a1c00 msgr2=0x7f24f80a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:28.129 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f4947fff640 1 -- 10.20.193.68:0/3397507038 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c03c070 con 0x7f4958130060 2026-02-18T21:02:28.129 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f24ff742640 1 -- 10.20.193.68:0/593797820 shutdown_connections 2026-02-18T21:02:28.129 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f4947fff640 1 -- 10.20.193.68:0/3397507038 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f494c02fa80 con 0x7f4958130060 2026-02-18T21:02:28.129 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f4947fff640 1 -- 10.20.193.68:0/3397507038 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c02fe50 con 0x7f4958130060 2026-02-18T21:02:28.130 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f24ff742640 1 -- 10.20.193.68:0/593797820 wait complete. 2026-02-18T21:02:28.130 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f7d32ffd640 1 -- 10.20.193.68:0/1888797891 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d2002fb90 con 0x7f7d3412d090 2026-02-18T21:02:28.130 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f7d32ffd640 1 -- 10.20.193.68:0/1888797891 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d20037440 con 0x7f7d3412d090 2026-02-18T21:02:28.131 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f495fa3d640 1 -- 10.20.193.68:0/3397507038 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4958130060 msgr2=0x7f49581304a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.131 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f495fa3d640 1 --2- 10.20.193.68:0/3397507038 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4958130060 0x7f49581304a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f494c0098a0 tx=0x7f494c02ee10 comp rx=0 tx=0).stop 2026-02-18T21:02:28.131 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f7d3a866640 1 -- 10.20.193.68:0/1888797891 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7d3412d090 msgr2=0x7f7d3412d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.131 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f7d3a866640 1 --2- 10.20.193.68:0/1888797891 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7d3412d090 0x7f7d3412d470 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7d200099d0 tx=0x7f7d2002ef60 comp rx=0 tx=0).stop 2026-02-18T21:02:28.132 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f495fa3d640 1 -- 10.20.193.68:0/3397507038 shutdown_connections 2026-02-18T21:02:28.132 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f495fa3d640 1 --2- 10.20.193.68:0/3397507038 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f49581309e0 0x7f49581373f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.132 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f495fa3d640 1 --2- 10.20.193.68:0/3397507038 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4958130060 0x7f49581304a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.132 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f495fa3d640 1 --2- 10.20.193.68:0/3397507038 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f495812d090 0x7f495812d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.132 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f495fa3d640 1 -- 10.20.193.68:0/3397507038 >> 10.20.193.68:0/3397507038 conn(0x7f49580a1c00 msgr2=0x7f49580a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:28.132 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f7d3a866640 1 -- 10.20.193.68:0/1888797891 shutdown_connections 2026-02-18T21:02:28.133 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f7d3a866640 1 --2- 10.20.193.68:0/1888797891 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7d34130060 0x7f7d341304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.133 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f7d3a866640 1 --2- 10.20.193.68:0/1888797891 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7d3412d090 0x7f7d3412d470 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.133 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f7d3a866640 1 -- 10.20.193.68:0/1888797891 >> 10.20.193.68:0/1888797891 conn(0x7f7d340a1c00 msgr2=0x7f7d340a2010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:28.133 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f7d3a866640 1 -- 10.20.193.68:0/1888797891 shutdown_connections 2026-02-18T21:02:28.133 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f495fa3d640 1 -- 10.20.193.68:0/3397507038 shutdown_connections 2026-02-18T21:02:28.133 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f7d3a866640 1 -- 10.20.193.68:0/1888797891 wait complete. 2026-02-18T21:02:28.134 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.115+0000 7f495fa3d640 1 -- 10.20.193.68:0/3397507038 wait complete. 2026-02-18T21:02:28.134 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f24ff742640 1 Processor -- start 2026-02-18T21:02:28.134 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f24ff742640 1 -- start start 2026-02-18T21:02:28.135 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f7d3a866640 1 Processor -- start 2026-02-18T21:02:28.135 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f495fa3d640 1 Processor -- start 2026-02-18T21:02:28.135 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f7d3a866640 1 -- start start 2026-02-18T21:02:28.136 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f495fa3d640 1 -- start start 2026-02-18T21:02:28.136 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f24ff742640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f24f812d090 0x7f24f811c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.136 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f24ff742640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f24f8130060 0x7f24f811c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.136 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f24ff742640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f24f81309e0 0x7f24f81c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.136 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f495fa3d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f495812d090 0x7f495811c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.137 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f7d3a866640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7d3412d090 0x7f7d3411c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.137 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f7d3a866640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7d34130060 0x7f7d3411cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.137 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f24ff742640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f24f812cdb0 con 0x7f24f81309e0 2026-02-18T21:02:28.137 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f24ff742640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f24f812d9b0 con 0x7f24f812d090 2026-02-18T21:02:28.137 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f24ff742640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f24f8072aa0 con 0x7f24f8130060 2026-02-18T21:02:28.138 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f495fa3d640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4958130060 0x7f495811cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.138 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f495fa3d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f49581309e0 0x7f49581c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.138 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f7d3a866640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7d341309e0 0x7f7d3411d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.138 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f7d3a866640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3412cdb0 con 0x7f7d34130060 2026-02-18T21:02:28.138 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f7d3a866640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f7d34073f70 con 0x7f7d3412d090 2026-02-18T21:02:28.138 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f7d3a866640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f7d34072aa0 con 0x7f7d341309e0 2026-02-18T21:02:28.139 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f495fa3d640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f495812cdb0 con 0x7f4958130060 2026-02-18T21:02:28.139 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f495fa3d640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f495812d9f0 con 0x7f49581309e0 2026-02-18T21:02:28.139 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f495fa3d640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f4958072aa0 con 0x7f495812d090 2026-02-18T21:02:28.140 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f24fccb6640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f24f8130060 0x7f24f811c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.140 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f24fd4b7640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f24f812d090 0x7f24f811c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.140 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f24fccb6640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f24f8130060 0x7f24f811c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60784/0 (socket says 10.20.193.68:60784) 2026-02-18T21:02:28.140 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f24fccb6640 1 -- 10.20.193.68:0/3457451451 learned_addr learned my addr 10.20.193.68:0/3457451451 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:28.140 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f24fdcb8640 1 --2- 10.20.193.68:0/3457451451 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f24f81309e0 0x7f24f81c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.140 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f7d337fe640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7d34130060 0x7f7d3411cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.141 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f495cfb1640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4958130060 0x7f495811cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.141 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f495cfb1640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4958130060 0x7f495811cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:39046/0 (socket says 10.20.193.68:39046) 2026-02-18T21:02:28.141 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f495cfb1640 1 -- 10.20.193.68:0/2716396124 learned_addr learned my addr 10.20.193.68:0/2716396124 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:28.142 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f7d337fe640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7d34130060 0x7f7d3411cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:39030/0 (socket says 10.20.193.68:39030) 2026-02-18T21:02:28.142 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f7d38ddc640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7d341309e0 0x7f7d3411d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.142 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f495d7b2640 1 --2- 10.20.193.68:0/2716396124 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f495812d090 0x7f495811c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.142 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f495dfb3640 1 --2- 10.20.193.68:0/2716396124 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f49581309e0 0x7f49581c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.143 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f7d337fe640 1 -- 10.20.193.68:0/1478823521 learned_addr learned my addr 10.20.193.68:0/1478823521 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:28.143 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f7d33fff640 1 --2- 10.20.193.68:0/1478823521 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7d3412d090 0x7f7d3411c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.143 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f24fccb6640 1 -- 10.20.193.68:0/3457451451 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f24f812d090 msgr2=0x7f24f811c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.143 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f24fccb6640 1 --2- 10.20.193.68:0/3457451451 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f24f812d090 0x7f24f811c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.143 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f24fccb6640 1 -- 10.20.193.68:0/3457451451 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f24f81309e0 msgr2=0x7f24f81c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.143 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f24fccb6640 1 --2- 10.20.193.68:0/3457451451 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f24f81309e0 0x7f24f81c6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f24fccb6640 1 -- 10.20.193.68:0/3457451451 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f811dc50 con 0x7f24f8130060 2026-02-18T21:02:28.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f495cfb1640 1 -- 10.20.193.68:0/2716396124 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f495812d090 msgr2=0x7f495811c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f495cfb1640 1 --2- 10.20.193.68:0/2716396124 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f495812d090 0x7f495811c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f495cfb1640 1 -- 10.20.193.68:0/2716396124 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f49581309e0 msgr2=0x7f49581c7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f495cfb1640 1 --2- 10.20.193.68:0/2716396124 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f49581309e0 0x7f49581c7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.144 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.116+0000 7f495cfb1640 1 -- 10.20.193.68:0/2716396124 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495811f1d0 con 0x7f4958130060 2026-02-18T21:02:28.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f7d38ddc640 1 -- 10.20.193.68:0/1478823521 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7d3412d090 msgr2=0x7f7d3411c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f7d38ddc640 1 --2- 10.20.193.68:0/1478823521 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7d3412d090 0x7f7d3411c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f7d38ddc640 1 -- 10.20.193.68:0/1478823521 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7d34130060 msgr2=0x7f7d3411cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f7d38ddc640 1 --2- 10.20.193.68:0/1478823521 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7d34130060 0x7f7d3411cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.145 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f7d38ddc640 1 -- 10.20.193.68:0/1478823521 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3411e0c0 con 0x7f7d341309e0 2026-02-18T21:02:28.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f24fccb6640 1 --2- 10.20.193.68:0/3457451451 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f24f8130060 0x7f24f811c990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00ec10 tx=0x7f24ec00c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:28.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f7d38ddc640 1 --2- 10.20.193.68:0/1478823521 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7d341309e0 0x7f7d3411d120 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800cbb0 tx=0x7f7d2800a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:28.146 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f495cfb1640 1 --2- 10.20.193.68:0/2716396124 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4958130060 0x7f495811cd80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f494c03a040 tx=0x7f494c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:28.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f24e5ffb640 1 -- 10.20.193.68:0/3457451451 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec017070 con 0x7f24f8130060 2026-02-18T21:02:28.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f24e5ffb640 1 -- 10.20.193.68:0/3457451451 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ec00cbe0 con 0x7f24f8130060 2026-02-18T21:02:28.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f24ff742640 1 -- 10.20.193.68:0/3457451451 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f811e4f0 con 0x7f24f8130060 2026-02-18T21:02:28.147 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f24e5ffb640 1 -- 10.20.193.68:0/3457451451 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec013470 con 0x7f24f8130060 2026-02-18T21:02:28.148 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f4945ffb640 1 -- 10.20.193.68:0/2716396124 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c03c040 con 0x7f4958130060 2026-02-18T21:02:28.148 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f7d30ff9640 1 -- 10.20.193.68:0/1478823521 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d28017070 con 0x7f7d341309e0 2026-02-18T21:02:28.148 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f7d30ff9640 1 -- 10.20.193.68:0/1478823521 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d2800ad50 con 0x7f7d341309e0 2026-02-18T21:02:28.148 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f24ff742640 1 -- 10.20.193.68:0/3457451451 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f81c73b0 con 0x7f24f8130060 2026-02-18T21:02:28.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f4945ffb640 1 -- 10.20.193.68:0/2716396124 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f494c042430 con 0x7f4958130060 2026-02-18T21:02:28.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f7d3a866640 1 -- 10.20.193.68:0/1478823521 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d3411e960 con 0x7f7d341309e0 2026-02-18T21:02:28.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f4945ffb640 1 -- 10.20.193.68:0/2716396124 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c042840 con 0x7f4958130060 2026-02-18T21:02:28.149 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f495fa3d640 1 -- 10.20.193.68:0/2716396124 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f495811e060 con 0x7f4958130060 2026-02-18T21:02:28.150 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f7d30ff9640 1 -- 10.20.193.68:0/1478823521 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d28003c60 con 0x7f7d341309e0 2026-02-18T21:02:28.150 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f495fa3d640 1 -- 10.20.193.68:0/2716396124 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f495811d2c0 con 0x7f4958130060 2026-02-18T21:02:28.150 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f7d3a866640 1 -- 10.20.193.68:0/1478823521 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d341c7460 con 0x7f7d341309e0 2026-02-18T21:02:28.151 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f24ff742640 1 -- 10.20.193.68:0/3457451451 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24f80687c0 con 0x7f24f8130060 2026-02-18T21:02:28.151 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f495fa3d640 1 -- 10.20.193.68:0/2716396124 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49580687c0 con 0x7f4958130060 2026-02-18T21:02:28.151 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.117+0000 7f24e5ffb640 1 -- 10.20.193.68:0/3457451451 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f24ec024060 con 0x7f24f8130060 2026-02-18T21:02:28.151 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.118+0000 7f7d30ff9640 1 -- 10.20.193.68:0/1478823521 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f7d28005070 con 0x7f7d341309e0 2026-02-18T21:02:28.152 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.118+0000 7f24e5ffb640 1 -- 10.20.193.68:0/3457451451 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f24ec066b50 con 0x7f24f8130060 2026-02-18T21:02:28.152 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.118+0000 7f4945ffb640 1 -- 10.20.193.68:0/2716396124 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f494c0429e0 con 0x7f4958130060 2026-02-18T21:02:28.152 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.118+0000 7f7d3a866640 1 -- 10.20.193.68:0/1478823521 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d340687c0 con 0x7f7d341309e0 2026-02-18T21:02:28.153 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.118+0000 7f7d30ff9640 1 -- 10.20.193.68:0/1478823521 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f7d280667e0 con 0x7f7d341309e0 2026-02-18T21:02:28.153 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.118+0000 7f4945ffb640 1 -- 10.20.193.68:0/2716396124 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f494c08bdb0 con 0x7f4958130060 2026-02-18T21:02:28.153 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.120+0000 7f24e5ffb640 1 -- 10.20.193.68:0/3457451451 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f24ec0408c0 con 0x7f24f8130060 2026-02-18T21:02:28.153 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.120+0000 7f4945ffb640 1 -- 10.20.193.68:0/2716396124 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f494c042d00 con 0x7f4958130060 2026-02-18T21:02:28.154 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.121+0000 7f7d30ff9640 1 -- 10.20.193.68:0/1478823521 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f7d34130e90 con 0x7f7d341309e0 2026-02-18T21:02:28.157 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.156+0000 7fedf8efb640 1 Processor -- start 2026-02-18T21:02:28.157 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.156+0000 7fedf8efb640 1 -- start start 2026-02-18T21:02:28.157 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.156+0000 7fedf8efb640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fedf4134a00 0x7fedf4134de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.157 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.156+0000 7fedf8efb640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedf4071420 0x7fedf40718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.157 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.156+0000 7fedf8efb640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedf4071df0 0x7fedf413b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.157 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.156+0000 7fedf8efb640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7fedf4134540 con 0x7fedf4134a00 2026-02-18T21:02:28.158 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.156+0000 7fedf8efb640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fedf4073e60 con 0x7fedf4071420 2026-02-18T21:02:28.158 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.156+0000 7fedf8efb640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fedf4072280 con 0x7fedf4071df0 2026-02-18T21:02:28.158 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.156+0000 7fedf2575640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fedf4134a00 0x7fedf4134de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.158 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.156+0000 7fedf1d74640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedf4071420 0x7fedf40718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.158 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.156+0000 7fedf2575640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fedf4134a00 0x7fedf4134de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:39060/0 (socket says 10.20.193.68:39060) 2026-02-18T21:02:28.158 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.156+0000 7fedf2575640 1 -- 10.20.193.68:0/3973973536 learned_addr learned my addr 10.20.193.68:0/3973973536 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:28.158 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.156+0000 7fedf2d76640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedf4071df0 0x7fedf413b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.158 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.156+0000 7fedf2575640 1 -- 10.20.193.68:0/3973973536 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedf4071df0 msgr2=0x7fedf413b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:28.158 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.156+0000 7fedf2575640 1 --2- 10.20.193.68:0/3973973536 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedf4071df0 0x7fedf413b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.158 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.157+0000 7fedf2575640 1 -- 10.20.193.68:0/3973973536 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedf4071420 msgr2=0x7fedf40718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:28.158 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.157+0000 7fedf2575640 1 --2- 10.20.193.68:0/3973973536 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedf4071420 0x7fedf40718b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.158 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.157+0000 7fedf2575640 1 -- 10.20.193.68:0/3973973536 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf409e050 con 0x7fedf4134a00 2026-02-18T21:02:28.158 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.157+0000 7fedf2575640 1 --2- 10.20.193.68:0/3973973536 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fedf4134a00 0x7fedf4134de0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fede8009970 tx=0x7fede802ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3e51de23eba523 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:28.159 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.157+0000 7fedf1573640 1 -- 10.20.193.68:0/3973973536 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede803c070 con 0x7fedf4134a00 2026-02-18T21:02:28.159 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.157+0000 7fedf1573640 1 -- 10.20.193.68:0/3973973536 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede802fac0 con 0x7fedf4134a00 2026-02-18T21:02:28.159 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.157+0000 7fedf1573640 1 -- 10.20.193.68:0/3973973536 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede8037440 con 0x7fedf4134a00 2026-02-18T21:02:28.161 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.157+0000 7fedf8efb640 1 -- 10.20.193.68:0/3973973536 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fedf4134a00 msgr2=0x7fedf4134de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.161 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.157+0000 7fedf8efb640 1 --2- 10.20.193.68:0/3973973536 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fedf4134a00 0x7fedf4134de0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fede8009970 tx=0x7fede802ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:28.161 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.157+0000 7fedf8efb640 1 -- 10.20.193.68:0/3973973536 shutdown_connections 2026-02-18T21:02:28.161 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.157+0000 7fedf8efb640 1 --2- 10.20.193.68:0/3973973536 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedf4071420 0x7fedf40718b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.161 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.157+0000 7fedf8efb640 1 --2- 10.20.193.68:0/3973973536 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedf4071df0 0x7fedf413b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.161 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.157+0000 7fedf8efb640 1 --2- 10.20.193.68:0/3973973536 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fedf4134a00 0x7fedf4134de0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.157+0000 7fedf8efb640 1 -- 10.20.193.68:0/3973973536 >> 10.20.193.68:0/3973973536 conn(0x7fedf409cea0 msgr2=0x7fedf409d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:28.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.157+0000 7fedf8efb640 1 -- 10.20.193.68:0/3973973536 shutdown_connections 2026-02-18T21:02:28.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.157+0000 7fedf8efb640 1 -- 10.20.193.68:0/3973973536 wait complete. 2026-02-18T21:02:28.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.158+0000 7fedf8efb640 1 Processor -- start 2026-02-18T21:02:28.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.158+0000 7fedf8efb640 1 -- start start 2026-02-18T21:02:28.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.158+0000 7fedf8efb640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedf4071420 0x7fedf4123d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.158+0000 7fedf8efb640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fedf4071df0 0x7fedf41242a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.158+0000 7fedf8efb640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedf4134a00 0x7fedf41247e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.158+0000 7fedf8efb640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fedf4135320 con 0x7fedf4071df0 2026-02-18T21:02:28.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.158+0000 7fedf8efb640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fedf4072d10 con 0x7fedf4071420 2026-02-18T21:02:28.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.158+0000 7fedf8efb640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fedf4127330 con 0x7fedf4134a00 2026-02-18T21:02:28.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.158+0000 7fedf1d74640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fedf4071df0 0x7fedf41242a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.158+0000 7fedf2575640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedf4071420 0x7fedf4123d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.158+0000 7fedf2d76640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedf4134a00 0x7fedf41247e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.162 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.158+0000 7fedf2575640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedf4071420 0x7fedf4123d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42590/0 (socket says 10.20.193.68:42590) 2026-02-18T21:02:28.163 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.158+0000 7fedf2575640 1 -- 10.20.193.68:0/1042261799 learned_addr learned my addr 10.20.193.68:0/1042261799 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:28.163 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.159+0000 7fedf2d76640 1 -- 10.20.193.68:0/1042261799 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedf4071420 msgr2=0x7fedf4123d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.163 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.159+0000 7fedf2d76640 1 --2- 10.20.193.68:0/1042261799 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedf4071420 0x7fedf4123d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.163 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.159+0000 7fedf2d76640 1 -- 10.20.193.68:0/1042261799 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fedf4071df0 msgr2=0x7fedf41242a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.163 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.159+0000 7fedf2d76640 1 --2- 10.20.193.68:0/1042261799 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fedf4071df0 0x7fedf41242a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.163 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.159+0000 7fedf2d76640 1 -- 10.20.193.68:0/1042261799 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf4126780 con 0x7fedf4134a00 2026-02-18T21:02:28.163 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.159+0000 7fedf2d76640 1 --2- 10.20.193.68:0/1042261799 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedf4134a00 0x7fedf41247e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fede400efc0 tx=0x7fede400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:28.163 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.159+0000 7feddaffd640 1 -- 10.20.193.68:0/1042261799 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4018020 con 0x7fedf4134a00 2026-02-18T21:02:28.163 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.159+0000 7feddaffd640 1 -- 10.20.193.68:0/1042261799 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede4014480 con 0x7fedf4134a00 2026-02-18T21:02:28.163 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.159+0000 7feddaffd640 1 -- 10.20.193.68:0/1042261799 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4014870 con 0x7fedf4134a00 2026-02-18T21:02:28.163 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.159+0000 7fedf8efb640 1 -- 10.20.193.68:0/1042261799 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf4125ef0 con 0x7fedf4134a00 2026-02-18T21:02:28.163 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.159+0000 7fedf8efb640 1 -- 10.20.193.68:0/1042261799 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf41cb5c0 con 0x7fedf4134a00 2026-02-18T21:02:28.163 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.159+0000 7fedf8efb640 1 -- 10.20.193.68:0/1042261799 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf40718b0 con 0x7fedf4134a00 2026-02-18T21:02:28.163 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.160+0000 7feddaffd640 1 -- 10.20.193.68:0/1042261799 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fede4014a10 con 0x7fedf4134a00 2026-02-18T21:02:28.163 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.160+0000 7feddaffd640 1 -- 10.20.193.68:0/1042261799 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7fede4067ae0 con 0x7fedf4134a00 2026-02-18T21:02:28.164 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.162+0000 7feddaffd640 1 -- 10.20.193.68:0/1042261799 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fede4022030 con 0x7fedf4134a00 2026-02-18T21:02:28.189 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.189+0000 7f24ff742640 1 -- 10.20.193.68:0/3457451451 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f24f811ee60 con 0x7f24f8130060 2026-02-18T21:02:28.190 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.190+0000 7f24e5ffb640 1 -- 10.20.193.68:0/3457451451 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f24f811ee60 con 0x7f24f8130060 2026-02-18T21:02:28.190 INFO:teuthology.orchestra.run.trial068.stdout:124554051587 2026-02-18T21:02:28.191 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.191+0000 7f24ff742640 1 -- 10.20.193.68:0/3457451451 >> v1:10.20.193.68:6816/2904515774 conn(0x7f24c804f790 legacy=0x7f24c8051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.191 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.191+0000 7f24ff742640 1 -- 10.20.193.68:0/3457451451 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f24f8130060 msgr2=0x7f24f811c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.192 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.191+0000 7f24ff742640 1 --2- 10.20.193.68:0/3457451451 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f24f8130060 0x7f24f811c990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00ec10 tx=0x7f24ec00c520 comp rx=0 tx=0).stop 2026-02-18T21:02:28.192 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.191+0000 7f24ff742640 1 -- 10.20.193.68:0/3457451451 shutdown_connections 2026-02-18T21:02:28.192 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.191+0000 7f24ff742640 1 --2- 10.20.193.68:0/3457451451 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f24f81309e0 0x7f24f81c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.192 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.191+0000 7f24ff742640 1 --2- 10.20.193.68:0/3457451451 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f24f8130060 0x7f24f811c990 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.192 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.191+0000 7f24ff742640 1 --2- 10.20.193.68:0/3457451451 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f24f812d090 0x7f24f811c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.192 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.191+0000 7f24ff742640 1 -- 10.20.193.68:0/3457451451 >> 10.20.193.68:0/3457451451 conn(0x7f24f80a1c00 msgr2=0x7f24f81286f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:28.192 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.191+0000 7f24ff742640 1 -- 10.20.193.68:0/3457451451 shutdown_connections 2026-02-18T21:02:28.192 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.191+0000 7f24ff742640 1 -- 10.20.193.68:0/3457451451 wait complete. 2026-02-18T21:02:28.193 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.192+0000 7f495fa3d640 1 -- 10.20.193.68:0/2716396124 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f495812a050 con 0x7f4958130060 2026-02-18T21:02:28.193 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.192+0000 7f7d3a866640 1 -- 10.20.193.68:0/1478823521 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7d3412d470 con 0x7f7d341309e0 2026-02-18T21:02:28.193 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.192+0000 7f4945ffb640 1 -- 10.20.193.68:0/2716396124 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f495812a050 con 0x7f4958130060 2026-02-18T21:02:28.194 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.192+0000 7f7d30ff9640 1 -- 10.20.193.68:0/1478823521 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f7d28040650 con 0x7f7d341309e0 2026-02-18T21:02:28.194 INFO:teuthology.orchestra.run.trial068.stdout:111669149700 2026-02-18T21:02:28.194 INFO:teuthology.orchestra.run.trial068.stdout:120259084291 2026-02-18T21:02:28.195 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.194+0000 7f495fa3d640 1 -- 10.20.193.68:0/2716396124 >> v1:10.20.193.68:6816/2904515774 conn(0x7f492804f790 legacy=0x7f4928051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.195 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.194+0000 7f495fa3d640 1 -- 10.20.193.68:0/2716396124 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4958130060 msgr2=0x7f495811cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.195 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.194+0000 7f495fa3d640 1 --2- 10.20.193.68:0/2716396124 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4958130060 0x7f495811cd80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f494c03a040 tx=0x7f494c0047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.196 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.194+0000 7f7d3a866640 1 -- 10.20.193.68:0/1478823521 >> v1:10.20.193.68:6816/2904515774 conn(0x7f7d0404f7e0 legacy=0x7f7d04051ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.196 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.194+0000 7f7d3a866640 1 -- 10.20.193.68:0/1478823521 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7d341309e0 msgr2=0x7f7d3411d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.196 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.194+0000 7f7d3a866640 1 --2- 10.20.193.68:0/1478823521 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7d341309e0 0x7f7d3411d120 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d2800cbb0 tx=0x7f7d2800a430 comp rx=0 tx=0).stop 2026-02-18T21:02:28.196 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.194+0000 7f495fa3d640 1 -- 10.20.193.68:0/2716396124 shutdown_connections 2026-02-18T21:02:28.196 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.194+0000 7f495fa3d640 1 --2- 10.20.193.68:0/2716396124 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f49581309e0 0x7f49581c7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.197 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.194+0000 7f7d3a866640 1 -- 10.20.193.68:0/1478823521 shutdown_connections 2026-02-18T21:02:28.197 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.194+0000 7f7d3a866640 1 --2- 10.20.193.68:0/1478823521 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f7d341309e0 0x7f7d3411d120 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.197 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.194+0000 7f7d3a866640 1 --2- 10.20.193.68:0/1478823521 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f7d34130060 0x7f7d3411cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.197 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.194+0000 7f7d3a866640 1 --2- 10.20.193.68:0/1478823521 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f7d3412d090 0x7f7d3411c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.197 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.194+0000 7f7d3a866640 1 -- 10.20.193.68:0/1478823521 >> 10.20.193.68:0/1478823521 conn(0x7f7d340a1c00 msgr2=0x7f7d3406e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:28.197 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.194+0000 7f495fa3d640 1 --2- 10.20.193.68:0/2716396124 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f4958130060 0x7f495811cd80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.197 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.194+0000 7f495fa3d640 1 --2- 10.20.193.68:0/2716396124 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f495812d090 0x7f495811c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.197 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.194+0000 7f495fa3d640 1 -- 10.20.193.68:0/2716396124 >> 10.20.193.68:0/2716396124 conn(0x7f49580a1c00 msgr2=0x7f495806e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:28.198 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.194+0000 7f7d3a866640 1 -- 10.20.193.68:0/1478823521 shutdown_connections 2026-02-18T21:02:28.198 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.194+0000 7f495fa3d640 1 -- 10.20.193.68:0/2716396124 shutdown_connections 2026-02-18T21:02:28.198 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.194+0000 7f7d3a866640 1 -- 10.20.193.68:0/1478823521 wait complete. 2026-02-18T21:02:28.199 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.194+0000 7f495fa3d640 1 -- 10.20.193.68:0/2716396124 wait complete. 2026-02-18T21:02:28.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051587 got 124554051587 for osd.3 2026-02-18T21:02:28.200 DEBUG:teuthology.parallel:result is None 2026-02-18T21:02:28.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084291 got 120259084291 for osd.2 2026-02-18T21:02:28.202 DEBUG:teuthology.parallel:result is None 2026-02-18T21:02:28.203 INFO:tasks.ceph.ceph_manager.ceph:need seq 111669149699 got 111669149700 for osd.0 2026-02-18T21:02:28.203 DEBUG:teuthology.parallel:result is None 2026-02-18T21:02:28.233 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.233+0000 7fedf8efb640 1 -- 10.20.193.68:0/1042261799 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fedf4069ef0 con 0x7fedf4134a00 2026-02-18T21:02:28.233 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.233+0000 7feddaffd640 1 -- 10.20.193.68:0/1042261799 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fede4010040 con 0x7fedf4134a00 2026-02-18T21:02:28.233 INFO:teuthology.orchestra.run.trial068.stdout:115964116995 2026-02-18T21:02:28.234 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.234+0000 7fedf8efb640 1 -- 10.20.193.68:0/1042261799 >> v1:10.20.193.68:6816/2904515774 conn(0x7fedc004f790 legacy=0x7fedc0051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.234+0000 7fedf8efb640 1 -- 10.20.193.68:0/1042261799 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedf4134a00 msgr2=0x7fedf41247e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.234+0000 7fedf8efb640 1 --2- 10.20.193.68:0/1042261799 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedf4134a00 0x7fedf41247e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fede400efc0 tx=0x7fede400c490 comp rx=0 tx=0).stop 2026-02-18T21:02:28.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.234+0000 7fedf8efb640 1 -- 10.20.193.68:0/1042261799 shutdown_connections 2026-02-18T21:02:28.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.234+0000 7fedf8efb640 1 --2- 10.20.193.68:0/1042261799 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedf4134a00 0x7fedf41247e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.234+0000 7fedf8efb640 1 --2- 10.20.193.68:0/1042261799 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fedf4071df0 0x7fedf41242a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.234+0000 7fedf8efb640 1 --2- 10.20.193.68:0/1042261799 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedf4071420 0x7fedf4123d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.234+0000 7fedf8efb640 1 -- 10.20.193.68:0/1042261799 >> 10.20.193.68:0/1042261799 conn(0x7fedf409cea0 msgr2=0x7fedf4131030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:28.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.234+0000 7fedf8efb640 1 -- 10.20.193.68:0/1042261799 shutdown_connections 2026-02-18T21:02:28.235 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.234+0000 7fedf8efb640 1 -- 10.20.193.68:0/1042261799 wait complete. 2026-02-18T21:02:28.242 INFO:tasks.ceph.ceph_manager.ceph:need seq 115964116995 got 115964116995 for osd.1 2026-02-18T21:02:28.242 DEBUG:teuthology.parallel:result is None 2026-02-18T21:02:28.242 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-18T21:02:28.242 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-18T21:02:28.353 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.348+0000 7ff52a794640 1 Processor -- start 2026-02-18T21:02:28.353 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.348+0000 7ff52a794640 1 -- start start 2026-02-18T21:02:28.353 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.349+0000 7ff52a794640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7ff52412e1b0 0x7ff52412e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.353 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.349+0000 7ff52a794640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff524073680 0x7ff524071400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.353 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.349+0000 7ff52a794640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff52409e090 con 0x7ff524071940 2026-02-18T21:02:28.353 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.349+0000 7ff52a794640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7ff524073e60 con 0x7ff52412e1b0 2026-02-18T21:02:28.353 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.349+0000 7ff52a794640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7ff52412ead0 con 0x7ff524073680 2026-02-18T21:02:28.354 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.349+0000 7ff523fff640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7ff52412e1b0 0x7ff52412e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.354 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.349+0000 7ff5237fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff524073680 0x7ff524071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.354 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.349+0000 7ff528d0a640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7ff524071940 0x7ff524135080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:44744/0 (socket says 10.20.193.68:44744) 2026-02-18T21:02:28.354 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.349+0000 7ff528d0a640 1 -- 10.20.193.68:0/4119918085 learned_addr learned my addr 10.20.193.68:0/4119918085 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:28.354 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.349+0000 7ff523fff640 1 -- 10.20.193.68:0/4119918085 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff524073680 msgr2=0x7ff524071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:28.354 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.349+0000 7ff523fff640 1 --2- 10.20.193.68:0/4119918085 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff524073680 0x7ff524071400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.354 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.349+0000 7ff523fff640 1 -- 10.20.193.68:0/4119918085 >> v1:10.20.193.68:6789/0 conn(0x7ff524071940 legacy=0x7ff524135080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.354 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.349+0000 7ff522ffd640 1 -- 10.20.193.68:0/4119918085 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1422369836 0 0) 0x7ff52409e090 con 0x7ff524071940 2026-02-18T21:02:28.354 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.349+0000 7ff523fff640 1 -- 10.20.193.68:0/4119918085 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff524072d10 con 0x7ff52412e1b0 2026-02-18T21:02:28.354 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.349+0000 7ff5237fe640 1 --2- 10.20.193.68:0/4119918085 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff524073680 0x7ff524071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:28.354 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.349+0000 7ff523fff640 1 --2- 10.20.193.68:0/4119918085 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ff52412e1b0 0x7ff52412e590 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff5100098a0 tx=0x7ff51002ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7229635b2dd006a6 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:28.355 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.349+0000 7ff522ffd640 1 -- 10.20.193.68:0/4119918085 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51003c070 con 0x7ff52412e1b0 2026-02-18T21:02:28.355 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.350+0000 7ff522ffd640 1 -- 10.20.193.68:0/4119918085 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff51002fa40 con 0x7ff52412e1b0 2026-02-18T21:02:28.355 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.350+0000 7ff522ffd640 1 -- 10.20.193.68:0/4119918085 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51002fe10 con 0x7ff52412e1b0 2026-02-18T21:02:28.355 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.350+0000 7ff52a794640 1 -- 10.20.193.68:0/4119918085 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ff52412e1b0 msgr2=0x7ff52412e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.355 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.350+0000 7ff52a794640 1 --2- 10.20.193.68:0/4119918085 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ff52412e1b0 0x7ff52412e590 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff5100098a0 tx=0x7ff51002ed80 comp rx=0 tx=0).stop 2026-02-18T21:02:28.355 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.350+0000 7ff52a794640 1 -- 10.20.193.68:0/4119918085 shutdown_connections 2026-02-18T21:02:28.355 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.350+0000 7ff52a794640 1 --2- 10.20.193.68:0/4119918085 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff524073680 0x7ff524071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.355 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.350+0000 7ff52a794640 1 --2- 10.20.193.68:0/4119918085 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ff52412e1b0 0x7ff52412e590 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.355 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.350+0000 7ff52a794640 1 -- 10.20.193.68:0/4119918085 >> 10.20.193.68:0/4119918085 conn(0x7ff52409cee0 msgr2=0x7ff52409d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:28.355 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.350+0000 7ff52a794640 1 -- 10.20.193.68:0/4119918085 shutdown_connections 2026-02-18T21:02:28.355 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.350+0000 7ff52a794640 1 -- 10.20.193.68:0/4119918085 wait complete. 2026-02-18T21:02:28.355 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.350+0000 7ff52a794640 1 Processor -- start 2026-02-18T21:02:28.356 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.350+0000 7ff52a794640 1 -- start start 2026-02-18T21:02:28.356 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff52a794640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ff524071940 0x7ff524133ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.356 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff52a794640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ff524073680 0x7ff5241343e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.356 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff52a794640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff52412e1b0 0x7ff524134920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.356 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff52a794640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7ff524072160 con 0x7ff524073680 2026-02-18T21:02:28.356 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff52a794640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7ff524071fe0 con 0x7ff524071940 2026-02-18T21:02:28.356 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff52a794640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7ff5241367a0 con 0x7ff52412e1b0 2026-02-18T21:02:28.356 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff5237fe640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ff524073680 0x7ff5241343e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.356 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff528d0a640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff52412e1b0 0x7ff524134920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.356 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff5237fe640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ff524073680 0x7ff5241343e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:39080/0 (socket says 10.20.193.68:39080) 2026-02-18T21:02:28.356 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff5237fe640 1 -- 10.20.193.68:0/1502142172 learned_addr learned my addr 10.20.193.68:0/1502142172 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:28.356 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff523fff640 1 --2- 10.20.193.68:0/1502142172 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ff524071940 0x7ff524133ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.357 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff5237fe640 1 -- 10.20.193.68:0/1502142172 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff52412e1b0 msgr2=0x7ff524134920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.357 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff5237fe640 1 --2- 10.20.193.68:0/1502142172 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff52412e1b0 0x7ff524134920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.357 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff5237fe640 1 -- 10.20.193.68:0/1502142172 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ff524071940 msgr2=0x7ff524133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.357 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff5237fe640 1 --2- 10.20.193.68:0/1502142172 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ff524071940 0x7ff524133ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.357 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff5237fe640 1 -- 10.20.193.68:0/1502142172 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff524136080 con 0x7ff524073680 2026-02-18T21:02:28.357 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff5237fe640 1 --2- 10.20.193.68:0/1502142172 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ff524073680 0x7ff5241343e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff51400ec10 tx=0x7ff51400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:28.357 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff520ff9640 1 -- 10.20.193.68:0/1502142172 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff514017070 con 0x7ff524073680 2026-02-18T21:02:28.357 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff520ff9640 1 -- 10.20.193.68:0/1502142172 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff51400cc40 con 0x7ff524073680 2026-02-18T21:02:28.357 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff52a794640 1 -- 10.20.193.68:0/1502142172 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff524134e60 con 0x7ff524073680 2026-02-18T21:02:28.357 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff520ff9640 1 -- 10.20.193.68:0/1502142172 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff514013470 con 0x7ff524073680 2026-02-18T21:02:28.357 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff52a794640 1 -- 10.20.193.68:0/1502142172 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5241cd6d0 con 0x7ff524073680 2026-02-18T21:02:28.357 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.351+0000 7ff52a794640 1 -- 10.20.193.68:0/1502142172 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff524071400 con 0x7ff524073680 2026-02-18T21:02:28.358 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.352+0000 7ff520ff9640 1 -- 10.20.193.68:0/1502142172 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7ff514013610 con 0x7ff524073680 2026-02-18T21:02:28.358 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.352+0000 7ff520ff9640 1 -- 10.20.193.68:0/1502142172 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7ff514067130 con 0x7ff524073680 2026-02-18T21:02:28.358 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.354+0000 7ff520ff9640 1 -- 10.20.193.68:0/1502142172 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7ff514040f20 con 0x7ff524073680 2026-02-18T21:02:28.424 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.424+0000 7ff52a794640 1 -- 10.20.193.68:0/1502142172 --> v1:10.20.193.68:6816/2904515774 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff5241284a0 con 0x7ff4f404f790 2026-02-18T21:02:28.425 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.425+0000 7ff520ff9640 1 -- 10.20.193.68:0/1502142172 <== mgr.14114 v1:10.20.193.68:6816/2904515774 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31985 (unknown 2965378022 0 3056484353) 0x7ff5241284a0 con 0x7ff4f404f790 2026-02-18T21:02:28.426 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:28.427 INFO:teuthology.orchestra.run.trial068.stderr:dumped all 2026-02-18T21:02:28.427 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.426+0000 7ff52a794640 1 -- 10.20.193.68:0/1502142172 >> v1:10.20.193.68:6816/2904515774 conn(0x7ff4f404f790 legacy=0x7ff4f4051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.427 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.426+0000 7ff52a794640 1 -- 10.20.193.68:0/1502142172 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ff524073680 msgr2=0x7ff5241343e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.427 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.426+0000 7ff52a794640 1 --2- 10.20.193.68:0/1502142172 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ff524073680 0x7ff5241343e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff51400ec10 tx=0x7ff51400c520 comp rx=0 tx=0).stop 2026-02-18T21:02:28.427 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.426+0000 7ff52a794640 1 -- 10.20.193.68:0/1502142172 shutdown_connections 2026-02-18T21:02:28.427 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.426+0000 7ff52a794640 1 --2- 10.20.193.68:0/1502142172 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff52412e1b0 0x7ff524134920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.427 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.426+0000 7ff52a794640 1 --2- 10.20.193.68:0/1502142172 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ff524073680 0x7ff5241343e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.428 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.426+0000 7ff52a794640 1 --2- 10.20.193.68:0/1502142172 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ff524071940 0x7ff524133ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.428 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.426+0000 7ff52a794640 1 -- 10.20.193.68:0/1502142172 >> 10.20.193.68:0/1502142172 conn(0x7ff52409cee0 msgr2=0x7ff5240709c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:28.428 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.426+0000 7ff52a794640 1 -- 10.20.193.68:0/1502142172 shutdown_connections 2026-02-18T21:02:28.428 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.426+0000 7ff52a794640 1 -- 10.20.193.68:0/1502142172 wait complete. 2026-02-18T21:02:28.433 INFO:teuthology.orchestra.run.trial068.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2026-02-18T21:02:27.003932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":128752,"kb_used_data":2232,"kb_used_omap":17,"kb_used_meta":126446,"kb_avail":377358608,"statfs":{"total":386547056640,"available":386415214592,"internally_reserved":0,"allocated":2285568,"data_stored":1563269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18173,"internal_metadata":129480963},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.970785"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048218+0000","last_change":"2026-02-18T21:02:21.035499+0000","last_active":"2026-02-18T21:02:25.048218+0000","last_peered":"2026-02-18T21:02:25.048218+0000","last_clean":"2026-02-18T21:02:25.048218+0000","last_became_active":"2026-02-18T21:02:21.035326+0000","last_became_peered":"2026-02-18T21:02:21.035326+0000","last_unstale":"2026-02-18T21:02:25.048218+0000","last_undegraded":"2026-02-18T21:02:25.048218+0000","last_fullsized":"2026-02-18T21:02:25.048218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T00:53:21.914540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000486527,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-18T21:02:24.045765+0000","last_change":"2026-02-18T21:02:19.036890+0000","last_active":"2026-02-18T21:02:24.045765+0000","last_peered":"2026-02-18T21:02:24.045765+0000","last_clean":"2026-02-18T21:02:24.045765+0000","last_became_active":"2026-02-18T21:02:19.036766+0000","last_became_peered":"2026-02-18T21:02:19.036766+0000","last_unstale":"2026-02-18T21:02:24.045765+0000","last_undegraded":"2026-02-18T21:02:24.045765+0000","last_fullsized":"2026-02-18T21:02:24.045765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T08:09:48.776074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018692399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048248+0000","last_change":"2026-02-18T21:02:21.035264+0000","last_active":"2026-02-18T21:02:25.048248+0000","last_peered":"2026-02-18T21:02:25.048248+0000","last_clean":"2026-02-18T21:02:25.048248+0000","last_became_active":"2026-02-18T21:02:21.035120+0000","last_became_peered":"2026-02-18T21:02:21.035120+0000","last_unstale":"2026-02-18T21:02:25.048248+0000","last_undegraded":"2026-02-18T21:02:25.048248+0000","last_fullsized":"2026-02-18T21:02:25.048248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T08:23:02.934853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044243599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-18T21:02:24.045759+0000","last_change":"2026-02-18T21:02:19.036659+0000","last_active":"2026-02-18T21:02:24.045759+0000","last_peered":"2026-02-18T21:02:24.045759+0000","last_clean":"2026-02-18T21:02:24.045759+0000","last_became_active":"2026-02-18T21:02:19.036530+0000","last_became_peered":"2026-02-18T21:02:19.036530+0000","last_unstale":"2026-02-18T21:02:24.045759+0000","last_undegraded":"2026-02-18T21:02:24.045759+0000","last_fullsized":"2026-02-18T21:02:24.045759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T00:58:20.528612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020214300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048221+0000","last_change":"2026-02-18T21:02:21.036361+0000","last_active":"2026-02-18T21:02:25.048221+0000","last_peered":"2026-02-18T21:02:25.048221+0000","last_clean":"2026-02-18T21:02:25.048221+0000","last_became_active":"2026-02-18T21:02:21.036142+0000","last_became_peered":"2026-02-18T21:02:21.036142+0000","last_unstale":"2026-02-18T21:02:25.048221+0000","last_undegraded":"2026-02-18T21:02:25.048221+0000","last_fullsized":"2026-02-18T21:02:25.048221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T04:35:27.290307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036890000000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048111+0000","last_change":"2026-02-18T21:02:21.035466+0000","last_active":"2026-02-18T21:02:25.048111+0000","last_peered":"2026-02-18T21:02:25.048111+0000","last_clean":"2026-02-18T21:02:25.048111+0000","last_became_active":"2026-02-18T21:02:21.035305+0000","last_became_peered":"2026-02-18T21:02:21.035305+0000","last_unstale":"2026-02-18T21:02:25.048111+0000","last_undegraded":"2026-02-18T21:02:25.048111+0000","last_fullsized":"2026-02-18T21:02:25.048111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T01:23:13.378008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021428500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048222+0000","last_change":"2026-02-18T21:02:21.036020+0000","last_active":"2026-02-18T21:02:25.048222+0000","last_peered":"2026-02-18T21:02:25.048222+0000","last_clean":"2026-02-18T21:02:25.048222+0000","last_became_active":"2026-02-18T21:02:21.035916+0000","last_became_peered":"2026-02-18T21:02:21.035916+0000","last_unstale":"2026-02-18T21:02:25.048222+0000","last_undegraded":"2026-02-18T21:02:25.048222+0000","last_fullsized":"2026-02-18T21:02:25.048222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T06:05:49.040282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017934099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048226+0000","last_change":"2026-02-18T21:02:21.035434+0000","last_active":"2026-02-18T21:02:25.048226+0000","last_peered":"2026-02-18T21:02:25.048226+0000","last_clean":"2026-02-18T21:02:25.048226+0000","last_became_active":"2026-02-18T21:02:21.035231+0000","last_became_peered":"2026-02-18T21:02:21.035231+0000","last_unstale":"2026-02-18T21:02:25.048226+0000","last_undegraded":"2026-02-18T21:02:25.048226+0000","last_fullsized":"2026-02-18T21:02:25.048226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T00:30:40.499896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000176987,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'79","reported_seq":154,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-18T21:02:24.045794+0000","last_change":"2026-02-18T21:02:19.036859+0000","last_active":"2026-02-18T21:02:24.045794+0000","last_peered":"2026-02-18T21:02:24.045794+0000","last_clean":"2026-02-18T21:02:24.045794+0000","last_became_active":"2026-02-18T21:02:19.036727+0000","last_became_peered":"2026-02-18T21:02:19.036727+0000","last_unstale":"2026-02-18T21:02:24.045794+0000","last_undegraded":"2026-02-18T21:02:24.045794+0000","last_fullsized":"2026-02-18T21:02:24.045794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:20.963920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:20.963920+0000","last_clean_scrub_stamp":"2026-02-18T21:01:20.963920+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T04:27:19.526940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":29,"seq":124554051587,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":276,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":282624,"data_stored":98317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":32370240},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":28,"seq":120259084291,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":264,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":270336,"data_stored":94735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":32370240},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":27,"seq":115964116995,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":848,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":868352,"data_stored":685122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":32370242},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149700,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":844,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":864256,"data_stored":685095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4543,"internal_metadata":32370241},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-18T21:02:28.435 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-18T21:02:28.505 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.500+0000 7fc83e2e9640 1 Processor -- start 2026-02-18T21:02:28.505 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.500+0000 7fc83e2e9640 1 -- start start 2026-02-18T21:02:28.505 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc83e2e9640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc83812e1b0 0x7fc83812e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.506 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc83e2e9640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fc838073680 0x7fc838071400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.506 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc83e2e9640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc838071940 0x7fc838071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.506 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc83e2e9640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7fc83812dcf0 con 0x7fc838073680 2026-02-18T21:02:28.506 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc83e2e9640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fc83809e090 con 0x7fc83812e1b0 2026-02-18T21:02:28.506 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc83e2e9640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fc838073e60 con 0x7fc838071940 2026-02-18T21:02:28.506 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc837fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc83812e1b0 0x7fc83812e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.506 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc8377fe640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fc838073680 0x7fc838071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.506 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc83c85f640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc838071940 0x7fc838071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.506 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc837fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc83812e1b0 0x7fc83812e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42606/0 (socket says 10.20.193.68:42606) 2026-02-18T21:02:28.506 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc8377fe640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fc838073680 0x7fc838071400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:39082/0 (socket says 10.20.193.68:39082) 2026-02-18T21:02:28.506 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc837fff640 1 -- 10.20.193.68:0/1364339921 learned_addr learned my addr 10.20.193.68:0/1364339921 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:28.507 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc8377fe640 1 -- 10.20.193.68:0/1364339921 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc838071940 msgr2=0x7fc838071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:28.507 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc8377fe640 1 --2- 10.20.193.68:0/1364339921 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc838071940 0x7fc838071dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.507 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc8377fe640 1 -- 10.20.193.68:0/1364339921 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc83812e1b0 msgr2=0x7fc83812e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:28.507 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc8377fe640 1 --2- 10.20.193.68:0/1364339921 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc83812e1b0 0x7fc83812e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.507 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc8377fe640 1 -- 10.20.193.68:0/1364339921 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc83812ead0 con 0x7fc838073680 2026-02-18T21:02:28.507 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc837fff640 1 --2- 10.20.193.68:0/1364339921 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc83812e1b0 0x7fc83812e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:28.507 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc8377fe640 1 --2- 10.20.193.68:0/1364339921 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc838073680 0x7fc838071400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc8280098a0 tx=0x7fc82802ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b766258048ba61f5 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:28.507 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc836ffd640 1 -- 10.20.193.68:0/1364339921 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82803c070 con 0x7fc838073680 2026-02-18T21:02:28.507 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.501+0000 7fc836ffd640 1 -- 10.20.193.68:0/1364339921 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82802f9f0 con 0x7fc838073680 2026-02-18T21:02:28.507 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.502+0000 7fc836ffd640 1 -- 10.20.193.68:0/1364339921 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82802fdc0 con 0x7fc838073680 2026-02-18T21:02:28.507 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.502+0000 7fc83e2e9640 1 -- 10.20.193.68:0/1364339921 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc838073680 msgr2=0x7fc838071400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.507 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.502+0000 7fc83e2e9640 1 --2- 10.20.193.68:0/1364339921 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc838073680 0x7fc838071400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc8280098a0 tx=0x7fc82802ed80 comp rx=0 tx=0).stop 2026-02-18T21:02:28.508 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.502+0000 7fc83e2e9640 1 -- 10.20.193.68:0/1364339921 shutdown_connections 2026-02-18T21:02:28.508 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.502+0000 7fc83e2e9640 1 --2- 10.20.193.68:0/1364339921 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc838071940 0x7fc838071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.508 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.502+0000 7fc83e2e9640 1 --2- 10.20.193.68:0/1364339921 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc838073680 0x7fc838071400 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.508 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.502+0000 7fc83e2e9640 1 --2- 10.20.193.68:0/1364339921 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc83812e1b0 0x7fc83812e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.508 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.502+0000 7fc83e2e9640 1 -- 10.20.193.68:0/1364339921 >> 10.20.193.68:0/1364339921 conn(0x7fc83809cee0 msgr2=0x7fc83809d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:28.508 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.502+0000 7fc83e2e9640 1 -- 10.20.193.68:0/1364339921 shutdown_connections 2026-02-18T21:02:28.508 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.502+0000 7fc83e2e9640 1 -- 10.20.193.68:0/1364339921 wait complete. 2026-02-18T21:02:28.508 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.502+0000 7fc83e2e9640 1 Processor -- start 2026-02-18T21:02:28.508 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.502+0000 7fc83e2e9640 1 -- start start 2026-02-18T21:02:28.508 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc83e2e9640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc838071940 0x7fc8381c5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.508 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc83e2e9640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc838073680 0x7fc8381c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.508 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc83e2e9640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc83812e1b0 0x7fc838131a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.509 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc83e2e9640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fc838135200 con 0x7fc83812e1b0 2026-02-18T21:02:28.509 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc83e2e9640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fc838135080 con 0x7fc838071940 2026-02-18T21:02:28.509 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc83e2e9640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fc838135380 con 0x7fc838073680 2026-02-18T21:02:28.509 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc837fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc838071940 0x7fc8381c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.509 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc83c85f640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc83812e1b0 0x7fc838131a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.509 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc837fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc838071940 0x7fc8381c5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42608/0 (socket says 10.20.193.68:42608) 2026-02-18T21:02:28.509 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc837fff640 1 -- 10.20.193.68:0/3892796371 learned_addr learned my addr 10.20.193.68:0/3892796371 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:28.509 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc8377fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc838073680 0x7fc8381c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.509 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc837fff640 1 -- 10.20.193.68:0/3892796371 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc838073680 msgr2=0x7fc8381c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.509 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc837fff640 1 --2- 10.20.193.68:0/3892796371 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc838073680 0x7fc8381c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.509 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc837fff640 1 -- 10.20.193.68:0/3892796371 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc83812e1b0 msgr2=0x7fc838131a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc837fff640 1 --2- 10.20.193.68:0/3892796371 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc83812e1b0 0x7fc838131a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc837fff640 1 -- 10.20.193.68:0/3892796371 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8381339a0 con 0x7fc838071940 2026-02-18T21:02:28.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc83c85f640 1 --2- 10.20.193.68:0/3892796371 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc83812e1b0 0x7fc838131a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:28.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc837fff640 1 --2- 10.20.193.68:0/3892796371 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc838071940 0x7fc8381c5570 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc82400ebe0 tx=0x7fc82400c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:28.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc834ff9640 1 -- 10.20.193.68:0/3892796371 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc824017070 con 0x7fc838071940 2026-02-18T21:02:28.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc834ff9640 1 -- 10.20.193.68:0/3892796371 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82400cc40 con 0x7fc838071940 2026-02-18T21:02:28.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc83e2e9640 1 -- 10.20.193.68:0/3892796371 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8381170a0 con 0x7fc838071940 2026-02-18T21:02:28.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc834ff9640 1 -- 10.20.193.68:0/3892796371 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc824013470 con 0x7fc838071940 2026-02-18T21:02:28.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.503+0000 7fc83e2e9640 1 -- 10.20.193.68:0/3892796371 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8381c5ff0 con 0x7fc838071940 2026-02-18T21:02:28.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.504+0000 7fc83e2e9640 1 -- 10.20.193.68:0/3892796371 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc838071400 con 0x7fc838071940 2026-02-18T21:02:28.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.504+0000 7fc834ff9640 1 -- 10.20.193.68:0/3892796371 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fc824024060 con 0x7fc838071940 2026-02-18T21:02:28.510 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.504+0000 7fc834ff9640 1 -- 10.20.193.68:0/3892796371 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7fc824066ae0 con 0x7fc838071940 2026-02-18T21:02:28.511 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.506+0000 7fc834ff9640 1 -- 10.20.193.68:0/3892796371 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fc8240408d0 con 0x7fc838071940 2026-02-18T21:02:28.574 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.574+0000 7fc83e2e9640 1 -- 10.20.193.68:0/3892796371 --> v1:10.20.193.68:6816/2904515774 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc838133c70 con 0x7fc80804f7c0 2026-02-18T21:02:28.575 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.574+0000 7fc834ff9640 1 -- 10.20.193.68:0/3892796371 <== mgr.14114 v1:10.20.193.68:6816/2904515774 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31985 (unknown 2965378022 0 3056484353) 0x7fc838133c70 con 0x7fc80804f7c0 2026-02-18T21:02:28.575 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:28.576 INFO:teuthology.orchestra.run.trial068.stderr:dumped all 2026-02-18T21:02:28.576 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.575+0000 7fc83e2e9640 1 -- 10.20.193.68:0/3892796371 >> v1:10.20.193.68:6816/2904515774 conn(0x7fc80804f7c0 legacy=0x7fc808051c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.577 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.575+0000 7fc83e2e9640 1 -- 10.20.193.68:0/3892796371 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc838071940 msgr2=0x7fc8381c5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.577 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.575+0000 7fc83e2e9640 1 --2- 10.20.193.68:0/3892796371 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc838071940 0x7fc8381c5570 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc82400ebe0 tx=0x7fc82400c520 comp rx=0 tx=0).stop 2026-02-18T21:02:28.577 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.575+0000 7fc83e2e9640 1 -- 10.20.193.68:0/3892796371 shutdown_connections 2026-02-18T21:02:28.577 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.575+0000 7fc83e2e9640 1 --2- 10.20.193.68:0/3892796371 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fc83812e1b0 0x7fc838131a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.577 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.575+0000 7fc83e2e9640 1 --2- 10.20.193.68:0/3892796371 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fc838073680 0x7fc8381c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.577 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.575+0000 7fc83e2e9640 1 --2- 10.20.193.68:0/3892796371 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fc838071940 0x7fc8381c5570 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.577 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.575+0000 7fc83e2e9640 1 -- 10.20.193.68:0/3892796371 >> 10.20.193.68:0/3892796371 conn(0x7fc83809cee0 msgr2=0x7fc83806ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:28.577 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.575+0000 7fc83e2e9640 1 -- 10.20.193.68:0/3892796371 shutdown_connections 2026-02-18T21:02:28.577 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.575+0000 7fc83e2e9640 1 -- 10.20.193.68:0/3892796371 wait complete. 2026-02-18T21:02:28.582 INFO:teuthology.orchestra.run.trial068.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2026-02-18T21:02:27.003932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":128752,"kb_used_data":2232,"kb_used_omap":17,"kb_used_meta":126446,"kb_avail":377358608,"statfs":{"total":386547056640,"available":386415214592,"internally_reserved":0,"allocated":2285568,"data_stored":1563269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18173,"internal_metadata":129480963},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.970785"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048218+0000","last_change":"2026-02-18T21:02:21.035499+0000","last_active":"2026-02-18T21:02:25.048218+0000","last_peered":"2026-02-18T21:02:25.048218+0000","last_clean":"2026-02-18T21:02:25.048218+0000","last_became_active":"2026-02-18T21:02:21.035326+0000","last_became_peered":"2026-02-18T21:02:21.035326+0000","last_unstale":"2026-02-18T21:02:25.048218+0000","last_undegraded":"2026-02-18T21:02:25.048218+0000","last_fullsized":"2026-02-18T21:02:25.048218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T00:53:21.914540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000486527,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-18T21:02:24.045765+0000","last_change":"2026-02-18T21:02:19.036890+0000","last_active":"2026-02-18T21:02:24.045765+0000","last_peered":"2026-02-18T21:02:24.045765+0000","last_clean":"2026-02-18T21:02:24.045765+0000","last_became_active":"2026-02-18T21:02:19.036766+0000","last_became_peered":"2026-02-18T21:02:19.036766+0000","last_unstale":"2026-02-18T21:02:24.045765+0000","last_undegraded":"2026-02-18T21:02:24.045765+0000","last_fullsized":"2026-02-18T21:02:24.045765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T08:09:48.776074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018692399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048248+0000","last_change":"2026-02-18T21:02:21.035264+0000","last_active":"2026-02-18T21:02:25.048248+0000","last_peered":"2026-02-18T21:02:25.048248+0000","last_clean":"2026-02-18T21:02:25.048248+0000","last_became_active":"2026-02-18T21:02:21.035120+0000","last_became_peered":"2026-02-18T21:02:21.035120+0000","last_unstale":"2026-02-18T21:02:25.048248+0000","last_undegraded":"2026-02-18T21:02:25.048248+0000","last_fullsized":"2026-02-18T21:02:25.048248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T08:23:02.934853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044243599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-18T21:02:24.045759+0000","last_change":"2026-02-18T21:02:19.036659+0000","last_active":"2026-02-18T21:02:24.045759+0000","last_peered":"2026-02-18T21:02:24.045759+0000","last_clean":"2026-02-18T21:02:24.045759+0000","last_became_active":"2026-02-18T21:02:19.036530+0000","last_became_peered":"2026-02-18T21:02:19.036530+0000","last_unstale":"2026-02-18T21:02:24.045759+0000","last_undegraded":"2026-02-18T21:02:24.045759+0000","last_fullsized":"2026-02-18T21:02:24.045759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T00:58:20.528612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020214300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048221+0000","last_change":"2026-02-18T21:02:21.036361+0000","last_active":"2026-02-18T21:02:25.048221+0000","last_peered":"2026-02-18T21:02:25.048221+0000","last_clean":"2026-02-18T21:02:25.048221+0000","last_became_active":"2026-02-18T21:02:21.036142+0000","last_became_peered":"2026-02-18T21:02:21.036142+0000","last_unstale":"2026-02-18T21:02:25.048221+0000","last_undegraded":"2026-02-18T21:02:25.048221+0000","last_fullsized":"2026-02-18T21:02:25.048221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T04:35:27.290307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036890000000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048111+0000","last_change":"2026-02-18T21:02:21.035466+0000","last_active":"2026-02-18T21:02:25.048111+0000","last_peered":"2026-02-18T21:02:25.048111+0000","last_clean":"2026-02-18T21:02:25.048111+0000","last_became_active":"2026-02-18T21:02:21.035305+0000","last_became_peered":"2026-02-18T21:02:21.035305+0000","last_unstale":"2026-02-18T21:02:25.048111+0000","last_undegraded":"2026-02-18T21:02:25.048111+0000","last_fullsized":"2026-02-18T21:02:25.048111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T01:23:13.378008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021428500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048222+0000","last_change":"2026-02-18T21:02:21.036020+0000","last_active":"2026-02-18T21:02:25.048222+0000","last_peered":"2026-02-18T21:02:25.048222+0000","last_clean":"2026-02-18T21:02:25.048222+0000","last_became_active":"2026-02-18T21:02:21.035916+0000","last_became_peered":"2026-02-18T21:02:21.035916+0000","last_unstale":"2026-02-18T21:02:25.048222+0000","last_undegraded":"2026-02-18T21:02:25.048222+0000","last_fullsized":"2026-02-18T21:02:25.048222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T06:05:49.040282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017934099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048226+0000","last_change":"2026-02-18T21:02:21.035434+0000","last_active":"2026-02-18T21:02:25.048226+0000","last_peered":"2026-02-18T21:02:25.048226+0000","last_clean":"2026-02-18T21:02:25.048226+0000","last_became_active":"2026-02-18T21:02:21.035231+0000","last_became_peered":"2026-02-18T21:02:21.035231+0000","last_unstale":"2026-02-18T21:02:25.048226+0000","last_undegraded":"2026-02-18T21:02:25.048226+0000","last_fullsized":"2026-02-18T21:02:25.048226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T00:30:40.499896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000176987,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'79","reported_seq":154,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-18T21:02:24.045794+0000","last_change":"2026-02-18T21:02:19.036859+0000","last_active":"2026-02-18T21:02:24.045794+0000","last_peered":"2026-02-18T21:02:24.045794+0000","last_clean":"2026-02-18T21:02:24.045794+0000","last_became_active":"2026-02-18T21:02:19.036727+0000","last_became_peered":"2026-02-18T21:02:19.036727+0000","last_unstale":"2026-02-18T21:02:24.045794+0000","last_undegraded":"2026-02-18T21:02:24.045794+0000","last_fullsized":"2026-02-18T21:02:24.045794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:20.963920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:20.963920+0000","last_clean_scrub_stamp":"2026-02-18T21:01:20.963920+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T04:27:19.526940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":29,"seq":124554051587,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":276,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":282624,"data_stored":98317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":32370240},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":28,"seq":120259084291,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":264,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":270336,"data_stored":94735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":32370240},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":27,"seq":115964116995,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":848,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":868352,"data_stored":685122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":32370242},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149700,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":844,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":864256,"data_stored":685095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4543,"internal_metadata":32370241},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-18T21:02:28.584 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-18T21:02:28.584 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-18T21:02:28.584 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-18T21:02:28.584 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-18T21:02:28.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.653+0000 7f47cb23d640 1 Processor -- start 2026-02-18T21:02:28.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.653+0000 7f47cb23d640 1 -- start start 2026-02-18T21:02:28.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.653+0000 7f47cb23d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f47c4114bb0 0x7f47c4114f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.653+0000 7f47cb23d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f47c41154d0 0x7f47c41304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.653+0000 7f47cb23d640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c4071400 con 0x7f47c41309e0 2026-02-18T21:02:28.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.653+0000 7f47cb23d640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f47c40716e0 con 0x7f47c4114bb0 2026-02-18T21:02:28.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.653+0000 7f47cb23d640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f47c409e090 con 0x7f47c41154d0 2026-02-18T21:02:28.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.653+0000 7f47c8fb2640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f47c4114bb0 0x7f47c4114f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.653+0000 7f47c8fb2640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f47c4114bb0 0x7f47c4114f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42622/0 (socket says 10.20.193.68:42622) 2026-02-18T21:02:28.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.653+0000 7f47c8fb2640 1 -- 10.20.193.68:0/2187294497 learned_addr learned my addr 10.20.193.68:0/2187294497 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:28.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.653+0000 7f47bbfff640 1 --2- 10.20.193.68:0/2187294497 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f47c41154d0 0x7f47c41304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.653+0000 7f47c8fb2640 1 -- 10.20.193.68:0/2187294497 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f47c41154d0 msgr2=0x7f47c41304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:28.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.653+0000 7f47c8fb2640 1 --2- 10.20.193.68:0/2187294497 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f47c41154d0 0x7f47c41304a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.653+0000 7f47c8fb2640 1 -- 10.20.193.68:0/2187294497 >> v1:10.20.193.68:6789/0 conn(0x7f47c41309e0 legacy=0x7f47c41376f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.653+0000 7f47bb7fe640 1 -- 10.20.193.68:0/2187294497 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3870523778 0 0) 0x7f47c0002ca0 con 0x7f47c41309e0 2026-02-18T21:02:28.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.653+0000 7f47c8fb2640 1 -- 10.20.193.68:0/2187294497 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c4071ca0 con 0x7f47c4114bb0 2026-02-18T21:02:28.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.654+0000 7f47c8fb2640 1 --2- 10.20.193.68:0/2187294497 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f47c4114bb0 0x7f47c4114f90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f47b40099a0 tx=0x7f47b402ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db37d4ccf00eef7 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:28.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.654+0000 7f47bb7fe640 1 -- 10.20.193.68:0/2187294497 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b403c070 con 0x7f47c4114bb0 2026-02-18T21:02:28.658 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.654+0000 7f47bb7fe640 1 -- 10.20.193.68:0/2187294497 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b402fb00 con 0x7f47c4114bb0 2026-02-18T21:02:28.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.654+0000 7f47bb7fe640 1 -- 10.20.193.68:0/2187294497 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4037440 con 0x7f47c4114bb0 2026-02-18T21:02:28.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.654+0000 7f47cb23d640 1 -- 10.20.193.68:0/2187294497 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f47c4114bb0 msgr2=0x7f47c4114f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.654+0000 7f47cb23d640 1 --2- 10.20.193.68:0/2187294497 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f47c4114bb0 0x7f47c4114f90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f47b40099a0 tx=0x7f47b402ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:28.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.654+0000 7f47cb23d640 1 -- 10.20.193.68:0/2187294497 shutdown_connections 2026-02-18T21:02:28.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.654+0000 7f47cb23d640 1 --2- 10.20.193.68:0/2187294497 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f47c41154d0 0x7f47c41304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.654+0000 7f47cb23d640 1 --2- 10.20.193.68:0/2187294497 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f47c4114bb0 0x7f47c4114f90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.654+0000 7f47cb23d640 1 -- 10.20.193.68:0/2187294497 >> 10.20.193.68:0/2187294497 conn(0x7f47c409cee0 msgr2=0x7f47c409d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:28.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.654+0000 7f47cb23d640 1 -- 10.20.193.68:0/2187294497 shutdown_connections 2026-02-18T21:02:28.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.654+0000 7f47cb23d640 1 -- 10.20.193.68:0/2187294497 wait complete. 2026-02-18T21:02:28.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47cb23d640 1 Processor -- start 2026-02-18T21:02:28.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47cb23d640 1 -- start start 2026-02-18T21:02:28.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47cb23d640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f47c4114bb0 0x7f47c41c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47cb23d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f47c41154d0 0x7f47c41c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47cb23d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f47c41309e0 0x7f47c4123810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47cb23d640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f47c41158b0 con 0x7f47c4114bb0 2026-02-18T21:02:28.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47cb23d640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f47c4130e90 con 0x7f47c41309e0 2026-02-18T21:02:28.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47cb23d640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f47c4073760 con 0x7f47c41154d0 2026-02-18T21:02:28.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47c8fb2640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f47c4114bb0 0x7f47c41c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47bbfff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f47c41154d0 0x7f47c41c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47c8fb2640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f47c4114bb0 0x7f47c41c7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:39104/0 (socket says 10.20.193.68:39104) 2026-02-18T21:02:28.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47c8fb2640 1 -- 10.20.193.68:0/3500178225 learned_addr learned my addr 10.20.193.68:0/3500178225 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:28.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47c97b3640 1 --2- 10.20.193.68:0/3500178225 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f47c41309e0 0x7f47c4123810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47c8fb2640 1 -- 10.20.193.68:0/3500178225 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f47c41154d0 msgr2=0x7f47c41c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47c8fb2640 1 --2- 10.20.193.68:0/3500178225 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f47c41154d0 0x7f47c41c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47c8fb2640 1 -- 10.20.193.68:0/3500178225 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f47c41309e0 msgr2=0x7f47c4123810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47c8fb2640 1 --2- 10.20.193.68:0/3500178225 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f47c41309e0 0x7f47c4123810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47c8fb2640 1 -- 10.20.193.68:0/3500178225 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c4125ad0 con 0x7f47c4114bb0 2026-02-18T21:02:28.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47c8fb2640 1 --2- 10.20.193.68:0/3500178225 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f47c4114bb0 0x7f47c41c7670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f47b4002410 tx=0x7f47b40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:28.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47b97fa640 1 -- 10.20.193.68:0/3500178225 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b403c040 con 0x7f47c4114bb0 2026-02-18T21:02:28.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47b97fa640 1 -- 10.20.193.68:0/3500178225 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b4037e20 con 0x7f47c4114bb0 2026-02-18T21:02:28.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47cb23d640 1 -- 10.20.193.68:0/3500178225 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c41c80f0 con 0x7f47c4114bb0 2026-02-18T21:02:28.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47b97fa640 1 -- 10.20.193.68:0/3500178225 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4004250 con 0x7f47c4114bb0 2026-02-18T21:02:28.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.655+0000 7f47cb23d640 1 -- 10.20.193.68:0/3500178225 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c4126640 con 0x7f47c4114bb0 2026-02-18T21:02:28.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.656+0000 7f4792ffd640 1 -- 10.20.193.68:0/3500178225 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c4131250 con 0x7f47c4114bb0 2026-02-18T21:02:28.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.656+0000 7f47b97fa640 1 -- 10.20.193.68:0/3500178225 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f47b403f050 con 0x7f47c4114bb0 2026-02-18T21:02:28.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.656+0000 7f47b97fa640 1 -- 10.20.193.68:0/3500178225 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f47b408b540 con 0x7f47c4114bb0 2026-02-18T21:02:28.662 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.658+0000 7f47b97fa640 1 -- 10.20.193.68:0/3500178225 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f47b4044020 con 0x7f47c4114bb0 2026-02-18T21:02:28.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.740+0000 7f4792ffd640 1 -- 10.20.193.68:0/3500178225 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f47c40008d0 con 0x7f47c4114bb0 2026-02-18T21:02:28.740 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.740+0000 7f47b97fa640 1 -- 10.20.193.68:0/3500178225 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f47b4065400 con 0x7f47c4114bb0 2026-02-18T21:02:28.741 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:28.741 INFO:teuthology.orchestra.run.trial068.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-18T21:02:28.742 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.741+0000 7f4792ffd640 1 -- 10.20.193.68:0/3500178225 >> v1:10.20.193.68:6816/2904515774 conn(0x7f479404f790 legacy=0x7f4794051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.742 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.741+0000 7f4792ffd640 1 -- 10.20.193.68:0/3500178225 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f47c4114bb0 msgr2=0x7f47c41c7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.742 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.741+0000 7f4792ffd640 1 --2- 10.20.193.68:0/3500178225 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f47c4114bb0 0x7f47c41c7670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f47b4002410 tx=0x7f47b40047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.742 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.741+0000 7f4792ffd640 1 -- 10.20.193.68:0/3500178225 shutdown_connections 2026-02-18T21:02:28.742 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.741+0000 7f4792ffd640 1 --2- 10.20.193.68:0/3500178225 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f47c41309e0 0x7f47c4123810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.742 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.741+0000 7f4792ffd640 1 --2- 10.20.193.68:0/3500178225 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f47c41154d0 0x7f47c41c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.742 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.741+0000 7f4792ffd640 1 --2- 10.20.193.68:0/3500178225 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f47c4114bb0 0x7f47c41c7670 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.741+0000 7f4792ffd640 1 -- 10.20.193.68:0/3500178225 >> 10.20.193.68:0/3500178225 conn(0x7f47c409cee0 msgr2=0x7f47c406f270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:28.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.741+0000 7f4792ffd640 1 -- 10.20.193.68:0/3500178225 shutdown_connections 2026-02-18T21:02:28.743 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.741+0000 7f4792ffd640 1 -- 10.20.193.68:0/3500178225 wait complete. 2026-02-18T21:02:28.749 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-18T21:02:28.749 INFO:teuthology.run_tasks:Running task print... 2026-02-18T21:02:28.768 INFO:teuthology.task.print:**** done ceph.restart 2026-02-18T21:02:28.768 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2026-02-18T21:02:28.789 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2026-02-18T21:02:28.805 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2026-02-18T21:02:28.823 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-18T21:02:28.839 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-18T21:02:28.840 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-18T21:02:28.915 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.908+0000 7f41485a5640 1 Processor -- start 2026-02-18T21:02:28.915 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.908+0000 7f41485a5640 1 -- start start 2026-02-18T21:02:28.915 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.909+0000 7f41485a5640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4140071400 0x7f41400717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.915 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.909+0000 7f41485a5640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f414012e510 0x7f414013ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.916 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.909+0000 7f41485a5640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41400731f0 con 0x7f4140071d20 2026-02-18T21:02:28.916 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.909+0000 7f41485a5640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f414009e090 con 0x7f414012e510 2026-02-18T21:02:28.916 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.909+0000 7f41485a5640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f4140073f90 con 0x7f4140071400 2026-02-18T21:02:28.916 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.909+0000 7f4145b19640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f4140071d20 0x7f414012de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:44754/0 (socket says 10.20.193.68:44754) 2026-02-18T21:02:28.916 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.909+0000 7f4145b19640 1 -- 10.20.193.68:0/2455971043 learned_addr learned my addr 10.20.193.68:0/2455971043 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:28.916 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.909+0000 7f4146b1b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f414012e510 0x7f414013ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.917 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.909+0000 7f414631a640 1 --2- 10.20.193.68:0/2455971043 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4140071400 0x7f41400717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.917 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.909+0000 7f4145318640 1 -- 10.20.193.68:0/2455971043 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 756684665 0 0) 0x7f4134002920 con 0x7f4140071d20 2026-02-18T21:02:28.917 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.909+0000 7f4145318640 1 -- 10.20.193.68:0/2455971043 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4128003620 con 0x7f4140071d20 2026-02-18T21:02:28.917 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.909+0000 7f4146b1b640 1 -- 10.20.193.68:0/2455971043 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4140071400 msgr2=0x7f41400717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:28.917 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.909+0000 7f4146b1b640 1 --2- 10.20.193.68:0/2455971043 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4140071400 0x7f41400717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.917 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.909+0000 7f4146b1b640 1 -- 10.20.193.68:0/2455971043 >> v1:10.20.193.68:6789/0 conn(0x7f4140071d20 legacy=0x7f414012de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.917 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.909+0000 7f4146b1b640 1 -- 10.20.193.68:0/2455971043 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4140072900 con 0x7f414012e510 2026-02-18T21:02:28.917 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.909+0000 7f4146b1b640 1 --2- 10.20.193.68:0/2455971043 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f414012e510 0x7f414013ca40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f413c009dc0 tx=0x7f413c02f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68e0500c19cefb4a server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:28.917 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.910+0000 7f4145318640 1 -- 10.20.193.68:0/2455971043 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c03c070 con 0x7f414012e510 2026-02-18T21:02:28.918 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.910+0000 7f4145318640 1 -- 10.20.193.68:0/2455971043 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f413c037440 con 0x7f414012e510 2026-02-18T21:02:28.918 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.910+0000 7f4145318640 1 -- 10.20.193.68:0/2455971043 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f413c037810 con 0x7f414012e510 2026-02-18T21:02:28.918 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.910+0000 7f41485a5640 1 -- 10.20.193.68:0/2455971043 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f414012e510 msgr2=0x7f414013ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.918 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.910+0000 7f41485a5640 1 --2- 10.20.193.68:0/2455971043 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f414012e510 0x7f414013ca40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f413c009dc0 tx=0x7f413c02f230 comp rx=0 tx=0).stop 2026-02-18T21:02:28.918 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.910+0000 7f41485a5640 1 -- 10.20.193.68:0/2455971043 shutdown_connections 2026-02-18T21:02:28.918 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.910+0000 7f41485a5640 1 --2- 10.20.193.68:0/2455971043 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f414012e510 0x7f414013ca40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.918 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.910+0000 7f41485a5640 1 --2- 10.20.193.68:0/2455971043 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4140071400 0x7f41400717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.918 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.910+0000 7f41485a5640 1 -- 10.20.193.68:0/2455971043 >> 10.20.193.68:0/2455971043 conn(0x7f414009cee0 msgr2=0x7f414009d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:28.918 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.910+0000 7f41485a5640 1 -- 10.20.193.68:0/2455971043 shutdown_connections 2026-02-18T21:02:28.918 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.910+0000 7f41485a5640 1 -- 10.20.193.68:0/2455971043 wait complete. 2026-02-18T21:02:28.918 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.910+0000 7f41485a5640 1 Processor -- start 2026-02-18T21:02:28.919 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.910+0000 7f41485a5640 1 -- start start 2026-02-18T21:02:28.919 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f41485a5640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4140071400 0x7f4140135a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.919 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f41485a5640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4140071d20 0x7f4140135f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.919 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f41485a5640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f414012e510 0x7f4140136480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:28.919 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f41485a5640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f414012e990 con 0x7f414012e510 2026-02-18T21:02:28.919 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f41485a5640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f414012eb10 con 0x7f4140071400 2026-02-18T21:02:28.919 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f41485a5640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f414012ec90 con 0x7f4140071d20 2026-02-18T21:02:28.919 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f414631a640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4140071400 0x7f4140135a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.919 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f4146b1b640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f414012e510 0x7f4140136480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.919 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f4145b19640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4140071d20 0x7f4140135f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:28.919 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f414631a640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4140071400 0x7f4140135a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42638/0 (socket says 10.20.193.68:42638) 2026-02-18T21:02:28.920 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f4146b1b640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f414012e510 0x7f4140136480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:39120/0 (socket says 10.20.193.68:39120) 2026-02-18T21:02:28.920 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f414631a640 1 -- 10.20.193.68:0/1581570513 learned_addr learned my addr 10.20.193.68:0/1581570513 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:28.920 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f414631a640 1 -- 10.20.193.68:0/1581570513 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4140071d20 msgr2=0x7f4140135f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.920 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f414631a640 1 --2- 10.20.193.68:0/1581570513 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4140071d20 0x7f4140135f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.920 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f414631a640 1 -- 10.20.193.68:0/1581570513 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f414012e510 msgr2=0x7f4140136480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.920 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f414631a640 1 --2- 10.20.193.68:0/1581570513 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f414012e510 0x7f4140136480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.920 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f414631a640 1 -- 10.20.193.68:0/1581570513 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f414012ee10 con 0x7f4140071400 2026-02-18T21:02:28.920 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f4146b1b640 1 --2- 10.20.193.68:0/1581570513 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f414012e510 0x7f4140136480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:28.920 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f414631a640 1 --2- 10.20.193.68:0/1581570513 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4140071400 0x7f4140135a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f413000ec10 tx=0x7f413000c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:28.920 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f4126ffd640 1 -- 10.20.193.68:0/1581570513 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130017070 con 0x7f4140071400 2026-02-18T21:02:28.920 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f4126ffd640 1 -- 10.20.193.68:0/1581570513 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f413000cc40 con 0x7f4140071400 2026-02-18T21:02:28.921 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f41485a5640 1 -- 10.20.193.68:0/1581570513 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4140138310 con 0x7f4140071400 2026-02-18T21:02:28.921 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f4126ffd640 1 -- 10.20.193.68:0/1581570513 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130013470 con 0x7f4140071400 2026-02-18T21:02:28.921 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f41485a5640 1 -- 10.20.193.68:0/1581570513 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4140137250 con 0x7f4140071400 2026-02-18T21:02:28.921 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.911+0000 7f41485a5640 1 -- 10.20.193.68:0/1581570513 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41401302c0 con 0x7f4140071400 2026-02-18T21:02:28.921 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.912+0000 7f4126ffd640 1 -- 10.20.193.68:0/1581570513 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f4130024060 con 0x7f4140071400 2026-02-18T21:02:28.921 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.912+0000 7f4126ffd640 1 -- 10.20.193.68:0/1581570513 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f4130066ca0 con 0x7f4140071400 2026-02-18T21:02:28.921 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.914+0000 7f4126ffd640 1 -- 10.20.193.68:0/1581570513 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f41401302c0 con 0x7f4140071400 2026-02-18T21:02:28.982 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.981+0000 7f41485a5640 1 -- 10.20.193.68:0/1581570513 --> v1:10.20.193.68:6816/2904515774 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f41400717e0 con 0x7f411004f790 2026-02-18T21:02:28.982 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.982+0000 7f4126ffd640 1 -- 10.20.193.68:0/1581570513 <== mgr.14114 v1:10.20.193.68:6816/2904515774 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31985 (unknown 2965378022 0 3056484353) 0x7f41400717e0 con 0x7f411004f790 2026-02-18T21:02:28.983 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:28.984 INFO:teuthology.orchestra.run.trial068.stderr:dumped all 2026-02-18T21:02:28.984 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.983+0000 7f41485a5640 1 -- 10.20.193.68:0/1581570513 >> v1:10.20.193.68:6816/2904515774 conn(0x7f411004f790 legacy=0x7f4110051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.985 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.983+0000 7f41485a5640 1 -- 10.20.193.68:0/1581570513 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4140071400 msgr2=0x7f4140135a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:28.985 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.983+0000 7f41485a5640 1 --2- 10.20.193.68:0/1581570513 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4140071400 0x7f4140135a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f413000ec10 tx=0x7f413000c520 comp rx=0 tx=0).stop 2026-02-18T21:02:28.985 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.983+0000 7f41485a5640 1 -- 10.20.193.68:0/1581570513 shutdown_connections 2026-02-18T21:02:28.985 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.983+0000 7f41485a5640 1 --2- 10.20.193.68:0/1581570513 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f414012e510 0x7f4140136480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.985 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.983+0000 7f41485a5640 1 --2- 10.20.193.68:0/1581570513 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f4140071d20 0x7f4140135f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.985 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.983+0000 7f41485a5640 1 --2- 10.20.193.68:0/1581570513 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f4140071400 0x7f4140135a00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:28.985 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.983+0000 7f41485a5640 1 -- 10.20.193.68:0/1581570513 >> 10.20.193.68:0/1581570513 conn(0x7f414009cee0 msgr2=0x7f414006ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:28.985 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.983+0000 7f41485a5640 1 -- 10.20.193.68:0/1581570513 shutdown_connections 2026-02-18T21:02:28.986 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:28.983+0000 7f41485a5640 1 -- 10.20.193.68:0/1581570513 wait complete. 2026-02-18T21:02:28.991 INFO:teuthology.orchestra.run.trial068.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2026-02-18T21:02:27.003932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":128752,"kb_used_data":2232,"kb_used_omap":17,"kb_used_meta":126446,"kb_avail":377358608,"statfs":{"total":386547056640,"available":386415214592,"internally_reserved":0,"allocated":2285568,"data_stored":1563269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18173,"internal_metadata":129480963},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.970785"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048218+0000","last_change":"2026-02-18T21:02:21.035499+0000","last_active":"2026-02-18T21:02:25.048218+0000","last_peered":"2026-02-18T21:02:25.048218+0000","last_clean":"2026-02-18T21:02:25.048218+0000","last_became_active":"2026-02-18T21:02:21.035326+0000","last_became_peered":"2026-02-18T21:02:21.035326+0000","last_unstale":"2026-02-18T21:02:25.048218+0000","last_undegraded":"2026-02-18T21:02:25.048218+0000","last_fullsized":"2026-02-18T21:02:25.048218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T00:53:21.914540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000486527,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-18T21:02:24.045765+0000","last_change":"2026-02-18T21:02:19.036890+0000","last_active":"2026-02-18T21:02:24.045765+0000","last_peered":"2026-02-18T21:02:24.045765+0000","last_clean":"2026-02-18T21:02:24.045765+0000","last_became_active":"2026-02-18T21:02:19.036766+0000","last_became_peered":"2026-02-18T21:02:19.036766+0000","last_unstale":"2026-02-18T21:02:24.045765+0000","last_undegraded":"2026-02-18T21:02:24.045765+0000","last_fullsized":"2026-02-18T21:02:24.045765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T08:09:48.776074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018692399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048248+0000","last_change":"2026-02-18T21:02:21.035264+0000","last_active":"2026-02-18T21:02:25.048248+0000","last_peered":"2026-02-18T21:02:25.048248+0000","last_clean":"2026-02-18T21:02:25.048248+0000","last_became_active":"2026-02-18T21:02:21.035120+0000","last_became_peered":"2026-02-18T21:02:21.035120+0000","last_unstale":"2026-02-18T21:02:25.048248+0000","last_undegraded":"2026-02-18T21:02:25.048248+0000","last_fullsized":"2026-02-18T21:02:25.048248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T08:23:02.934853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044243599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-18T21:02:24.045759+0000","last_change":"2026-02-18T21:02:19.036659+0000","last_active":"2026-02-18T21:02:24.045759+0000","last_peered":"2026-02-18T21:02:24.045759+0000","last_clean":"2026-02-18T21:02:24.045759+0000","last_became_active":"2026-02-18T21:02:19.036530+0000","last_became_peered":"2026-02-18T21:02:19.036530+0000","last_unstale":"2026-02-18T21:02:24.045759+0000","last_undegraded":"2026-02-18T21:02:24.045759+0000","last_fullsized":"2026-02-18T21:02:24.045759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T00:58:20.528612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020214300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048221+0000","last_change":"2026-02-18T21:02:21.036361+0000","last_active":"2026-02-18T21:02:25.048221+0000","last_peered":"2026-02-18T21:02:25.048221+0000","last_clean":"2026-02-18T21:02:25.048221+0000","last_became_active":"2026-02-18T21:02:21.036142+0000","last_became_peered":"2026-02-18T21:02:21.036142+0000","last_unstale":"2026-02-18T21:02:25.048221+0000","last_undegraded":"2026-02-18T21:02:25.048221+0000","last_fullsized":"2026-02-18T21:02:25.048221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T04:35:27.290307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036890000000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048111+0000","last_change":"2026-02-18T21:02:21.035466+0000","last_active":"2026-02-18T21:02:25.048111+0000","last_peered":"2026-02-18T21:02:25.048111+0000","last_clean":"2026-02-18T21:02:25.048111+0000","last_became_active":"2026-02-18T21:02:21.035305+0000","last_became_peered":"2026-02-18T21:02:21.035305+0000","last_unstale":"2026-02-18T21:02:25.048111+0000","last_undegraded":"2026-02-18T21:02:25.048111+0000","last_fullsized":"2026-02-18T21:02:25.048111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T01:23:13.378008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021428500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048222+0000","last_change":"2026-02-18T21:02:21.036020+0000","last_active":"2026-02-18T21:02:25.048222+0000","last_peered":"2026-02-18T21:02:25.048222+0000","last_clean":"2026-02-18T21:02:25.048222+0000","last_became_active":"2026-02-18T21:02:21.035916+0000","last_became_peered":"2026-02-18T21:02:21.035916+0000","last_unstale":"2026-02-18T21:02:25.048222+0000","last_undegraded":"2026-02-18T21:02:25.048222+0000","last_fullsized":"2026-02-18T21:02:25.048222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T06:05:49.040282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017934099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048226+0000","last_change":"2026-02-18T21:02:21.035434+0000","last_active":"2026-02-18T21:02:25.048226+0000","last_peered":"2026-02-18T21:02:25.048226+0000","last_clean":"2026-02-18T21:02:25.048226+0000","last_became_active":"2026-02-18T21:02:21.035231+0000","last_became_peered":"2026-02-18T21:02:21.035231+0000","last_unstale":"2026-02-18T21:02:25.048226+0000","last_undegraded":"2026-02-18T21:02:25.048226+0000","last_fullsized":"2026-02-18T21:02:25.048226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T00:30:40.499896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000176987,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'79","reported_seq":154,"reported_epoch":32,"state":"active+clean","last_fresh":"2026-02-18T21:02:24.045794+0000","last_change":"2026-02-18T21:02:19.036859+0000","last_active":"2026-02-18T21:02:24.045794+0000","last_peered":"2026-02-18T21:02:24.045794+0000","last_clean":"2026-02-18T21:02:24.045794+0000","last_became_active":"2026-02-18T21:02:19.036727+0000","last_became_peered":"2026-02-18T21:02:19.036727+0000","last_unstale":"2026-02-18T21:02:24.045794+0000","last_undegraded":"2026-02-18T21:02:24.045794+0000","last_fullsized":"2026-02-18T21:02:24.045794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:20.963920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:20.963920+0000","last_clean_scrub_stamp":"2026-02-18T21:01:20.963920+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T04:27:19.526940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":29,"seq":124554051587,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":276,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":282624,"data_stored":98317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":32370240},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":28,"seq":120259084291,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":264,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":270336,"data_stored":94735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":32370240},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":27,"seq":115964116995,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":848,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":868352,"data_stored":685122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":32370242},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149700,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":844,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":864256,"data_stored":685095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4543,"internal_metadata":32370241},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-18T21:02:28.993 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-18T21:02:29.068 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.064+0000 7f5c0e733640 1 Processor -- start 2026-02-18T21:02:29.068 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.064+0000 7f5c0e733640 1 -- start start 2026-02-18T21:02:29.069 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.064+0000 7f5c0e733640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f5c08071650 0x7f5c08070410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:29.069 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.064+0000 7f5c0e733640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5c08070950 0x7f5c08070da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:29.069 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.064+0000 7f5c0e733640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5c08134be0 0x7f5c08136fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:29.069 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.064+0000 7f5c0e733640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f5c08074010 con 0x7f5c08071650 2026-02-18T21:02:29.069 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.064+0000 7f5c0e733640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f5c080734b0 con 0x7f5c08134be0 2026-02-18T21:02:29.069 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.064+0000 7f5c0e733640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f5c080722e0 con 0x7f5c08070950 2026-02-18T21:02:29.069 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.064+0000 7f5c07fff640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f5c08071650 0x7f5c08070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:29.069 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.064+0000 7f5c07fff640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f5c08071650 0x7f5c08070410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:39134/0 (socket says 10.20.193.68:39134) 2026-02-18T21:02:29.069 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.064+0000 7f5c07fff640 1 -- 10.20.193.68:0/1452794281 learned_addr learned my addr 10.20.193.68:0/1452794281 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:29.069 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.064+0000 7f5c077fe640 1 --2- 10.20.193.68:0/1452794281 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5c08070950 0x7f5c08070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:29.070 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.064+0000 7f5c0cca9640 1 --2- 10.20.193.68:0/1452794281 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5c08134be0 0x7f5c08136fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:29.070 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.064+0000 7f5c07fff640 1 -- 10.20.193.68:0/1452794281 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5c08070950 msgr2=0x7f5c08070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:29.070 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.064+0000 7f5c07fff640 1 --2- 10.20.193.68:0/1452794281 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5c08070950 0x7f5c08070da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.070 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.064+0000 7f5c07fff640 1 -- 10.20.193.68:0/1452794281 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5c08134be0 msgr2=0x7f5c08136fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:29.070 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.064+0000 7f5c07fff640 1 --2- 10.20.193.68:0/1452794281 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5c08134be0 0x7f5c08136fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.070 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.064+0000 7f5c07fff640 1 -- 10.20.193.68:0/1452794281 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c08071a30 con 0x7f5c08071650 2026-02-18T21:02:29.070 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.064+0000 7f5c077fe640 1 --2- 10.20.193.68:0/1452794281 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5c08070950 0x7f5c08070da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:29.070 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.065+0000 7f5c07fff640 1 --2- 10.20.193.68:0/1452794281 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5c08071650 0x7f5c08070410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009970 tx=0x7f5bf402ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8265f47bddce16e server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:29.070 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.065+0000 7f5c06ffd640 1 -- 10.20.193.68:0/1452794281 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf403c070 con 0x7f5c08071650 2026-02-18T21:02:29.070 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.065+0000 7f5c06ffd640 1 -- 10.20.193.68:0/1452794281 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf402fac0 con 0x7f5c08071650 2026-02-18T21:02:29.070 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.065+0000 7f5c06ffd640 1 -- 10.20.193.68:0/1452794281 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4037440 con 0x7f5c08071650 2026-02-18T21:02:29.071 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.065+0000 7f5c0e733640 1 -- 10.20.193.68:0/1452794281 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5c08071650 msgr2=0x7f5c08070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:29.071 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.065+0000 7f5c0e733640 1 --2- 10.20.193.68:0/1452794281 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5c08071650 0x7f5c08070410 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009970 tx=0x7f5bf402ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:29.071 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.065+0000 7f5c0e733640 1 -- 10.20.193.68:0/1452794281 shutdown_connections 2026-02-18T21:02:29.071 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.065+0000 7f5c0e733640 1 --2- 10.20.193.68:0/1452794281 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5c08134be0 0x7f5c08136fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.071 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.065+0000 7f5c0e733640 1 --2- 10.20.193.68:0/1452794281 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5c08070950 0x7f5c08070da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.071 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.065+0000 7f5c0e733640 1 --2- 10.20.193.68:0/1452794281 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5c08071650 0x7f5c08070410 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.071 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.065+0000 7f5c0e733640 1 -- 10.20.193.68:0/1452794281 >> 10.20.193.68:0/1452794281 conn(0x7f5c0809ec10 msgr2=0x7f5c0809f020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:29.071 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.065+0000 7f5c0e733640 1 -- 10.20.193.68:0/1452794281 shutdown_connections 2026-02-18T21:02:29.071 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.065+0000 7f5c0e733640 1 -- 10.20.193.68:0/1452794281 wait complete. 2026-02-18T21:02:29.071 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.065+0000 7f5c0e733640 1 Processor -- start 2026-02-18T21:02:29.071 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.065+0000 7f5c0e733640 1 -- start start 2026-02-18T21:02:29.071 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c0e733640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5c08070950 0x7f5c080932a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:29.072 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c0e733640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5c08071650 0x7f5c080937e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:29.072 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c0e733640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5c08134be0 0x7f5c08093d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:29.072 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c0e733640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f5c081378a0 con 0x7f5c08071650 2026-02-18T21:02:29.072 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c0e733640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f5c08137720 con 0x7f5c08070950 2026-02-18T21:02:29.072 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c0e733640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f5c08137a20 con 0x7f5c08134be0 2026-02-18T21:02:29.072 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c07fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5c08070950 0x7f5c080932a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:29.072 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c077fe640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5c08071650 0x7f5c080937e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:29.072 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c07fff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5c08070950 0x7f5c080932a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42658/0 (socket says 10.20.193.68:42658) 2026-02-18T21:02:29.072 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c07fff640 1 -- 10.20.193.68:0/2720638438 learned_addr learned my addr 10.20.193.68:0/2720638438 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:29.072 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c0cca9640 1 --2- 10.20.193.68:0/2720638438 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5c08134be0 0x7f5c08093d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:29.072 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c077fe640 1 -- 10.20.193.68:0/2720638438 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5c08134be0 msgr2=0x7f5c08093d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:29.073 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c077fe640 1 --2- 10.20.193.68:0/2720638438 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5c08134be0 0x7f5c08093d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.073 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c077fe640 1 -- 10.20.193.68:0/2720638438 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5c08070950 msgr2=0x7f5c080932a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:29.073 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c077fe640 1 --2- 10.20.193.68:0/2720638438 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5c08070950 0x7f5c080932a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.073 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c077fe640 1 -- 10.20.193.68:0/2720638438 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0809a8a0 con 0x7f5c08071650 2026-02-18T21:02:29.073 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c077fe640 1 --2- 10.20.193.68:0/2720638438 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5c08071650 0x7f5c080937e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800ec10 tx=0x7f5bf800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:29.073 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c04ff9640 1 -- 10.20.193.68:0/2720638438 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8017070 con 0x7f5c08071650 2026-02-18T21:02:29.073 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c04ff9640 1 -- 10.20.193.68:0/2720638438 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf800cc40 con 0x7f5c08071650 2026-02-18T21:02:29.073 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c04ff9640 1 -- 10.20.193.68:0/2720638438 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8013470 con 0x7f5c08071650 2026-02-18T21:02:29.073 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c0e733640 1 -- 10.20.193.68:0/2720638438 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c0809ad40 con 0x7f5c08071650 2026-02-18T21:02:29.073 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.066+0000 7f5c0e733640 1 -- 10.20.193.68:0/2720638438 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c08095f30 con 0x7f5c08071650 2026-02-18T21:02:29.073 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.067+0000 7f5c0e733640 1 -- 10.20.193.68:0/2720638438 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c08070410 con 0x7f5c08071650 2026-02-18T21:02:29.073 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.067+0000 7f5c04ff9640 1 -- 10.20.193.68:0/2720638438 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f5bf8013610 con 0x7f5c08071650 2026-02-18T21:02:29.074 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.067+0000 7f5c04ff9640 1 -- 10.20.193.68:0/2720638438 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f5bf8067190 con 0x7f5c08071650 2026-02-18T21:02:29.074 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.069+0000 7f5c04ff9640 1 -- 10.20.193.68:0/2720638438 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f5bf8040ee0 con 0x7f5c08071650 2026-02-18T21:02:29.138 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.138+0000 7f5c0e733640 1 -- 10.20.193.68:0/2720638438 --> v1:10.20.193.68:6816/2904515774 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5c0806a210 con 0x7f5bd804f790 2026-02-18T21:02:29.138 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.138+0000 7f5c04ff9640 1 -- 10.20.193.68:0/2720638438 <== mgr.14114 v1:10.20.193.68:6816/2904515774 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31985 (unknown 2965378022 0 1943736226) 0x7f5c0806a210 con 0x7f5bd804f790 2026-02-18T21:02:29.139 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:29.140 INFO:teuthology.orchestra.run.trial068.stderr:dumped all 2026-02-18T21:02:29.140 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.139+0000 7f5c0e733640 1 -- 10.20.193.68:0/2720638438 >> v1:10.20.193.68:6816/2904515774 conn(0x7f5bd804f790 legacy=0x7f5bd8051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:29.140 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.139+0000 7f5c0e733640 1 -- 10.20.193.68:0/2720638438 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5c08071650 msgr2=0x7f5c080937e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:29.141 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.139+0000 7f5c0e733640 1 --2- 10.20.193.68:0/2720638438 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5c08071650 0x7f5c080937e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800ec10 tx=0x7f5bf800c520 comp rx=0 tx=0).stop 2026-02-18T21:02:29.141 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.139+0000 7f5c0e733640 1 -- 10.20.193.68:0/2720638438 shutdown_connections 2026-02-18T21:02:29.141 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.139+0000 7f5c0e733640 1 --2- 10.20.193.68:0/2720638438 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f5c08134be0 0x7f5c08093d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.141 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.139+0000 7f5c0e733640 1 --2- 10.20.193.68:0/2720638438 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f5c08071650 0x7f5c080937e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.141 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.139+0000 7f5c0e733640 1 --2- 10.20.193.68:0/2720638438 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f5c08070950 0x7f5c080932a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.141 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.139+0000 7f5c0e733640 1 -- 10.20.193.68:0/2720638438 >> 10.20.193.68:0/2720638438 conn(0x7f5c0809ec10 msgr2=0x7f5c08136250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:29.141 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.139+0000 7f5c0e733640 1 -- 10.20.193.68:0/2720638438 shutdown_connections 2026-02-18T21:02:29.141 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.139+0000 7f5c0e733640 1 -- 10.20.193.68:0/2720638438 wait complete. 2026-02-18T21:02:29.147 INFO:teuthology.orchestra.run.trial068.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2026-02-18T21:02:29.004145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":128768,"kb_used_data":2248,"kb_used_omap":17,"kb_used_meta":126446,"kb_avail":377358592,"statfs":{"total":386547056640,"available":386415198208,"internally_reserved":0,"allocated":2301952,"data_stored":1570395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18173,"internal_metadata":129480963},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000698"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048218+0000","last_change":"2026-02-18T21:02:21.035499+0000","last_active":"2026-02-18T21:02:25.048218+0000","last_peered":"2026-02-18T21:02:25.048218+0000","last_clean":"2026-02-18T21:02:25.048218+0000","last_became_active":"2026-02-18T21:02:21.035326+0000","last_became_peered":"2026-02-18T21:02:21.035326+0000","last_unstale":"2026-02-18T21:02:25.048218+0000","last_undegraded":"2026-02-18T21:02:25.048218+0000","last_fullsized":"2026-02-18T21:02:25.048218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T00:53:21.914540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000486527,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:26.365211+0000","last_change":"2026-02-18T21:02:19.036890+0000","last_active":"2026-02-18T21:02:26.365211+0000","last_peered":"2026-02-18T21:02:26.365211+0000","last_clean":"2026-02-18T21:02:26.365211+0000","last_became_active":"2026-02-18T21:02:19.036766+0000","last_became_peered":"2026-02-18T21:02:19.036766+0000","last_unstale":"2026-02-18T21:02:26.365211+0000","last_undegraded":"2026-02-18T21:02:26.365211+0000","last_fullsized":"2026-02-18T21:02:26.365211+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T04:56:21.470671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018692399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048248+0000","last_change":"2026-02-18T21:02:21.035264+0000","last_active":"2026-02-18T21:02:25.048248+0000","last_peered":"2026-02-18T21:02:25.048248+0000","last_clean":"2026-02-18T21:02:25.048248+0000","last_became_active":"2026-02-18T21:02:21.035120+0000","last_became_peered":"2026-02-18T21:02:21.035120+0000","last_unstale":"2026-02-18T21:02:25.048248+0000","last_undegraded":"2026-02-18T21:02:25.048248+0000","last_fullsized":"2026-02-18T21:02:25.048248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T08:23:02.934853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044243599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:26.365172+0000","last_change":"2026-02-18T21:02:19.036659+0000","last_active":"2026-02-18T21:02:26.365172+0000","last_peered":"2026-02-18T21:02:26.365172+0000","last_clean":"2026-02-18T21:02:26.365172+0000","last_became_active":"2026-02-18T21:02:19.036530+0000","last_became_peered":"2026-02-18T21:02:19.036530+0000","last_unstale":"2026-02-18T21:02:26.365172+0000","last_undegraded":"2026-02-18T21:02:26.365172+0000","last_fullsized":"2026-02-18T21:02:26.365172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T05:12:12.426889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020214300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048221+0000","last_change":"2026-02-18T21:02:21.036361+0000","last_active":"2026-02-18T21:02:25.048221+0000","last_peered":"2026-02-18T21:02:25.048221+0000","last_clean":"2026-02-18T21:02:25.048221+0000","last_became_active":"2026-02-18T21:02:21.036142+0000","last_became_peered":"2026-02-18T21:02:21.036142+0000","last_unstale":"2026-02-18T21:02:25.048221+0000","last_undegraded":"2026-02-18T21:02:25.048221+0000","last_fullsized":"2026-02-18T21:02:25.048221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T04:35:27.290307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036890000000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048111+0000","last_change":"2026-02-18T21:02:21.035466+0000","last_active":"2026-02-18T21:02:25.048111+0000","last_peered":"2026-02-18T21:02:25.048111+0000","last_clean":"2026-02-18T21:02:25.048111+0000","last_became_active":"2026-02-18T21:02:21.035305+0000","last_became_peered":"2026-02-18T21:02:21.035305+0000","last_unstale":"2026-02-18T21:02:25.048111+0000","last_undegraded":"2026-02-18T21:02:25.048111+0000","last_fullsized":"2026-02-18T21:02:25.048111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T01:23:13.378008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021428500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048222+0000","last_change":"2026-02-18T21:02:21.036020+0000","last_active":"2026-02-18T21:02:25.048222+0000","last_peered":"2026-02-18T21:02:25.048222+0000","last_clean":"2026-02-18T21:02:25.048222+0000","last_became_active":"2026-02-18T21:02:21.035916+0000","last_became_peered":"2026-02-18T21:02:21.035916+0000","last_unstale":"2026-02-18T21:02:25.048222+0000","last_undegraded":"2026-02-18T21:02:25.048222+0000","last_fullsized":"2026-02-18T21:02:25.048222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T06:05:49.040282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017934099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048226+0000","last_change":"2026-02-18T21:02:21.035434+0000","last_active":"2026-02-18T21:02:25.048226+0000","last_peered":"2026-02-18T21:02:25.048226+0000","last_clean":"2026-02-18T21:02:25.048226+0000","last_became_active":"2026-02-18T21:02:21.035231+0000","last_became_peered":"2026-02-18T21:02:21.035231+0000","last_unstale":"2026-02-18T21:02:25.048226+0000","last_undegraded":"2026-02-18T21:02:25.048226+0000","last_fullsized":"2026-02-18T21:02:25.048226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T00:30:40.499896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000176987,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'79","reported_seq":156,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:26.365112+0000","last_change":"2026-02-18T21:02:19.036859+0000","last_active":"2026-02-18T21:02:26.365112+0000","last_peered":"2026-02-18T21:02:26.365112+0000","last_clean":"2026-02-18T21:02:26.365112+0000","last_became_active":"2026-02-18T21:02:19.036727+0000","last_became_peered":"2026-02-18T21:02:19.036727+0000","last_unstale":"2026-02-18T21:02:26.365112+0000","last_undegraded":"2026-02-18T21:02:26.365112+0000","last_fullsized":"2026-02-18T21:02:26.365112+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:20.963920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:20.963920+0000","last_clean_scrub_stamp":"2026-02-18T21:01:20.963920+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T04:27:19.526940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":29,"seq":124554051587,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":276,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":282624,"data_stored":98317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":32370240},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":28,"seq":120259084292,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":272,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":278528,"data_stored":98298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":32370240},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":27,"seq":115964116996,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":856,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":876544,"data_stored":688685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":32370242},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149700,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":844,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":864256,"data_stored":685095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4543,"internal_metadata":32370241},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-18T21:02:29.148 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-18T21:02:29.149 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-18T21:02:29.220 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.216+0000 7fedbddef640 1 Processor -- start 2026-02-18T21:02:29.220 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.216+0000 7fedbddef640 1 -- start start 2026-02-18T21:02:29.220 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.216+0000 7fedbddef640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedb8071400 0x7fedb80717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:29.220 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.216+0000 7fedbddef640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fedb8071d20 0x7fedb812de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:29.220 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.216+0000 7fedbddef640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedb812e340 0x7fedb812e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:29.221 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.216+0000 7fedbddef640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7fedb80731f0 con 0x7fedb8071d20 2026-02-18T21:02:29.221 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.216+0000 7fedbddef640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fedb809e090 con 0x7fedb812e340 2026-02-18T21:02:29.221 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.216+0000 7fedbddef640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fedb8073f90 con 0x7fedb8071400 2026-02-18T21:02:29.221 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.216+0000 7fedb77fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedb8071400 0x7fedb80717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:29.221 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.216+0000 7fedb77fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedb8071400 0x7fedb80717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60872/0 (socket says 10.20.193.68:60872) 2026-02-18T21:02:29.221 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.216+0000 7fedb77fe640 1 -- 10.20.193.68:0/1138494390 learned_addr learned my addr 10.20.193.68:0/1138494390 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:29.221 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.216+0000 7fedb7fff640 1 --2- 10.20.193.68:0/1138494390 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedb812e340 0x7fedb812e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:29.221 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.216+0000 7fedb6ffd640 1 --2- 10.20.193.68:0/1138494390 >> v2:10.20.193.68:3300/0 conn(0x7fedb8071d20 0x7fedb812de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:29.221 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.216+0000 7fedb77fe640 1 -- 10.20.193.68:0/1138494390 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedb812e340 msgr2=0x7fedb812e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:29.221 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.216+0000 7fedb77fe640 1 --2- 10.20.193.68:0/1138494390 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedb812e340 0x7fedb812e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.221 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.216+0000 7fedb77fe640 1 -- 10.20.193.68:0/1138494390 >> v2:10.20.193.68:3300/0 conn(0x7fedb8071d20 msgr2=0x7fedb812de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:29.222 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.216+0000 7fedb77fe640 1 --2- 10.20.193.68:0/1138494390 >> v2:10.20.193.68:3300/0 conn(0x7fedb8071d20 0x7fedb812de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.222 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.216+0000 7fedb77fe640 1 -- 10.20.193.68:0/1138494390 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb8072900 con 0x7fedb8071400 2026-02-18T21:02:29.222 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.217+0000 7fedb77fe640 1 --2- 10.20.193.68:0/1138494390 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedb8071400 0x7fedb80717e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feda4009970 tx=0x7feda402eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90e4486a330d8cce server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:29.222 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.217+0000 7fedb67fc640 1 -- 10.20.193.68:0/1138494390 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda403c070 con 0x7fedb8071400 2026-02-18T21:02:29.222 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.217+0000 7fedb67fc640 1 -- 10.20.193.68:0/1138494390 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda402fb60 con 0x7fedb8071400 2026-02-18T21:02:29.222 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.217+0000 7fedb67fc640 1 -- 10.20.193.68:0/1138494390 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda4037440 con 0x7fedb8071400 2026-02-18T21:02:29.222 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.217+0000 7fedbddef640 1 -- 10.20.193.68:0/1138494390 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedb8071400 msgr2=0x7fedb80717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:29.222 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.217+0000 7fedbddef640 1 --2- 10.20.193.68:0/1138494390 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedb8071400 0x7fedb80717e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feda4009970 tx=0x7feda402eef0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.222 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.217+0000 7fedbddef640 1 -- 10.20.193.68:0/1138494390 shutdown_connections 2026-02-18T21:02:29.222 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.217+0000 7fedbddef640 1 --2- 10.20.193.68:0/1138494390 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedb812e340 0x7fedb812e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.222 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.217+0000 7fedbddef640 1 --2- 10.20.193.68:0/1138494390 >> v2:10.20.193.68:3300/0 conn(0x7fedb8071d20 0x7fedb812de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.222 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.217+0000 7fedbddef640 1 --2- 10.20.193.68:0/1138494390 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedb8071400 0x7fedb80717e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.223 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.217+0000 7fedbddef640 1 -- 10.20.193.68:0/1138494390 >> 10.20.193.68:0/1138494390 conn(0x7fedb809cee0 msgr2=0x7fedb809d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:29.223 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.217+0000 7fedbddef640 1 -- 10.20.193.68:0/1138494390 shutdown_connections 2026-02-18T21:02:29.223 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.217+0000 7fedbddef640 1 -- 10.20.193.68:0/1138494390 wait complete. 2026-02-18T21:02:29.223 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.217+0000 7fedbddef640 1 Processor -- start 2026-02-18T21:02:29.223 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fedbddef640 1 -- start start 2026-02-18T21:02:29.223 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fedbddef640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedb8071400 0x7fedb813a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:29.223 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fedbddef640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedb8071d20 0x7fedb813acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:29.223 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fedbddef640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fedb812e340 0x7fedb813b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:29.223 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fedbddef640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fedb8072100 con 0x7fedb812e340 2026-02-18T21:02:29.223 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fedbddef640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fedb813ba30 con 0x7fedb8071d20 2026-02-18T21:02:29.223 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fedbddef640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fedb8115250 con 0x7fedb8071400 2026-02-18T21:02:29.223 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fedb77fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedb8071400 0x7fedb813a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:29.223 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fedb77fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedb8071400 0x7fedb813a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60886/0 (socket says 10.20.193.68:60886) 2026-02-18T21:02:29.224 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fedb77fe640 1 -- 10.20.193.68:0/1802932538 learned_addr learned my addr 10.20.193.68:0/1802932538 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:29.224 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fedb6ffd640 1 --2- 10.20.193.68:0/1802932538 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedb8071d20 0x7fedb813acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:29.224 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fedb7fff640 1 --2- 10.20.193.68:0/1802932538 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fedb812e340 0x7fedb813b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:29.224 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fedb77fe640 1 -- 10.20.193.68:0/1802932538 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedb8071d20 msgr2=0x7fedb813acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:29.224 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fedb77fe640 1 --2- 10.20.193.68:0/1802932538 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedb8071d20 0x7fedb813acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.224 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fedb77fe640 1 -- 10.20.193.68:0/1802932538 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fedb812e340 msgr2=0x7fedb813b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:29.224 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fedb77fe640 1 --2- 10.20.193.68:0/1802932538 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fedb812e340 0x7fedb813b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.224 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fedb77fe640 1 -- 10.20.193.68:0/1802932538 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb813b730 con 0x7fedb8071400 2026-02-18T21:02:29.224 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fedb77fe640 1 --2- 10.20.193.68:0/1802932538 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedb8071400 0x7fedb813a770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feda4009aa0 tx=0x7feda40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:29.224 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fed93fff640 1 -- 10.20.193.68:0/1802932538 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda4047070 con 0x7fedb8071400 2026-02-18T21:02:29.224 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fed93fff640 1 -- 10.20.193.68:0/1802932538 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda4042430 con 0x7fedb8071400 2026-02-18T21:02:29.225 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fedbddef640 1 -- 10.20.193.68:0/1802932538 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedb8116330 con 0x7fedb8071400 2026-02-18T21:02:29.225 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fed93fff640 1 -- 10.20.193.68:0/1802932538 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda403c040 con 0x7fedb8071400 2026-02-18T21:02:29.225 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.218+0000 7fedbddef640 1 -- 10.20.193.68:0/1802932538 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fedb81d1c60 con 0x7fedb8071400 2026-02-18T21:02:29.225 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.219+0000 7fedbddef640 1 -- 10.20.193.68:0/1802932538 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedb812de00 con 0x7fedb8071400 2026-02-18T21:02:29.225 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.219+0000 7fed93fff640 1 -- 10.20.193.68:0/1802932538 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7feda403f3c0 con 0x7fedb8071400 2026-02-18T21:02:29.225 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.219+0000 7fed93fff640 1 -- 10.20.193.68:0/1802932538 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7feda408b6c0 con 0x7fedb8071400 2026-02-18T21:02:29.225 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.221+0000 7fed93fff640 1 -- 10.20.193.68:0/1802932538 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7feda4065560 con 0x7fedb8071400 2026-02-18T21:02:29.289 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.289+0000 7fedbddef640 1 -- 10.20.193.68:0/1802932538 --> v1:10.20.193.68:6816/2904515774 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fedb812ee10 con 0x7fed8804f790 2026-02-18T21:02:29.290 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.290+0000 7fed93fff640 1 -- 10.20.193.68:0/1802932538 <== mgr.14114 v1:10.20.193.68:6816/2904515774 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31985 (unknown 2965378022 0 1943736226) 0x7feda80098c0 con 0x7fed8804f790 2026-02-18T21:02:29.290 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:29.291 INFO:teuthology.orchestra.run.trial068.stderr:dumped all 2026-02-18T21:02:29.291 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.290+0000 7fedbddef640 1 -- 10.20.193.68:0/1802932538 >> v1:10.20.193.68:6816/2904515774 conn(0x7fed8804f790 legacy=0x7fed88051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:29.292 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.290+0000 7fedbddef640 1 -- 10.20.193.68:0/1802932538 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedb8071400 msgr2=0x7fedb813a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:29.292 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.290+0000 7fedbddef640 1 --2- 10.20.193.68:0/1802932538 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedb8071400 0x7fedb813a770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feda4009aa0 tx=0x7feda40047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.292 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.290+0000 7fedbddef640 1 -- 10.20.193.68:0/1802932538 shutdown_connections 2026-02-18T21:02:29.292 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.290+0000 7fedbddef640 1 --2- 10.20.193.68:0/1802932538 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fedb812e340 0x7fedb813b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.292 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.290+0000 7fedbddef640 1 --2- 10.20.193.68:0/1802932538 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fedb8071d20 0x7fedb813acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.292 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.290+0000 7fedbddef640 1 --2- 10.20.193.68:0/1802932538 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fedb8071400 0x7fedb813a770 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.292 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.290+0000 7fedbddef640 1 -- 10.20.193.68:0/1802932538 >> 10.20.193.68:0/1802932538 conn(0x7fedb809cee0 msgr2=0x7fedb8131960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:29.292 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.290+0000 7fedbddef640 1 -- 10.20.193.68:0/1802932538 shutdown_connections 2026-02-18T21:02:29.292 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.290+0000 7fedbddef640 1 -- 10.20.193.68:0/1802932538 wait complete. 2026-02-18T21:02:29.297 INFO:teuthology.orchestra.run.trial068.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2026-02-18T21:02:29.004145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":128768,"kb_used_data":2248,"kb_used_omap":17,"kb_used_meta":126446,"kb_avail":377358592,"statfs":{"total":386547056640,"available":386415198208,"internally_reserved":0,"allocated":2301952,"data_stored":1570395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18173,"internal_metadata":129480963},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000698"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048218+0000","last_change":"2026-02-18T21:02:21.035499+0000","last_active":"2026-02-18T21:02:25.048218+0000","last_peered":"2026-02-18T21:02:25.048218+0000","last_clean":"2026-02-18T21:02:25.048218+0000","last_became_active":"2026-02-18T21:02:21.035326+0000","last_became_peered":"2026-02-18T21:02:21.035326+0000","last_unstale":"2026-02-18T21:02:25.048218+0000","last_undegraded":"2026-02-18T21:02:25.048218+0000","last_fullsized":"2026-02-18T21:02:25.048218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T00:53:21.914540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000486527,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:26.365211+0000","last_change":"2026-02-18T21:02:19.036890+0000","last_active":"2026-02-18T21:02:26.365211+0000","last_peered":"2026-02-18T21:02:26.365211+0000","last_clean":"2026-02-18T21:02:26.365211+0000","last_became_active":"2026-02-18T21:02:19.036766+0000","last_became_peered":"2026-02-18T21:02:19.036766+0000","last_unstale":"2026-02-18T21:02:26.365211+0000","last_undegraded":"2026-02-18T21:02:26.365211+0000","last_fullsized":"2026-02-18T21:02:26.365211+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T04:56:21.470671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018692399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048248+0000","last_change":"2026-02-18T21:02:21.035264+0000","last_active":"2026-02-18T21:02:25.048248+0000","last_peered":"2026-02-18T21:02:25.048248+0000","last_clean":"2026-02-18T21:02:25.048248+0000","last_became_active":"2026-02-18T21:02:21.035120+0000","last_became_peered":"2026-02-18T21:02:21.035120+0000","last_unstale":"2026-02-18T21:02:25.048248+0000","last_undegraded":"2026-02-18T21:02:25.048248+0000","last_fullsized":"2026-02-18T21:02:25.048248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T08:23:02.934853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044243599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:26.365172+0000","last_change":"2026-02-18T21:02:19.036659+0000","last_active":"2026-02-18T21:02:26.365172+0000","last_peered":"2026-02-18T21:02:26.365172+0000","last_clean":"2026-02-18T21:02:26.365172+0000","last_became_active":"2026-02-18T21:02:19.036530+0000","last_became_peered":"2026-02-18T21:02:19.036530+0000","last_unstale":"2026-02-18T21:02:26.365172+0000","last_undegraded":"2026-02-18T21:02:26.365172+0000","last_fullsized":"2026-02-18T21:02:26.365172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T05:12:12.426889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020214300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048221+0000","last_change":"2026-02-18T21:02:21.036361+0000","last_active":"2026-02-18T21:02:25.048221+0000","last_peered":"2026-02-18T21:02:25.048221+0000","last_clean":"2026-02-18T21:02:25.048221+0000","last_became_active":"2026-02-18T21:02:21.036142+0000","last_became_peered":"2026-02-18T21:02:21.036142+0000","last_unstale":"2026-02-18T21:02:25.048221+0000","last_undegraded":"2026-02-18T21:02:25.048221+0000","last_fullsized":"2026-02-18T21:02:25.048221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T04:35:27.290307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036890000000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048111+0000","last_change":"2026-02-18T21:02:21.035466+0000","last_active":"2026-02-18T21:02:25.048111+0000","last_peered":"2026-02-18T21:02:25.048111+0000","last_clean":"2026-02-18T21:02:25.048111+0000","last_became_active":"2026-02-18T21:02:21.035305+0000","last_became_peered":"2026-02-18T21:02:21.035305+0000","last_unstale":"2026-02-18T21:02:25.048111+0000","last_undegraded":"2026-02-18T21:02:25.048111+0000","last_fullsized":"2026-02-18T21:02:25.048111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T01:23:13.378008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021428500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048222+0000","last_change":"2026-02-18T21:02:21.036020+0000","last_active":"2026-02-18T21:02:25.048222+0000","last_peered":"2026-02-18T21:02:25.048222+0000","last_clean":"2026-02-18T21:02:25.048222+0000","last_became_active":"2026-02-18T21:02:21.035916+0000","last_became_peered":"2026-02-18T21:02:21.035916+0000","last_unstale":"2026-02-18T21:02:25.048222+0000","last_undegraded":"2026-02-18T21:02:25.048222+0000","last_fullsized":"2026-02-18T21:02:25.048222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T06:05:49.040282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017934099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048226+0000","last_change":"2026-02-18T21:02:21.035434+0000","last_active":"2026-02-18T21:02:25.048226+0000","last_peered":"2026-02-18T21:02:25.048226+0000","last_clean":"2026-02-18T21:02:25.048226+0000","last_became_active":"2026-02-18T21:02:21.035231+0000","last_became_peered":"2026-02-18T21:02:21.035231+0000","last_unstale":"2026-02-18T21:02:25.048226+0000","last_undegraded":"2026-02-18T21:02:25.048226+0000","last_fullsized":"2026-02-18T21:02:25.048226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T00:30:40.499896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000176987,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'79","reported_seq":156,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:26.365112+0000","last_change":"2026-02-18T21:02:19.036859+0000","last_active":"2026-02-18T21:02:26.365112+0000","last_peered":"2026-02-18T21:02:26.365112+0000","last_clean":"2026-02-18T21:02:26.365112+0000","last_became_active":"2026-02-18T21:02:19.036727+0000","last_became_peered":"2026-02-18T21:02:19.036727+0000","last_unstale":"2026-02-18T21:02:26.365112+0000","last_undegraded":"2026-02-18T21:02:26.365112+0000","last_fullsized":"2026-02-18T21:02:26.365112+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:20.963920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:20.963920+0000","last_clean_scrub_stamp":"2026-02-18T21:01:20.963920+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T04:27:19.526940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":29,"seq":124554051587,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":276,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":282624,"data_stored":98317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":32370240},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":28,"seq":120259084292,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":272,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":278528,"data_stored":98298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":32370240},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":27,"seq":115964116996,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":856,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":876544,"data_stored":688685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":32370242},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149700,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":844,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":864256,"data_stored":685095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4543,"internal_metadata":32370241},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-18T21:02:29.299 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-18T21:02:29.368 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.366+0000 7ff087906640 1 Processor -- start 2026-02-18T21:02:29.368 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.366+0000 7ff087906640 1 -- start start 2026-02-18T21:02:29.369 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.366+0000 7ff087906640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff080130da0 0x7ff0801354c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:29.369 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.366+0000 7ff087906640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ff080135a00 0x7ff080137df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:29.369 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.366+0000 7ff087906640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff080073b30 con 0x7ff080130180 2026-02-18T21:02:29.369 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.366+0000 7ff087906640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7ff080074100 con 0x7ff080135a00 2026-02-18T21:02:29.369 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.366+0000 7ff087906640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7ff0800a2960 con 0x7ff080130da0 2026-02-18T21:02:29.369 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.366+0000 7ff085e7c640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ff080135a00 0x7ff080137df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:29.369 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.366+0000 7ff084e7a640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff080130da0 0x7ff0801354c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:29.369 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.366+0000 7ff08567b640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7ff080130180 0x7ff080130690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:44770/0 (socket says 10.20.193.68:44770) 2026-02-18T21:02:29.369 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.366+0000 7ff08567b640 1 -- 10.20.193.68:0/280190127 learned_addr learned my addr 10.20.193.68:0/280190127 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:29.369 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.367+0000 7ff085e7c640 1 -- 10.20.193.68:0/280190127 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff080130da0 msgr2=0x7ff0801354c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:29.370 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.367+0000 7ff085e7c640 1 --2- 10.20.193.68:0/280190127 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff080130da0 0x7ff0801354c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.370 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.367+0000 7ff085e7c640 1 -- 10.20.193.68:0/280190127 >> v1:10.20.193.68:6789/0 conn(0x7ff080130180 legacy=0x7ff080130690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:29.370 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.367+0000 7ff085e7c640 1 -- 10.20.193.68:0/280190127 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0800731c0 con 0x7ff080135a00 2026-02-18T21:02:29.370 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.367+0000 7ff085e7c640 1 --2- 10.20.193.68:0/280190127 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ff080135a00 0x7ff080137df0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff07c009df0 tx=0x7ff07c02f250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7dee0c8b377a57e server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:29.370 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.367+0000 7ff06ffff640 1 -- 10.20.193.68:0/280190127 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c03c070 con 0x7ff080135a00 2026-02-18T21:02:29.370 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.367+0000 7ff06ffff640 1 -- 10.20.193.68:0/280190127 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff07c037440 con 0x7ff080135a00 2026-02-18T21:02:29.370 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.367+0000 7ff06ffff640 1 -- 10.20.193.68:0/280190127 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c037810 con 0x7ff080135a00 2026-02-18T21:02:29.370 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.367+0000 7ff087906640 1 -- 10.20.193.68:0/280190127 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ff080135a00 msgr2=0x7ff080137df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:29.370 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.367+0000 7ff087906640 1 --2- 10.20.193.68:0/280190127 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ff080135a00 0x7ff080137df0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff07c009df0 tx=0x7ff07c02f250 comp rx=0 tx=0).stop 2026-02-18T21:02:29.370 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.367+0000 7ff087906640 1 -- 10.20.193.68:0/280190127 shutdown_connections 2026-02-18T21:02:29.370 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.367+0000 7ff087906640 1 --2- 10.20.193.68:0/280190127 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ff080135a00 0x7ff080137df0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.370 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.367+0000 7ff087906640 1 --2- 10.20.193.68:0/280190127 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff080130da0 0x7ff0801354c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.371 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.367+0000 7ff087906640 1 -- 10.20.193.68:0/280190127 >> 10.20.193.68:0/280190127 conn(0x7ff0800a1e40 msgr2=0x7ff0800a2250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:29.371 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.367+0000 7ff087906640 1 -- 10.20.193.68:0/280190127 shutdown_connections 2026-02-18T21:02:29.371 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.367+0000 7ff087906640 1 -- 10.20.193.68:0/280190127 wait complete. 2026-02-18T21:02:29.371 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.368+0000 7ff087906640 1 Processor -- start 2026-02-18T21:02:29.371 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.368+0000 7ff087906640 1 -- start start 2026-02-18T21:02:29.373 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff087906640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ff080130180 0x7ff080131510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:29.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff087906640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ff080130da0 0x7ff080131a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:29.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff087906640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff080135a00 0x7ff080131f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:29.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff087906640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7ff0801386c0 con 0x7ff080130da0 2026-02-18T21:02:29.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff087906640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7ff080138540 con 0x7ff080130180 2026-02-18T21:02:29.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff087906640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7ff080138840 con 0x7ff080135a00 2026-02-18T21:02:29.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff08567b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ff080130180 0x7ff080131510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:29.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff084e7a640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ff080130da0 0x7ff080131a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:29.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff085e7c640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff080135a00 0x7ff080131f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:29.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff084e7a640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ff080130da0 0x7ff080131a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:39164/0 (socket says 10.20.193.68:39164) 2026-02-18T21:02:29.374 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff084e7a640 1 -- 10.20.193.68:0/3402220701 learned_addr learned my addr 10.20.193.68:0/3402220701 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:29.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff08567b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ff080130180 0x7ff080131510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:42710/0 (socket says 10.20.193.68:42710) 2026-02-18T21:02:29.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff085e7c640 1 -- 10.20.193.68:0/3402220701 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ff080130180 msgr2=0x7ff080131510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:29.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff085e7c640 1 --2- 10.20.193.68:0/3402220701 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ff080130180 0x7ff080131510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff085e7c640 1 -- 10.20.193.68:0/3402220701 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ff080130da0 msgr2=0x7ff080131a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:29.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff085e7c640 1 --2- 10.20.193.68:0/3402220701 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ff080130da0 0x7ff080131a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff085e7c640 1 -- 10.20.193.68:0/3402220701 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0801337d0 con 0x7ff080135a00 2026-02-18T21:02:29.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff084e7a640 1 --2- 10.20.193.68:0/3402220701 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ff080130da0 0x7ff080131a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:29.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff085e7c640 1 --2- 10.20.193.68:0/3402220701 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff080135a00 0x7ff080131f90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff07c036000 tx=0x7ff07c004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:29.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff06dffb640 1 -- 10.20.193.68:0/3402220701 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c03c050 con 0x7ff080135a00 2026-02-18T21:02:29.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff06dffb640 1 -- 10.20.193.68:0/3402220701 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff07c048070 con 0x7ff080135a00 2026-02-18T21:02:29.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff087906640 1 -- 10.20.193.68:0/3402220701 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff080132e10 con 0x7ff080135a00 2026-02-18T21:02:29.375 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff06dffb640 1 -- 10.20.193.68:0/3402220701 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c041a10 con 0x7ff080135a00 2026-02-18T21:02:29.376 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff087906640 1 -- 10.20.193.68:0/3402220701 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7ff080133a10 con 0x7ff080135a00 2026-02-18T21:02:29.376 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.369+0000 7ff087906640 1 -- 10.20.193.68:0/3402220701 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0800687c0 con 0x7ff080135a00 2026-02-18T21:02:29.376 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.370+0000 7ff06dffb640 1 -- 10.20.193.68:0/3402220701 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7ff07c041bb0 con 0x7ff080135a00 2026-02-18T21:02:29.376 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.370+0000 7ff06dffb640 1 -- 10.20.193.68:0/3402220701 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7ff07c08cac0 con 0x7ff080135a00 2026-02-18T21:02:29.376 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.372+0000 7ff06dffb640 1 -- 10.20.193.68:0/3402220701 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7ff07c08bb70 con 0x7ff080135a00 2026-02-18T21:02:29.443 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.443+0000 7ff087906640 1 -- 10.20.193.68:0/3402220701 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0801306c0 con 0x7ff080135a00 2026-02-18T21:02:29.443 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.443+0000 7ff06dffb640 1 -- 10.20.193.68:0/3402220701 <== mon.2 v2:10.20.193.68:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+9171 (secure 0 0 0) 0x7ff0801306c0 con 0x7ff080135a00 2026-02-18T21:02:29.444 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:29.444 INFO:teuthology.orchestra.run.trial068.stdout:{"epoch":33,"fsid":"73558818-cfd1-494a-84aa-56d128598ef4","created":"2026-02-18T21:01:11.071818+0000","modified":"2026-02-18T21:02:25.044997+0000","last_up_change":"2026-02-18T21:02:20.031260+0000","last_in_change":"2026-02-18T21:01:11.803245+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"quincy","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-18T21:01:20.913845+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-18T21:01:25.650381+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":16,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb5f8e54-3a43-41d6-b266-aa412a7f170e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":20,"up_from":26,"up_thru":26,"down_at":21,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6800","nonce":2637053487}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6801","nonce":2637053487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6803","nonce":2637053487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6802","nonce":2637053487}]},"public_addr":"10.20.193.68:6800/2637053487","cluster_addr":"10.20.193.68:6801/2637053487","heartbeat_back_addr":"10.20.193.68:6803/2637053487","heartbeat_front_addr":"10.20.193.68:6802/2637053487","state":["exists","up"]},{"osd":1,"uuid":"e26d8762-250e-42e7-8768-23caa22edb04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":27,"up_thru":27,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6804","nonce":4160428224}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6805","nonce":4160428224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6807","nonce":4160428224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6806","nonce":4160428224}]},"public_addr":"10.20.193.68:6804/4160428224","cluster_addr":"10.20.193.68:6805/4160428224","heartbeat_back_addr":"10.20.193.68:6807/4160428224","heartbeat_front_addr":"10.20.193.68:6806/4160428224","state":["exists","up"]},{"osd":2,"uuid":"568ee96d-39ac-4d79-92bb-d1f3f12601b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":21,"up_from":28,"up_thru":29,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6808","nonce":3642986683}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6809","nonce":3642986683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6811","nonce":3642986683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6810","nonce":3642986683}]},"public_addr":"10.20.193.68:6808/3642986683","cluster_addr":"10.20.193.68:6809/3642986683","heartbeat_back_addr":"10.20.193.68:6811/3642986683","heartbeat_front_addr":"10.20.193.68:6810/3642986683","state":["exists","up"]},{"osd":3,"uuid":"765a38cd-f526-4aba-b94e-c57076ca6c72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":29,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6812","nonce":1687218919}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6813","nonce":1687218919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6815","nonce":1687218919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.68:6814","nonce":1687218919}]},"public_addr":"10.20.193.68:6812/1687218919","cluster_addr":"10.20.193.68:6813/1687218919","heartbeat_back_addr":"10.20.193.68:6815/1687218919","heartbeat_front_addr":"10.20.193.68:6814/1687218919","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.873205+0000","dead_epoch":21},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.929452+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.863830+0000","dead_epoch":23},{"osd":3,"down_stamp":"2026-02-18T21:02:12.008626+0000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-18T21:01:16.949895+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.68:0/991885778":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/4112610678":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/4267957295":"2026-02-19T21:02:04.994407+0000","10.20.193.68:6816/24610":"2026-02-19T21:02:04.994407+0000","10.20.193.68:0/3536457986":"2026-02-19T21:02:04.994407+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-18T21:02:29.445 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.444+0000 7ff087906640 1 -- 10.20.193.68:0/3402220701 >> v1:10.20.193.68:6816/2904515774 conn(0x7ff05004f790 legacy=0x7ff050051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:29.445 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.444+0000 7ff087906640 1 -- 10.20.193.68:0/3402220701 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff080135a00 msgr2=0x7ff080131f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:29.445 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.444+0000 7ff087906640 1 --2- 10.20.193.68:0/3402220701 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff080135a00 0x7ff080131f90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff07c036000 tx=0x7ff07c004b40 comp rx=0 tx=0).stop 2026-02-18T21:02:29.445 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.444+0000 7ff087906640 1 -- 10.20.193.68:0/3402220701 shutdown_connections 2026-02-18T21:02:29.445 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.444+0000 7ff087906640 1 --2- 10.20.193.68:0/3402220701 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7ff080135a00 0x7ff080131f90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.445 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.444+0000 7ff087906640 1 --2- 10.20.193.68:0/3402220701 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7ff080130da0 0x7ff080131a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.446 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.444+0000 7ff087906640 1 --2- 10.20.193.68:0/3402220701 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7ff080130180 0x7ff080131510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:29.446 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.444+0000 7ff087906640 1 -- 10.20.193.68:0/3402220701 >> 10.20.193.68:0/3402220701 conn(0x7ff0800a1e40 msgr2=0x7ff0800703d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:29.446 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.444+0000 7ff087906640 1 -- 10.20.193.68:0/3402220701 shutdown_connections 2026-02-18T21:02:29.446 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:29.444+0000 7ff087906640 1 -- 10.20.193.68:0/3402220701 wait complete. 2026-02-18T21:02:30.453 INFO:tasks.ceph:Scrubbing osd.0 2026-02-18T21:02:30.453 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-18T21:02:30.530 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.525+0000 7f4772257640 1 Processor -- start 2026-02-18T21:02:30.530 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.525+0000 7f4772257640 1 -- start start 2026-02-18T21:02:30.530 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.525+0000 7f4772257640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f476c1306c0 0x7f476c130aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:30.530 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.525+0000 7f4772257640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f476c0736d0 0x7f476c12cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:30.530 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.525+0000 7f4772257640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f476c130450 con 0x7f476c12d1a0 2026-02-18T21:02:30.530 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.525+0000 7f4772257640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f476c073250 con 0x7f476c0736d0 2026-02-18T21:02:30.530 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.525+0000 7f4772257640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f476c130fe0 con 0x7f476c1306c0 2026-02-18T21:02:30.530 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.525+0000 7f476b7fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f476c1306c0 0x7f476c130aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:30.531 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.525+0000 7f476affd640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f476c0736d0 0x7f476c12cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:30.531 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.525+0000 7f476b7fe640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f476c1306c0 0x7f476c130aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:52242/0 (socket says 10.20.193.68:52242) 2026-02-18T21:02:30.531 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.525+0000 7f476bfff640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f476c12d1a0 0x7f476c137570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:48004/0 (socket says 10.20.193.68:48004) 2026-02-18T21:02:30.531 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.525+0000 7f476b7fe640 1 -- 10.20.193.68:0/2356794687 learned_addr learned my addr 10.20.193.68:0/2356794687 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:30.531 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.526+0000 7f476a7fc640 1 -- 10.20.193.68:0/2356794687 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1412139467 0 0) 0x7f476c130450 con 0x7f476c12d1a0 2026-02-18T21:02:30.531 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.526+0000 7f476a7fc640 1 -- 10.20.193.68:0/2356794687 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4750003620 con 0x7f476c12d1a0 2026-02-18T21:02:30.531 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.526+0000 7f476affd640 1 -- 10.20.193.68:0/2356794687 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f476c1306c0 msgr2=0x7f476c130aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:30.531 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.526+0000 7f476affd640 1 --2- 10.20.193.68:0/2356794687 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f476c1306c0 0x7f476c130aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.531 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.526+0000 7f476affd640 1 -- 10.20.193.68:0/2356794687 >> v1:10.20.193.68:6789/0 conn(0x7f476c12d1a0 legacy=0x7f476c137570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.531 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.526+0000 7f476affd640 1 -- 10.20.193.68:0/2356794687 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476c073eb0 con 0x7f476c0736d0 2026-02-18T21:02:30.531 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.526+0000 7f476b7fe640 1 --2- 10.20.193.68:0/2356794687 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f476c1306c0 0x7f476c130aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:30.532 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.526+0000 7f476affd640 1 --2- 10.20.193.68:0/2356794687 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f476c0736d0 0x7f476c12cc60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f475c0098d0 tx=0x7f475c02ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d78d16f3818a68e server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:30.532 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.526+0000 7f476a7fc640 1 -- 10.20.193.68:0/2356794687 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c03c070 con 0x7f476c0736d0 2026-02-18T21:02:30.532 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.526+0000 7f476a7fc640 1 -- 10.20.193.68:0/2356794687 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f475c02fab0 con 0x7f476c0736d0 2026-02-18T21:02:30.532 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.526+0000 7f476a7fc640 1 -- 10.20.193.68:0/2356794687 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c02fe60 con 0x7f476c0736d0 2026-02-18T21:02:30.532 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.526+0000 7f4772257640 1 -- 10.20.193.68:0/2356794687 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f476c0736d0 msgr2=0x7f476c12cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.532 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.526+0000 7f4772257640 1 --2- 10.20.193.68:0/2356794687 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f476c0736d0 0x7f476c12cc60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f475c0098d0 tx=0x7f475c02ee40 comp rx=0 tx=0).stop 2026-02-18T21:02:30.532 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.526+0000 7f4772257640 1 -- 10.20.193.68:0/2356794687 shutdown_connections 2026-02-18T21:02:30.532 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.526+0000 7f4772257640 1 --2- 10.20.193.68:0/2356794687 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f476c0736d0 0x7f476c12cc60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.532 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.526+0000 7f4772257640 1 --2- 10.20.193.68:0/2356794687 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f476c1306c0 0x7f476c130aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.532 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.527+0000 7f4772257640 1 -- 10.20.193.68:0/2356794687 >> 10.20.193.68:0/2356794687 conn(0x7f476c0a1d10 msgr2=0x7f476c0a2120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:30.532 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.527+0000 7f4772257640 1 -- 10.20.193.68:0/2356794687 shutdown_connections 2026-02-18T21:02:30.532 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.527+0000 7f4772257640 1 -- 10.20.193.68:0/2356794687 wait complete. 2026-02-18T21:02:30.532 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.527+0000 7f4772257640 1 Processor -- start 2026-02-18T21:02:30.533 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.527+0000 7f4772257640 1 -- start start 2026-02-18T21:02:30.533 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.527+0000 7f4772257640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f476c0736d0 0x7f476c1341d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:30.533 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.527+0000 7f4772257640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f476c12d1a0 0x7f476c134710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:30.533 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.527+0000 7f4772257640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f476c1306c0 0x7f476c134c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:30.533 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.527+0000 7f4772257640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f476c12d9e0 con 0x7f476c0736d0 2026-02-18T21:02:30.533 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.527+0000 7f4772257640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f476c12d860 con 0x7f476c12d1a0 2026-02-18T21:02:30.533 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.527+0000 7f4772257640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f476c138c90 con 0x7f476c1306c0 2026-02-18T21:02:30.533 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.527+0000 7f476bfff640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f476c1306c0 0x7f476c134c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:30.533 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.527+0000 7f476affd640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f476c12d1a0 0x7f476c134710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:30.533 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.527+0000 7f476b7fe640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f476c0736d0 0x7f476c1341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:30.533 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.527+0000 7f476affd640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f476c12d1a0 0x7f476c134710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:39414/0 (socket says 10.20.193.68:39414) 2026-02-18T21:02:30.534 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.527+0000 7f476affd640 1 -- 10.20.193.68:0/3235224809 learned_addr learned my addr 10.20.193.68:0/3235224809 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:30.534 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.527+0000 7f476bfff640 1 -- 10.20.193.68:0/3235224809 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f476c12d1a0 msgr2=0x7f476c134710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.534 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.527+0000 7f476bfff640 1 --2- 10.20.193.68:0/3235224809 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f476c12d1a0 0x7f476c134710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.534 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.528+0000 7f476bfff640 1 -- 10.20.193.68:0/3235224809 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f476c0736d0 msgr2=0x7f476c1341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.534 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.528+0000 7f476bfff640 1 --2- 10.20.193.68:0/3235224809 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f476c0736d0 0x7f476c1341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.534 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.528+0000 7f476bfff640 1 -- 10.20.193.68:0/3235224809 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476c136e50 con 0x7f476c1306c0 2026-02-18T21:02:30.534 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.528+0000 7f476b7fe640 1 --2- 10.20.193.68:0/3235224809 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f476c0736d0 0x7f476c1341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:30.534 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.528+0000 7f476affd640 1 --2- 10.20.193.68:0/3235224809 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f476c12d1a0 0x7f476c134710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:30.534 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.528+0000 7f476bfff640 1 --2- 10.20.193.68:0/3235224809 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f476c1306c0 0x7f476c134c50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f476000cb30 tx=0x7f476000a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:30.534 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.528+0000 7f4747fff640 1 -- 10.20.193.68:0/3235224809 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476000acb0 con 0x7f476c1306c0 2026-02-18T21:02:30.534 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.528+0000 7f4747fff640 1 -- 10.20.193.68:0/3235224809 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f476000ae50 con 0x7f476c1306c0 2026-02-18T21:02:30.534 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.528+0000 7f4772257640 1 -- 10.20.193.68:0/3235224809 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f476c135d00 con 0x7f476c1306c0 2026-02-18T21:02:30.535 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.528+0000 7f4747fff640 1 -- 10.20.193.68:0/3235224809 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4760012640 con 0x7f476c1306c0 2026-02-18T21:02:30.535 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.528+0000 7f4772257640 1 -- 10.20.193.68:0/3235224809 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f476c135410 con 0x7f476c1306c0 2026-02-18T21:02:30.535 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.528+0000 7f4772257640 1 -- 10.20.193.68:0/3235224809 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f476c12cc60 con 0x7f476c1306c0 2026-02-18T21:02:30.535 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.528+0000 7f4747fff640 1 -- 10.20.193.68:0/3235224809 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f47600127e0 con 0x7f476c1306c0 2026-02-18T21:02:30.535 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.529+0000 7f4747fff640 1 -- 10.20.193.68:0/3235224809 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f4760067150 con 0x7f476c1306c0 2026-02-18T21:02:30.535 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.529+0000 7f4747fff640 1 -- 10.20.193.68:0/3235224809 --> v1:10.20.193.68:6800/2637053487 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4760017ec0 con 0x7f473c056080 2026-02-18T21:02:30.535 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.529+0000 7f4747fff640 1 -- 10.20.193.68:0/3235224809 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f476006e050 con 0x7f476c1306c0 2026-02-18T21:02:30.535 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.529+0000 7f4747fff640 1 -- 10.20.193.68:0/3235224809 <== osd.0 v1:10.20.193.68:6800/2637053487 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f4760017ec0 con 0x7f473c056080 2026-02-18T21:02:30.536 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.536+0000 7f4772257640 1 -- 10.20.193.68:0/3235224809 --> v1:10.20.193.68:6800/2637053487 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f476c1388b0 con 0x7f473c056080 2026-02-18T21:02:30.536 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.536+0000 7f4747fff640 1 -- 10.20.193.68:0/3235224809 <== osd.0 v1:10.20.193.68:6800/2637053487 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7f476c1388b0 con 0x7f473c056080 2026-02-18T21:02:30.536 INFO:teuthology.orchestra.run.trial068.stdout:{ 2026-02-18T21:02:30.536 INFO:teuthology.orchestra.run.trial068.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-18T21:02:30.537 INFO:teuthology.orchestra.run.trial068.stdout:} 2026-02-18T21:02:30.537 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.536+0000 7f4772257640 1 -- 10.20.193.68:0/3235224809 >> v1:10.20.193.68:6800/2637053487 conn(0x7f473c056080 legacy=0x7f473c0584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.538 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.536+0000 7f4772257640 1 -- 10.20.193.68:0/3235224809 >> v1:10.20.193.68:6816/2904515774 conn(0x7f473c04f790 legacy=0x7f473c051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.538 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.536+0000 7f4772257640 1 -- 10.20.193.68:0/3235224809 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f476c1306c0 msgr2=0x7f476c134c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.538 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.536+0000 7f4772257640 1 --2- 10.20.193.68:0/3235224809 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f476c1306c0 0x7f476c134c50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f476000cb30 tx=0x7f476000a060 comp rx=0 tx=0).stop 2026-02-18T21:02:30.538 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.536+0000 7f476bfff640 1 -- 10.20.193.68:0/3235224809 reap_dead start 2026-02-18T21:02:30.538 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.536+0000 7f4772257640 1 -- 10.20.193.68:0/3235224809 shutdown_connections 2026-02-18T21:02:30.538 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.536+0000 7f4772257640 1 -- 10.20.193.68:0/3235224809 >> 10.20.193.68:0/3235224809 conn(0x7f476c0a1d10 msgr2=0x7f476c12b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:30.538 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.536+0000 7f4772257640 1 -- 10.20.193.68:0/3235224809 shutdown_connections 2026-02-18T21:02:30.538 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.536+0000 7f4772257640 1 -- 10.20.193.68:0/3235224809 wait complete. 2026-02-18T21:02:30.542 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-18T21:02:30.614 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.609+0000 7f03ffae4640 1 Processor -- start 2026-02-18T21:02:30.614 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.609+0000 7f03ffae4640 1 -- start start 2026-02-18T21:02:30.614 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.609+0000 7f03ffae4640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f03f812ac90 0x7f03f812b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:30.614 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.609+0000 7f03ffae4640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f03f8073680 0x7f03f8071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:30.614 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.609+0000 7f03ffae4640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03f812a7b0 con 0x7f03f8071960 2026-02-18T21:02:30.614 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.609+0000 7f03ffae4640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f03f8073e60 con 0x7f03f812ac90 2026-02-18T21:02:30.615 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.609+0000 7f03ffae4640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f03f8072d10 con 0x7f03f8073680 2026-02-18T21:02:30.615 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.609+0000 7f03fd859640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f03f812ac90 0x7f03f812b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:30.615 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.609+0000 7f03fd859640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f03f812ac90 0x7f03f812b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:43046/0 (socket says 10.20.193.68:43046) 2026-02-18T21:02:30.615 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.609+0000 7f03fd859640 1 -- 10.20.193.68:0/113351595 learned_addr learned my addr 10.20.193.68:0/113351595 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:30.615 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.609+0000 7f03fd058640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f03f8073680 0x7f03f8071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:30.615 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.609+0000 7f03fe05a640 1 --1- 10.20.193.68:0/113351595 >> v1:10.20.193.68:6789/0 conn(0x7f03f8071960 0x7f03f8135060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:48012/0 (socket says 10.20.193.68:48012) 2026-02-18T21:02:30.615 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.609+0000 7f03fd859640 1 -- 10.20.193.68:0/113351595 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f03f8073680 msgr2=0x7f03f8071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:30.615 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.609+0000 7f03fd859640 1 --2- 10.20.193.68:0/113351595 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f03f8073680 0x7f03f8071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.615 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.609+0000 7f03fd859640 1 -- 10.20.193.68:0/113351595 >> v1:10.20.193.68:6789/0 conn(0x7f03f8071960 legacy=0x7f03f8135060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.615 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.609+0000 7f03fd859640 1 -- 10.20.193.68:0/113351595 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f812b5b0 con 0x7f03f812ac90 2026-02-18T21:02:30.615 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.610+0000 7f03fd859640 1 --2- 10.20.193.68:0/113351595 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f03f812ac90 0x7f03f812b070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009970 tx=0x7f03e802ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56f9da7aff3a3ed server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:30.616 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.610+0000 7f03fc857640 1 -- 10.20.193.68:0/113351595 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e803c070 con 0x7f03f812ac90 2026-02-18T21:02:30.616 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.610+0000 7f03fc857640 1 -- 10.20.193.68:0/113351595 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03e802fb10 con 0x7f03f812ac90 2026-02-18T21:02:30.616 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.610+0000 7f03fc857640 1 -- 10.20.193.68:0/113351595 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03e8037440 con 0x7f03f812ac90 2026-02-18T21:02:30.616 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.610+0000 7f03ffae4640 1 -- 10.20.193.68:0/113351595 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f03f812ac90 msgr2=0x7f03f812b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.616 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.610+0000 7f03ffae4640 1 --2- 10.20.193.68:0/113351595 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f03f812ac90 0x7f03f812b070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009970 tx=0x7f03e802ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:30.616 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.610+0000 7f03ffae4640 1 -- 10.20.193.68:0/113351595 shutdown_connections 2026-02-18T21:02:30.616 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.610+0000 7f03ffae4640 1 --2- 10.20.193.68:0/113351595 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f03f8073680 0x7f03f8071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.616 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.610+0000 7f03ffae4640 1 --2- 10.20.193.68:0/113351595 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f03f812ac90 0x7f03f812b070 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.616 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.610+0000 7f03ffae4640 1 -- 10.20.193.68:0/113351595 >> 10.20.193.68:0/113351595 conn(0x7f03f809cea0 msgr2=0x7f03f809d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:30.616 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.610+0000 7f03ffae4640 1 -- 10.20.193.68:0/113351595 shutdown_connections 2026-02-18T21:02:30.616 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.610+0000 7f03ffae4640 1 -- 10.20.193.68:0/113351595 wait complete. 2026-02-18T21:02:30.617 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03ffae4640 1 Processor -- start 2026-02-18T21:02:30.617 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03ffae4640 1 -- start start 2026-02-18T21:02:30.617 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03ffae4640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f03f8071960 0x7f03f8131850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:30.617 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03ffae4640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f03f8073680 0x7f03f8131d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:30.617 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03ffae4640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f03f812ac90 0x7f03f81322d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:30.617 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03ffae4640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f03f8072180 con 0x7f03f812ac90 2026-02-18T21:02:30.617 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03ffae4640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f03f8072000 con 0x7f03f8073680 2026-02-18T21:02:30.617 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03ffae4640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f03f8136780 con 0x7f03f8071960 2026-02-18T21:02:30.617 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03fd058640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f03f8073680 0x7f03f8131d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:30.617 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03fd058640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f03f8073680 0x7f03f8131d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:39430/0 (socket says 10.20.193.68:39430) 2026-02-18T21:02:30.617 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03fe05a640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f03f812ac90 0x7f03f81322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:30.617 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03fd058640 1 -- 10.20.193.68:0/1992143251 learned_addr learned my addr 10.20.193.68:0/1992143251 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:30.618 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03fd859640 1 --2- 10.20.193.68:0/1992143251 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f03f8071960 0x7f03f8131850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:30.618 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03fd058640 1 -- 10.20.193.68:0/1992143251 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f03f8071960 msgr2=0x7f03f8131850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.618 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03fd058640 1 --2- 10.20.193.68:0/1992143251 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f03f8071960 0x7f03f8131850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.618 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03fd058640 1 -- 10.20.193.68:0/1992143251 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f03f812ac90 msgr2=0x7f03f81322d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.618 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03fd058640 1 --2- 10.20.193.68:0/1992143251 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f03f812ac90 0x7f03f81322d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.618 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03fd058640 1 -- 10.20.193.68:0/1992143251 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f81342c0 con 0x7f03f8073680 2026-02-18T21:02:30.618 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03fd058640 1 --2- 10.20.193.68:0/1992143251 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f03f8073680 0x7f03f8131d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00e890 tx=0x7f03ec00ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:30.618 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03e67fc640 1 -- 10.20.193.68:0/1992143251 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec017070 con 0x7f03f8073680 2026-02-18T21:02:30.618 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03e67fc640 1 -- 10.20.193.68:0/1992143251 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03ec00c940 con 0x7f03f8073680 2026-02-18T21:02:30.618 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03ffae4640 1 -- 10.20.193.68:0/1992143251 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03f8133100 con 0x7f03f8073680 2026-02-18T21:02:30.619 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03e67fc640 1 -- 10.20.193.68:0/1992143251 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec00cd30 con 0x7f03f8073680 2026-02-18T21:02:30.619 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.611+0000 7f03ffae4640 1 -- 10.20.193.68:0/1992143251 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f03f8132810 con 0x7f03f8073680 2026-02-18T21:02:30.619 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.612+0000 7f03ffae4640 1 -- 10.20.193.68:0/1992143251 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03f8071420 con 0x7f03f8073680 2026-02-18T21:02:30.619 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.612+0000 7f03e67fc640 1 -- 10.20.193.68:0/1992143251 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f03ec024060 con 0x7f03f8073680 2026-02-18T21:02:30.619 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.612+0000 7f03e67fc640 1 -- 10.20.193.68:0/1992143251 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f03ec066b20 con 0x7f03f8073680 2026-02-18T21:02:30.620 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.614+0000 7f03e67fc640 1 -- 10.20.193.68:0/1992143251 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f03ec040870 con 0x7f03f8073680 2026-02-18T21:02:30.685 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.684+0000 7f03ffae4640 1 -- 10.20.193.68:0/1992143251 --> v1:10.20.193.68:6816/2904515774 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f03f8069ef0 con 0x7f03c804f790 2026-02-18T21:02:30.685 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.685+0000 7f03e67fc640 1 -- 10.20.193.68:0/1992143251 <== mgr.14114 v1:10.20.193.68:6816/2904515774 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7f03f8069ef0 con 0x7f03c804f790 2026-02-18T21:02:30.685 INFO:teuthology.orchestra.run.trial068.stderr:instructed osd(s) 0 to deep-scrub 2026-02-18T21:02:30.686 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.685+0000 7f03ffae4640 1 -- 10.20.193.68:0/1992143251 >> v1:10.20.193.68:6816/2904515774 conn(0x7f03c804f790 legacy=0x7f03c8051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.686 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.685+0000 7f03ffae4640 1 -- 10.20.193.68:0/1992143251 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f03f8073680 msgr2=0x7f03f8131d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.687 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.685+0000 7f03ffae4640 1 --2- 10.20.193.68:0/1992143251 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f03f8073680 0x7f03f8131d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f03ec00e890 tx=0x7f03ec00ed60 comp rx=0 tx=0).stop 2026-02-18T21:02:30.687 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.685+0000 7f03ffae4640 1 -- 10.20.193.68:0/1992143251 shutdown_connections 2026-02-18T21:02:30.687 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.685+0000 7f03ffae4640 1 --2- 10.20.193.68:0/1992143251 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f03f812ac90 0x7f03f81322d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.687 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.685+0000 7f03ffae4640 1 --2- 10.20.193.68:0/1992143251 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f03f8073680 0x7f03f8131d90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.687 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.685+0000 7f03ffae4640 1 --2- 10.20.193.68:0/1992143251 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f03f8071960 0x7f03f8131850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.687 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.685+0000 7f03ffae4640 1 -- 10.20.193.68:0/1992143251 >> 10.20.193.68:0/1992143251 conn(0x7f03f809cea0 msgr2=0x7f03f8127c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:30.687 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.686+0000 7f03ffae4640 1 -- 10.20.193.68:0/1992143251 shutdown_connections 2026-02-18T21:02:30.687 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.686+0000 7f03ffae4640 1 -- 10.20.193.68:0/1992143251 wait complete. 2026-02-18T21:02:30.693 INFO:tasks.ceph:Scrubbing osd.1 2026-02-18T21:02:30.694 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-18T21:02:30.770 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.764+0000 7f9b485f2640 1 Processor -- start 2026-02-18T21:02:30.770 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.764+0000 7f9b485f2640 1 -- start start 2026-02-18T21:02:30.770 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.765+0000 7f9b485f2640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9b4012e360 0x7f9b4012e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:30.770 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.765+0000 7f9b485f2640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9b40071af0 0x7f9b4013ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:30.770 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.765+0000 7f9b485f2640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b40073a60 con 0x7f9b40072bd0 2026-02-18T21:02:30.770 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.765+0000 7f9b485f2640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f9b40074020 con 0x7f9b4012e360 2026-02-18T21:02:30.771 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.765+0000 7f9b485f2640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f9b4009e2e0 con 0x7f9b40071af0 2026-02-18T21:02:30.771 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.765+0000 7f9b46367640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9b4012e360 0x7f9b4012e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:30.771 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.765+0000 7f9b45b66640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f9b40072bd0 0x7f9b400713e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:48026/0 (socket says 10.20.193.68:48026) 2026-02-18T21:02:30.771 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.765+0000 7f9b45b66640 1 -- 10.20.193.68:0/3774306433 learned_addr learned my addr 10.20.193.68:0/3774306433 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:30.771 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.765+0000 7f9b46b68640 1 --2- 10.20.193.68:0/3774306433 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9b40071af0 0x7f9b4013ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:30.771 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.765+0000 7f9b45365640 1 -- 10.20.193.68:0/3774306433 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2186602219 0 0) 0x7f9b40073a60 con 0x7f9b40072bd0 2026-02-18T21:02:30.771 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.765+0000 7f9b45365640 1 -- 10.20.193.68:0/3774306433 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b28003620 con 0x7f9b40072bd0 2026-02-18T21:02:30.771 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.765+0000 7f9b46367640 1 -- 10.20.193.68:0/3774306433 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9b40071af0 msgr2=0x7f9b4013ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:30.771 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.765+0000 7f9b46367640 1 --2- 10.20.193.68:0/3774306433 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9b40071af0 0x7f9b4013ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.772 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.765+0000 7f9b46367640 1 -- 10.20.193.68:0/3774306433 >> v1:10.20.193.68:6789/0 conn(0x7f9b40072bd0 legacy=0x7f9b400713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.772 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.765+0000 7f9b46367640 1 -- 10.20.193.68:0/3774306433 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b400742c0 con 0x7f9b4012e360 2026-02-18T21:02:30.772 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.765+0000 7f9b46b68640 1 --2- 10.20.193.68:0/3774306433 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9b40071af0 0x7f9b4013ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:30.772 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.765+0000 7f9b46367640 1 --2- 10.20.193.68:0/3774306433 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9b4012e360 0x7f9b4012e740 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9b300098d0 tx=0x7f9b3002ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7a0b28dcfd51098 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:30.772 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.766+0000 7f9b45365640 1 -- 10.20.193.68:0/3774306433 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3003c070 con 0x7f9b4012e360 2026-02-18T21:02:30.772 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.766+0000 7f9b45365640 1 -- 10.20.193.68:0/3774306433 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b3002fab0 con 0x7f9b4012e360 2026-02-18T21:02:30.772 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.766+0000 7f9b45365640 1 -- 10.20.193.68:0/3774306433 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3002fe60 con 0x7f9b4012e360 2026-02-18T21:02:30.772 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.766+0000 7f9b485f2640 1 -- 10.20.193.68:0/3774306433 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9b4012e360 msgr2=0x7f9b4012e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.772 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.766+0000 7f9b485f2640 1 --2- 10.20.193.68:0/3774306433 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9b4012e360 0x7f9b4012e740 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9b300098d0 tx=0x7f9b3002ee80 comp rx=0 tx=0).stop 2026-02-18T21:02:30.772 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.766+0000 7f9b485f2640 1 -- 10.20.193.68:0/3774306433 shutdown_connections 2026-02-18T21:02:30.772 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.766+0000 7f9b485f2640 1 --2- 10.20.193.68:0/3774306433 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9b40071af0 0x7f9b4013ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.766+0000 7f9b485f2640 1 --2- 10.20.193.68:0/3774306433 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9b4012e360 0x7f9b4012e740 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.766+0000 7f9b485f2640 1 -- 10.20.193.68:0/3774306433 >> 10.20.193.68:0/3774306433 conn(0x7f9b4009d020 msgr2=0x7f9b4009d430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:30.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.766+0000 7f9b485f2640 1 -- 10.20.193.68:0/3774306433 shutdown_connections 2026-02-18T21:02:30.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.766+0000 7f9b485f2640 1 -- 10.20.193.68:0/3774306433 wait complete. 2026-02-18T21:02:30.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.766+0000 7f9b485f2640 1 Processor -- start 2026-02-18T21:02:30.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.766+0000 7f9b485f2640 1 -- start start 2026-02-18T21:02:30.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b485f2640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9b40071af0 0x7f9b40125f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:30.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b485f2640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9b40072bd0 0x7f9b401264d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:30.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b485f2640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9b4012e360 0x7f9b40126a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:30.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b485f2640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f9b40072100 con 0x7f9b4012e360 2026-02-18T21:02:30.773 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b485f2640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f9b40071f80 con 0x7f9b40072bd0 2026-02-18T21:02:30.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b485f2640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f9b4013cf60 con 0x7f9b40071af0 2026-02-18T21:02:30.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b46367640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9b40071af0 0x7f9b40125f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:30.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b46367640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9b40071af0 0x7f9b40125f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:52276/0 (socket says 10.20.193.68:52276) 2026-02-18T21:02:30.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b45b66640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9b40072bd0 0x7f9b401264d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:30.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b46367640 1 -- 10.20.193.68:0/2320386874 learned_addr learned my addr 10.20.193.68:0/2320386874 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:30.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b46b68640 1 --2- 10.20.193.68:0/2320386874 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9b4012e360 0x7f9b40126a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:30.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b46367640 1 -- 10.20.193.68:0/2320386874 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9b40072bd0 msgr2=0x7f9b401264d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b46367640 1 --2- 10.20.193.68:0/2320386874 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9b40072bd0 0x7f9b401264d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b46367640 1 -- 10.20.193.68:0/2320386874 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9b4012e360 msgr2=0x7f9b40126a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.774 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b46367640 1 --2- 10.20.193.68:0/2320386874 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9b4012e360 0x7f9b40126a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b46367640 1 -- 10.20.193.68:0/2320386874 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4012f020 con 0x7f9b40071af0 2026-02-18T21:02:30.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b46367640 1 --2- 10.20.193.68:0/2320386874 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9b40071af0 0x7f9b40125f90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9b3003a040 tx=0x7f9b300047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:30.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b26ffd640 1 -- 10.20.193.68:0/2320386874 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3003c040 con 0x7f9b40071af0 2026-02-18T21:02:30.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b26ffd640 1 -- 10.20.193.68:0/2320386874 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b30004030 con 0x7f9b40071af0 2026-02-18T21:02:30.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b485f2640 1 -- 10.20.193.68:0/2320386874 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b401271d0 con 0x7f9b40071af0 2026-02-18T21:02:30.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b26ffd640 1 -- 10.20.193.68:0/2320386874 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b30004420 con 0x7f9b40071af0 2026-02-18T21:02:30.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.767+0000 7f9b485f2640 1 -- 10.20.193.68:0/2320386874 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b4013c9b0 con 0x7f9b40071af0 2026-02-18T21:02:30.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.768+0000 7f9b485f2640 1 -- 10.20.193.68:0/2320386874 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9b40127a40 con 0x7f9b40071af0 2026-02-18T21:02:30.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.768+0000 7f9b26ffd640 1 -- 10.20.193.68:0/2320386874 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f9b30053060 con 0x7f9b40071af0 2026-02-18T21:02:30.775 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.768+0000 7f9b26ffd640 1 -- 10.20.193.68:0/2320386874 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f9b3008bff0 con 0x7f9b40071af0 2026-02-18T21:02:30.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.768+0000 7f9b26ffd640 1 -- 10.20.193.68:0/2320386874 --> v1:10.20.193.68:6804/4160428224 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b30044e70 con 0x7f9b100560b0 2026-02-18T21:02:30.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.768+0000 7f9b26ffd640 1 -- 10.20.193.68:0/2320386874 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9b3008e610 con 0x7f9b40071af0 2026-02-18T21:02:30.776 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.769+0000 7f9b26ffd640 1 -- 10.20.193.68:0/2320386874 <== osd.1 v1:10.20.193.68:6804/4160428224 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f9b30044e70 con 0x7f9b100560b0 2026-02-18T21:02:30.777 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.775+0000 7f9b485f2640 1 -- 10.20.193.68:0/2320386874 --> v1:10.20.193.68:6804/4160428224 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9b4013cc40 con 0x7f9b100560b0 2026-02-18T21:02:30.777 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.775+0000 7f9b26ffd640 1 -- 10.20.193.68:0/2320386874 <== osd.1 v1:10.20.193.68:6804/4160428224 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7f9b4013cc40 con 0x7f9b100560b0 2026-02-18T21:02:30.777 INFO:teuthology.orchestra.run.trial068.stdout:{ 2026-02-18T21:02:30.777 INFO:teuthology.orchestra.run.trial068.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-18T21:02:30.777 INFO:teuthology.orchestra.run.trial068.stdout:} 2026-02-18T21:02:30.779 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.775+0000 7f9b485f2640 1 -- 10.20.193.68:0/2320386874 >> v1:10.20.193.68:6804/4160428224 conn(0x7f9b100560b0 legacy=0x7f9b100584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.779 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.775+0000 7f9b485f2640 1 -- 10.20.193.68:0/2320386874 >> v1:10.20.193.68:6816/2904515774 conn(0x7f9b1004f7c0 legacy=0x7f9b10051c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.779 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.775+0000 7f9b485f2640 1 -- 10.20.193.68:0/2320386874 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9b40071af0 msgr2=0x7f9b40125f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.779 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.775+0000 7f9b485f2640 1 --2- 10.20.193.68:0/2320386874 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9b40071af0 0x7f9b40125f90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9b3003a040 tx=0x7f9b300047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.779 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.775+0000 7f9b46b68640 1 -- 10.20.193.68:0/2320386874 reap_dead start 2026-02-18T21:02:30.779 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.775+0000 7f9b485f2640 1 -- 10.20.193.68:0/2320386874 shutdown_connections 2026-02-18T21:02:30.779 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.775+0000 7f9b485f2640 1 -- 10.20.193.68:0/2320386874 >> 10.20.193.68:0/2320386874 conn(0x7f9b4009d020 msgr2=0x7f9b40130bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:30.780 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.775+0000 7f9b485f2640 1 -- 10.20.193.68:0/2320386874 shutdown_connections 2026-02-18T21:02:30.780 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.775+0000 7f9b485f2640 1 -- 10.20.193.68:0/2320386874 wait complete. 2026-02-18T21:02:30.781 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-18T21:02:30.853 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.848+0000 7fabde074640 1 Processor -- start 2026-02-18T21:02:30.853 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.848+0000 7fabde074640 1 -- start start 2026-02-18T21:02:30.853 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.849+0000 7fabde074640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fabd8071420 0x7fabd81354d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:30.853 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.849+0000 7fabde074640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fabd81156a0 0x7fabd8137a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:30.853 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.849+0000 7fabde074640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabd809e050 con 0x7fabd8114bb0 2026-02-18T21:02:30.854 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.849+0000 7fabde074640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7fabd8116910 con 0x7fabd8071420 2026-02-18T21:02:30.854 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.849+0000 7fabde074640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fabd8116090 con 0x7fabd81156a0 2026-02-18T21:02:30.854 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.849+0000 7fabd77fe640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fabd8114bb0 0x7fabd8114f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:48034/0 (socket says 10.20.193.68:48034) 2026-02-18T21:02:30.854 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.849+0000 7fabd77fe640 1 -- 10.20.193.68:0/516383940 learned_addr learned my addr 10.20.193.68:0/516383940 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:30.854 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.849+0000 7fabd6ffd640 1 --2- 10.20.193.68:0/516383940 >> v2:10.20.193.68:3300/0 conn(0x7fabd8071420 0x7fabd81354d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:30.854 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.849+0000 7fabd7fff640 1 --2- 10.20.193.68:0/516383940 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fabd81156a0 0x7fabd8137a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:30.854 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.849+0000 7fabd67fc640 1 -- 10.20.193.68:0/516383940 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1728191824 0 0) 0x7fabd809e050 con 0x7fabd8114bb0 2026-02-18T21:02:30.854 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.849+0000 7fabd6ffd640 1 -- 10.20.193.68:0/516383940 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fabd81156a0 msgr2=0x7fabd8137a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:30.854 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.849+0000 7fabd6ffd640 1 --2- 10.20.193.68:0/516383940 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fabd81156a0 0x7fabd8137a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.854 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.849+0000 7fabd6ffd640 1 -- 10.20.193.68:0/516383940 >> v1:10.20.193.68:6789/0 conn(0x7fabd8114bb0 legacy=0x7fabd8114f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.854 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.849+0000 7fabd6ffd640 1 -- 10.20.193.68:0/516383940 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd81164d0 con 0x7fabd8071420 2026-02-18T21:02:30.855 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.849+0000 7fabd6ffd640 1 --2- 10.20.193.68:0/516383940 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fabd8071420 0x7fabd81354d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fabc80098a0 tx=0x7fabc802ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c773bef5e2392a4 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:30.855 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.849+0000 7fabd67fc640 1 -- 10.20.193.68:0/516383940 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc803c070 con 0x7fabd8071420 2026-02-18T21:02:30.855 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.849+0000 7fabd67fc640 1 -- 10.20.193.68:0/516383940 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc802fa40 con 0x7fabd8071420 2026-02-18T21:02:30.855 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.849+0000 7fabd67fc640 1 -- 10.20.193.68:0/516383940 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc802fe10 con 0x7fabd8071420 2026-02-18T21:02:30.855 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.850+0000 7fabde074640 1 -- 10.20.193.68:0/516383940 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fabd8071420 msgr2=0x7fabd81354d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.855 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.850+0000 7fabde074640 1 --2- 10.20.193.68:0/516383940 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fabd8071420 0x7fabd81354d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fabc80098a0 tx=0x7fabc802ed80 comp rx=0 tx=0).stop 2026-02-18T21:02:30.855 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.850+0000 7fabde074640 1 -- 10.20.193.68:0/516383940 shutdown_connections 2026-02-18T21:02:30.855 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.850+0000 7fabde074640 1 --2- 10.20.193.68:0/516383940 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fabd81156a0 0x7fabd8137a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.855 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.850+0000 7fabde074640 1 --2- 10.20.193.68:0/516383940 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fabd8071420 0x7fabd81354d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.855 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.850+0000 7fabde074640 1 -- 10.20.193.68:0/516383940 >> 10.20.193.68:0/516383940 conn(0x7fabd809cea0 msgr2=0x7fabd809d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:30.855 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.850+0000 7fabde074640 1 -- 10.20.193.68:0/516383940 shutdown_connections 2026-02-18T21:02:30.855 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.850+0000 7fabde074640 1 -- 10.20.193.68:0/516383940 wait complete. 2026-02-18T21:02:30.856 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.850+0000 7fabde074640 1 Processor -- start 2026-02-18T21:02:30.856 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.850+0000 7fabde074640 1 -- start start 2026-02-18T21:02:30.856 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.850+0000 7fabde074640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fabd8071420 0x7fabd811c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:30.856 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabde074640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fabd8114bb0 0x7fabd811ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:30.856 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabde074640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fabd81156a0 0x7fabd811d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:30.856 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabde074640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fabd81382f0 con 0x7fabd8071420 2026-02-18T21:02:30.856 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabde074640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fabd8138170 con 0x7fabd81156a0 2026-02-18T21:02:30.856 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabde074640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fabd8138470 con 0x7fabd8114bb0 2026-02-18T21:02:30.856 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabd77fe640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fabd8071420 0x7fabd811c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:30.856 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabd77fe640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fabd8071420 0x7fabd811c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:43076/0 (socket says 10.20.193.68:43076) 2026-02-18T21:02:30.856 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabd77fe640 1 -- 10.20.193.68:0/1822848678 learned_addr learned my addr 10.20.193.68:0/1822848678 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:30.856 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabd7fff640 1 --2- 10.20.193.68:0/1822848678 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fabd81156a0 0x7fabd811d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:30.857 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabd6ffd640 1 --2- 10.20.193.68:0/1822848678 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fabd8114bb0 0x7fabd811ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:30.857 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabd77fe640 1 -- 10.20.193.68:0/1822848678 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fabd8114bb0 msgr2=0x7fabd811ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.857 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabd77fe640 1 --2- 10.20.193.68:0/1822848678 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fabd8114bb0 0x7fabd811ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.857 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabd77fe640 1 -- 10.20.193.68:0/1822848678 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fabd81156a0 msgr2=0x7fabd811d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.857 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabd77fe640 1 --2- 10.20.193.68:0/1822848678 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fabd81156a0 0x7fabd811d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.857 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabd77fe640 1 -- 10.20.193.68:0/1822848678 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd811e240 con 0x7fabd8071420 2026-02-18T21:02:30.857 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabd7fff640 1 --2- 10.20.193.68:0/1822848678 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fabd81156a0 0x7fabd811d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:30.857 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabd77fe640 1 --2- 10.20.193.68:0/1822848678 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fabd8071420 0x7fabd811c940 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fabc400c730 tx=0x7fabc400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:30.857 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabb3fff640 1 -- 10.20.193.68:0/1822848678 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc4018070 con 0x7fabd8071420 2026-02-18T21:02:30.857 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabb3fff640 1 -- 10.20.193.68:0/1822848678 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabc4004ae0 con 0x7fabd8071420 2026-02-18T21:02:30.857 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabb3fff640 1 -- 10.20.193.68:0/1822848678 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc40070d0 con 0x7fabd8071420 2026-02-18T21:02:30.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabde074640 1 -- 10.20.193.68:0/1822848678 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd811d900 con 0x7fabd8071420 2026-02-18T21:02:30.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.851+0000 7fabde074640 1 -- 10.20.193.68:0/1822848678 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabd811f570 con 0x7fabd8071420 2026-02-18T21:02:30.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.852+0000 7fabde074640 1 -- 10.20.193.68:0/1822848678 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabd8114f90 con 0x7fabd8071420 2026-02-18T21:02:30.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.852+0000 7fabb3fff640 1 -- 10.20.193.68:0/1822848678 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fabc4007270 con 0x7fabd8071420 2026-02-18T21:02:30.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.852+0000 7fabb3fff640 1 -- 10.20.193.68:0/1822848678 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7fabc4065e70 con 0x7fabd8071420 2026-02-18T21:02:30.858 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.854+0000 7fabb3fff640 1 -- 10.20.193.68:0/1822848678 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fabc403fc60 con 0x7fabd8071420 2026-02-18T21:02:30.925 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.925+0000 7fabde074640 1 -- 10.20.193.68:0/1822848678 --> v1:10.20.193.68:6816/2904515774 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fabd8069ef0 con 0x7faba804f790 2026-02-18T21:02:30.925 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.925+0000 7fabb3fff640 1 -- 10.20.193.68:0/1822848678 <== mgr.14114 v1:10.20.193.68:6816/2904515774 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7fabd8069ef0 con 0x7faba804f790 2026-02-18T21:02:30.926 INFO:teuthology.orchestra.run.trial068.stderr:instructed osd(s) 1 to deep-scrub 2026-02-18T21:02:30.927 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.926+0000 7fabde074640 1 -- 10.20.193.68:0/1822848678 >> v1:10.20.193.68:6816/2904515774 conn(0x7faba804f790 legacy=0x7faba8051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.927 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.926+0000 7fabde074640 1 -- 10.20.193.68:0/1822848678 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fabd8071420 msgr2=0x7fabd811c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:30.927 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.926+0000 7fabde074640 1 --2- 10.20.193.68:0/1822848678 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fabd8071420 0x7fabd811c940 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fabc400c730 tx=0x7fabc400cc00 comp rx=0 tx=0).stop 2026-02-18T21:02:30.928 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.926+0000 7fabde074640 1 -- 10.20.193.68:0/1822848678 shutdown_connections 2026-02-18T21:02:30.928 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.926+0000 7fabde074640 1 --2- 10.20.193.68:0/1822848678 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fabd81156a0 0x7fabd811d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.928 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.926+0000 7fabde074640 1 --2- 10.20.193.68:0/1822848678 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fabd8114bb0 0x7fabd811ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.928 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.926+0000 7fabde074640 1 --2- 10.20.193.68:0/1822848678 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fabd8071420 0x7fabd811c940 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:30.928 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.926+0000 7fabde074640 1 -- 10.20.193.68:0/1822848678 >> 10.20.193.68:0/1822848678 conn(0x7fabd809cea0 msgr2=0x7fabd812f050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:30.928 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.926+0000 7fabde074640 1 -- 10.20.193.68:0/1822848678 shutdown_connections 2026-02-18T21:02:30.928 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:30.926+0000 7fabde074640 1 -- 10.20.193.68:0/1822848678 wait complete. 2026-02-18T21:02:30.934 INFO:tasks.ceph:Scrubbing osd.2 2026-02-18T21:02:30.934 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-18T21:02:31.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.003+0000 7fa260655640 1 Processor -- start 2026-02-18T21:02:31.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.003+0000 7fa260655640 1 -- start start 2026-02-18T21:02:31.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.003+0000 7fa260655640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fa25812e360 0x7fa25812e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.003+0000 7fa260655640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa258072bd0 0x7fa2580713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.003+0000 7fa260655640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa258071920 0x7fa258071db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.003 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.003+0000 7fa260655640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7fa258074020 con 0x7fa25812e360 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.003+0000 7fa260655640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fa258073a60 con 0x7fa258072bd0 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.003+0000 7fa260655640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fa25809e2e0 con 0x7fa258071920 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.003+0000 7fa25e3ca640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fa25812e360 0x7fa25812e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.003+0000 7fa25e3ca640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fa25812e360 0x7fa25812e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:43078/0 (socket says 10.20.193.68:43078) 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.003+0000 7fa25e3ca640 1 -- 10.20.193.68:0/1741255527 learned_addr learned my addr 10.20.193.68:0/1741255527 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.003+0000 7fa25dbc9640 1 --2- 10.20.193.68:0/1741255527 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa258072bd0 0x7fa2580713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.003+0000 7fa25ebcb640 1 --2- 10.20.193.68:0/1741255527 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa258071920 0x7fa258071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.003+0000 7fa25e3ca640 1 -- 10.20.193.68:0/1741255527 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa258071920 msgr2=0x7fa258071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.003+0000 7fa25e3ca640 1 --2- 10.20.193.68:0/1741255527 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa258071920 0x7fa258071db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.003+0000 7fa25e3ca640 1 -- 10.20.193.68:0/1741255527 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa258072bd0 msgr2=0x7fa2580713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.003+0000 7fa25e3ca640 1 --2- 10.20.193.68:0/1741255527 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa258072bd0 0x7fa2580713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.003+0000 7fa25e3ca640 1 -- 10.20.193.68:0/1741255527 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2580742c0 con 0x7fa25812e360 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.004+0000 7fa25e3ca640 1 --2- 10.20.193.68:0/1741255527 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa25812e360 0x7fa25812e740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa2480099a0 tx=0x7fa24802ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4fbd767d02d3a2 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.004+0000 7fa25d3c8640 1 -- 10.20.193.68:0/1741255527 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24803c070 con 0x7fa25812e360 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.004+0000 7fa25d3c8640 1 -- 10.20.193.68:0/1741255527 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa24802fb80 con 0x7fa25812e360 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.004+0000 7fa25d3c8640 1 -- 10.20.193.68:0/1741255527 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa248037440 con 0x7fa25812e360 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.004+0000 7fa260655640 1 -- 10.20.193.68:0/1741255527 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa25812e360 msgr2=0x7fa25812e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.004+0000 7fa260655640 1 --2- 10.20.193.68:0/1741255527 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa25812e360 0x7fa25812e740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa2480099a0 tx=0x7fa24802ef50 comp rx=0 tx=0).stop 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.004+0000 7fa260655640 1 -- 10.20.193.68:0/1741255527 shutdown_connections 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.004+0000 7fa260655640 1 --2- 10.20.193.68:0/1741255527 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa258072bd0 0x7fa2580713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.004 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.004+0000 7fa260655640 1 --2- 10.20.193.68:0/1741255527 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa258071920 0x7fa258071db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.004+0000 7fa260655640 1 --2- 10.20.193.68:0/1741255527 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa25812e360 0x7fa25812e740 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.004+0000 7fa260655640 1 -- 10.20.193.68:0/1741255527 >> 10.20.193.68:0/1741255527 conn(0x7fa25809d020 msgr2=0x7fa25809d430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:31.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.004+0000 7fa260655640 1 -- 10.20.193.68:0/1741255527 shutdown_connections 2026-02-18T21:02:31.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.004+0000 7fa260655640 1 -- 10.20.193.68:0/1741255527 wait complete. 2026-02-18T21:02:31.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.005+0000 7fa260655640 1 Processor -- start 2026-02-18T21:02:31.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.005+0000 7fa260655640 1 -- start start 2026-02-18T21:02:31.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.005+0000 7fa260655640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa258071920 0x7fa2581cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.005+0000 7fa260655640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa258072bd0 0x7fa2581cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.005+0000 7fa260655640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa25812e360 0x7fa2581cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.005+0000 7fa260655640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fa25813bb90 con 0x7fa258072bd0 2026-02-18T21:02:31.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.005+0000 7fa260655640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fa25813ba10 con 0x7fa258071920 2026-02-18T21:02:31.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.005+0000 7fa260655640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fa25813bd10 con 0x7fa25812e360 2026-02-18T21:02:31.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.005+0000 7fa25dbc9640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa258072bd0 0x7fa2581cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.005 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.005+0000 7fa25e3ca640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa258071920 0x7fa2581cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.005+0000 7fa25dbc9640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa258072bd0 0x7fa2581cc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:43086/0 (socket says 10.20.193.68:43086) 2026-02-18T21:02:31.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.005+0000 7fa25ebcb640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa25812e360 0x7fa2581cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.005+0000 7fa25dbc9640 1 -- 10.20.193.68:0/2129244504 learned_addr learned my addr 10.20.193.68:0/2129244504 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:31.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.005+0000 7fa25e3ca640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa258071920 0x7fa2581cbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:39484/0 (socket says 10.20.193.68:39484) 2026-02-18T21:02:31.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.006+0000 7fa25dbc9640 1 -- 10.20.193.68:0/2129244504 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa25812e360 msgr2=0x7fa2581cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.006+0000 7fa25dbc9640 1 --2- 10.20.193.68:0/2129244504 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa25812e360 0x7fa2581cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.006+0000 7fa25dbc9640 1 -- 10.20.193.68:0/2129244504 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa258071920 msgr2=0x7fa2581cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.006+0000 7fa25dbc9640 1 --2- 10.20.193.68:0/2129244504 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa258071920 0x7fa2581cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.006+0000 7fa25dbc9640 1 -- 10.20.193.68:0/2129244504 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa258136d90 con 0x7fa258072bd0 2026-02-18T21:02:31.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.006+0000 7fa25dbc9640 1 --2- 10.20.193.68:0/2129244504 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa258072bd0 0x7fa2581cc140 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00ec10 tx=0x7fa24c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:31.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.006+0000 7fa23effd640 1 -- 10.20.193.68:0/2129244504 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c017070 con 0x7fa258072bd0 2026-02-18T21:02:31.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.006+0000 7fa23effd640 1 -- 10.20.193.68:0/2129244504 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa24c00cc40 con 0x7fa258072bd0 2026-02-18T21:02:31.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.006+0000 7fa260655640 1 -- 10.20.193.68:0/2129244504 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa25812f020 con 0x7fa258072bd0 2026-02-18T21:02:31.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.006+0000 7fa23effd640 1 -- 10.20.193.68:0/2129244504 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c013470 con 0x7fa258072bd0 2026-02-18T21:02:31.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.006+0000 7fa260655640 1 -- 10.20.193.68:0/2129244504 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2581341c0 con 0x7fa258072bd0 2026-02-18T21:02:31.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.006+0000 7fa260655640 1 -- 10.20.193.68:0/2129244504 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa25812fe90 con 0x7fa258072bd0 2026-02-18T21:02:31.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.006+0000 7fa23effd640 1 -- 10.20.193.68:0/2129244504 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fa24c024060 con 0x7fa258072bd0 2026-02-18T21:02:31.006 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.007+0000 7fa23effd640 1 -- 10.20.193.68:0/2129244504 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7fa24c066b70 con 0x7fa258072bd0 2026-02-18T21:02:31.007 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.007+0000 7fa23effd640 1 -- 10.20.193.68:0/2129244504 --> v1:10.20.193.68:6808/3642986683 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa24c00be50 con 0x7fa228056010 2026-02-18T21:02:31.007 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.007+0000 7fa23effd640 1 -- 10.20.193.68:0/2129244504 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fa24c06b2c0 con 0x7fa258072bd0 2026-02-18T21:02:31.007 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.007+0000 7fa23effd640 1 -- 10.20.193.68:0/2129244504 <== osd.2 v1:10.20.193.68:6808/3642986683 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7fa24c00be50 con 0x7fa228056010 2026-02-18T21:02:31.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.013+0000 7fa260655640 1 -- 10.20.193.68:0/2129244504 --> v1:10.20.193.68:6808/3642986683 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa2580713e0 con 0x7fa228056010 2026-02-18T21:02:31.013 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.014+0000 7fa23effd640 1 -- 10.20.193.68:0/2129244504 <== osd.2 v1:10.20.193.68:6808/3642986683 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7fa2580713e0 con 0x7fa228056010 2026-02-18T21:02:31.014 INFO:teuthology.orchestra.run.trial068.stdout:{ 2026-02-18T21:02:31.014 INFO:teuthology.orchestra.run.trial068.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-18T21:02:31.014 INFO:teuthology.orchestra.run.trial068.stdout:} 2026-02-18T21:02:31.015 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.014+0000 7fa260655640 1 -- 10.20.193.68:0/2129244504 >> v1:10.20.193.68:6808/3642986683 conn(0x7fa228056010 legacy=0x7fa228058450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.015 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.014+0000 7fa260655640 1 -- 10.20.193.68:0/2129244504 >> v1:10.20.193.68:6816/2904515774 conn(0x7fa22804f790 legacy=0x7fa228051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.015 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.014+0000 7fa260655640 1 -- 10.20.193.68:0/2129244504 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa258072bd0 msgr2=0x7fa2581cc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.015 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.014+0000 7fa260655640 1 --2- 10.20.193.68:0/2129244504 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa258072bd0 0x7fa2581cc140 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00ec10 tx=0x7fa24c00c520 comp rx=0 tx=0).stop 2026-02-18T21:02:31.015 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.014+0000 7fa25ebcb640 1 -- 10.20.193.68:0/2129244504 reap_dead start 2026-02-18T21:02:31.016 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.014+0000 7fa260655640 1 -- 10.20.193.68:0/2129244504 shutdown_connections 2026-02-18T21:02:31.016 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.014+0000 7fa260655640 1 -- 10.20.193.68:0/2129244504 >> 10.20.193.68:0/2129244504 conn(0x7fa25809d020 msgr2=0x7fa2581314d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:31.016 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.014+0000 7fa260655640 1 -- 10.20.193.68:0/2129244504 shutdown_connections 2026-02-18T21:02:31.016 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.014+0000 7fa260655640 1 -- 10.20.193.68:0/2129244504 wait complete. 2026-02-18T21:02:31.019 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-18T21:02:31.093 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.089+0000 7fa9246c5640 1 Processor -- start 2026-02-18T21:02:31.093 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.089+0000 7fa9246c5640 1 -- start start 2026-02-18T21:02:31.093 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.089+0000 7fa9246c5640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fa91c134a00 0x7fa91c134de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.093 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.089+0000 7fa9246c5640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa91c071f80 0x7fa91c13c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.093 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.089+0000 7fa9246c5640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa91c09e050 con 0x7fa91c071420 2026-02-18T21:02:31.093 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.089+0000 7fa9246c5640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7fa91c134540 con 0x7fa91c134a00 2026-02-18T21:02:31.093 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.089+0000 7fa9246c5640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fa91c073e60 con 0x7fa91c071f80 2026-02-18T21:02:31.094 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.089+0000 7fa92243a640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fa91c134a00 0x7fa91c134de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.094 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.089+0000 7fa92243a640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fa91c134a00 0x7fa91c134de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:43088/0 (socket says 10.20.193.68:43088) 2026-02-18T21:02:31.094 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.089+0000 7fa921c39640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7fa91c071420 0x7fa91c071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:48042/0 (socket says 10.20.193.68:48042) 2026-02-18T21:02:31.094 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.089+0000 7fa92243a640 1 -- 10.20.193.68:0/3776778873 learned_addr learned my addr 10.20.193.68:0/3776778873 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:31.094 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.089+0000 7fa922c3b640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa91c071f80 0x7fa91c13c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.094 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.089+0000 7fa92243a640 1 -- 10.20.193.68:0/3776778873 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa91c071f80 msgr2=0x7fa91c13c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:31.094 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.089+0000 7fa92243a640 1 --2- 10.20.193.68:0/3776778873 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa91c071f80 0x7fa91c13c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.094 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.089+0000 7fa92243a640 1 -- 10.20.193.68:0/3776778873 >> v1:10.20.193.68:6789/0 conn(0x7fa91c071420 legacy=0x7fa91c071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.094 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.089+0000 7fa92243a640 1 -- 10.20.193.68:0/3776778873 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91c073060 con 0x7fa91c134a00 2026-02-18T21:02:31.094 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.089+0000 7fa921438640 1 -- 10.20.193.68:0/3776778873 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3976450007 0 0) 0x7fa91c09e050 con 0x7fa91c071420 2026-02-18T21:02:31.094 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.089+0000 7fa922c3b640 1 --2- 10.20.193.68:0/3776778873 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa91c071f80 0x7fa91c13c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:31.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.090+0000 7fa92243a640 1 --2- 10.20.193.68:0/3776778873 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa91c134a00 0x7fa91c134de0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009970 tx=0x7fa90c02ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a9a77e55c39f0e server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:31.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.090+0000 7fa921438640 1 -- 10.20.193.68:0/3776778873 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c03c070 con 0x7fa91c134a00 2026-02-18T21:02:31.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.090+0000 7fa921438640 1 -- 10.20.193.68:0/3776778873 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa90c02fb10 con 0x7fa91c134a00 2026-02-18T21:02:31.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.090+0000 7fa921438640 1 -- 10.20.193.68:0/3776778873 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90c037440 con 0x7fa91c134a00 2026-02-18T21:02:31.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.090+0000 7fa9246c5640 1 -- 10.20.193.68:0/3776778873 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa91c134a00 msgr2=0x7fa91c134de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.090+0000 7fa9246c5640 1 --2- 10.20.193.68:0/3776778873 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa91c134a00 0x7fa91c134de0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009970 tx=0x7fa90c02ee90 comp rx=0 tx=0).stop 2026-02-18T21:02:31.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.090+0000 7fa9246c5640 1 -- 10.20.193.68:0/3776778873 shutdown_connections 2026-02-18T21:02:31.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.090+0000 7fa9246c5640 1 --2- 10.20.193.68:0/3776778873 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa91c071f80 0x7fa91c13c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.090+0000 7fa9246c5640 1 --2- 10.20.193.68:0/3776778873 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa91c134a00 0x7fa91c134de0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.090+0000 7fa9246c5640 1 -- 10.20.193.68:0/3776778873 >> 10.20.193.68:0/3776778873 conn(0x7fa91c09cea0 msgr2=0x7fa91c09d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:31.095 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.090+0000 7fa9246c5640 1 -- 10.20.193.68:0/3776778873 shutdown_connections 2026-02-18T21:02:31.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.090+0000 7fa9246c5640 1 -- 10.20.193.68:0/3776778873 wait complete. 2026-02-18T21:02:31.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa9246c5640 1 Processor -- start 2026-02-18T21:02:31.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa9246c5640 1 -- start start 2026-02-18T21:02:31.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa9246c5640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa91c071420 0x7fa91c1cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa9246c5640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa91c071f80 0x7fa91c1cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa9246c5640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa91c134a00 0x7fa91c116900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa9246c5640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fa91c135320 con 0x7fa91c134a00 2026-02-18T21:02:31.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa9246c5640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fa91c13cdc0 con 0x7fa91c071f80 2026-02-18T21:02:31.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa9246c5640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fa91c12ee10 con 0x7fa91c071420 2026-02-18T21:02:31.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa921c39640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa91c071f80 0x7fa91c1cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa92243a640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa91c071420 0x7fa91c1cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.096 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa922c3b640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa91c134a00 0x7fa91c116900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa921c39640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa91c071f80 0x7fa91c1cc3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3301/0 says I am v2:10.20.193.68:39508/0 (socket says 10.20.193.68:39508) 2026-02-18T21:02:31.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa92243a640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa91c071420 0x7fa91c1cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:52324/0 (socket says 10.20.193.68:52324) 2026-02-18T21:02:31.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa921c39640 1 -- 10.20.193.68:0/4135502702 learned_addr learned my addr 10.20.193.68:0/4135502702 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:31.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa921c39640 1 -- 10.20.193.68:0/4135502702 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa91c071420 msgr2=0x7fa91c1cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa921c39640 1 --2- 10.20.193.68:0/4135502702 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa91c071420 0x7fa91c1cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa921c39640 1 -- 10.20.193.68:0/4135502702 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa91c134a00 msgr2=0x7fa91c116900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa921c39640 1 --2- 10.20.193.68:0/4135502702 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa91c134a00 0x7fa91c116900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa921c39640 1 -- 10.20.193.68:0/4135502702 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa91c119790 con 0x7fa91c071f80 2026-02-18T21:02:31.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa92243a640 1 --2- 10.20.193.68:0/4135502702 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa91c071420 0x7fa91c1cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:31.097 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa922c3b640 1 --2- 10.20.193.68:0/4135502702 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa91c134a00 0x7fa91c116900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:31.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa921c39640 1 --2- 10.20.193.68:0/4135502702 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa91c071f80 0x7fa91c1cc3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa91000c700 tx=0x7fa91000cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:31.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa902ffd640 1 -- 10.20.193.68:0/4135502702 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa910018070 con 0x7fa91c071f80 2026-02-18T21:02:31.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa902ffd640 1 -- 10.20.193.68:0/4135502702 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa910004ae0 con 0x7fa91c071f80 2026-02-18T21:02:31.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa902ffd640 1 -- 10.20.193.68:0/4135502702 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9100070d0 con 0x7fa91c071f80 2026-02-18T21:02:31.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa9246c5640 1 -- 10.20.193.68:0/4135502702 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa91c1cc900 con 0x7fa91c071f80 2026-02-18T21:02:31.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.091+0000 7fa9246c5640 1 -- 10.20.193.68:0/4135502702 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa91c118d30 con 0x7fa91c071f80 2026-02-18T21:02:31.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.092+0000 7fa902ffd640 1 -- 10.20.193.68:0/4135502702 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fa910007270 con 0x7fa91c071f80 2026-02-18T21:02:31.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.092+0000 7fa9246c5640 1 -- 10.20.193.68:0/4135502702 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa91c134de0 con 0x7fa91c071f80 2026-02-18T21:02:31.098 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.092+0000 7fa902ffd640 1 -- 10.20.193.68:0/4135502702 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7fa910065f40 con 0x7fa91c071f80 2026-02-18T21:02:31.099 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.094+0000 7fa902ffd640 1 -- 10.20.193.68:0/4135502702 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fa91003fc90 con 0x7fa91c071f80 2026-02-18T21:02:31.165 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.165+0000 7fa9246c5640 1 -- 10.20.193.68:0/4135502702 --> v1:10.20.193.68:6816/2904515774 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fa91c069ef0 con 0x7fa8ec04f790 2026-02-18T21:02:31.166 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.165+0000 7fa902ffd640 1 -- 10.20.193.68:0/4135502702 <== mgr.14114 v1:10.20.193.68:6816/2904515774 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7fa91c069ef0 con 0x7fa8ec04f790 2026-02-18T21:02:31.166 INFO:teuthology.orchestra.run.trial068.stderr:instructed osd(s) 2 to deep-scrub 2026-02-18T21:02:31.167 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.166+0000 7fa9246c5640 1 -- 10.20.193.68:0/4135502702 >> v1:10.20.193.68:6816/2904515774 conn(0x7fa8ec04f790 legacy=0x7fa8ec051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.167 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.166+0000 7fa9246c5640 1 -- 10.20.193.68:0/4135502702 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa91c071f80 msgr2=0x7fa91c1cc3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.167 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.166+0000 7fa9246c5640 1 --2- 10.20.193.68:0/4135502702 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa91c071f80 0x7fa91c1cc3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa91000c700 tx=0x7fa91000cbd0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.167 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.166+0000 7fa9246c5640 1 -- 10.20.193.68:0/4135502702 shutdown_connections 2026-02-18T21:02:31.167 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.166+0000 7fa9246c5640 1 --2- 10.20.193.68:0/4135502702 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fa91c134a00 0x7fa91c116900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.167 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.166+0000 7fa9246c5640 1 --2- 10.20.193.68:0/4135502702 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fa91c071f80 0x7fa91c1cc3c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.167 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.166+0000 7fa9246c5640 1 --2- 10.20.193.68:0/4135502702 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fa91c071420 0x7fa91c1cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.167 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.166+0000 7fa9246c5640 1 -- 10.20.193.68:0/4135502702 >> 10.20.193.68:0/4135502702 conn(0x7fa91c09cea0 msgr2=0x7fa91c131030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:31.167 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.166+0000 7fa9246c5640 1 -- 10.20.193.68:0/4135502702 shutdown_connections 2026-02-18T21:02:31.168 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.166+0000 7fa9246c5640 1 -- 10.20.193.68:0/4135502702 wait complete. 2026-02-18T21:02:31.174 INFO:tasks.ceph:Scrubbing osd.3 2026-02-18T21:02:31.175 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-18T21:02:31.249 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.245+0000 7f9c8d78d640 1 Processor -- start 2026-02-18T21:02:31.249 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.245+0000 7f9c8d78d640 1 -- start start 2026-02-18T21:02:31.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.245+0000 7f9c8d78d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9c881334c0 0x7f9c881358b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.245+0000 7f9c8d78d640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f9c88135df0 0x7f9c881381e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.245+0000 7f9c8d78d640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c8809e2e0 con 0x7f9c8812d010 2026-02-18T21:02:31.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.245+0000 7f9c8d78d640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f9c8812cc50 con 0x7f9c88135df0 2026-02-18T21:02:31.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.245+0000 7f9c8d78d640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f9c88071c60 con 0x7f9c881334c0 2026-02-18T21:02:31.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.245+0000 7f9c86ffd640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f9c8812d010 0x7f9c8812d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:48056/0 (socket says 10.20.193.68:48056) 2026-02-18T21:02:31.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.245+0000 7f9c86ffd640 1 -- 10.20.193.68:0/1686097593 learned_addr learned my addr 10.20.193.68:0/1686097593 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:31.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.245+0000 7f9c867fc640 1 --2- 10.20.193.68:0/1686097593 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9c881334c0 0x7f9c881358b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.245+0000 7f9c877fe640 1 --2- 10.20.193.68:0/1686097593 >> v2:10.20.193.68:3300/0 conn(0x7f9c88135df0 0x7f9c881381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.245+0000 7f9c85ffb640 1 -- 10.20.193.68:0/1686097593 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1817798013 0 0) 0x7f9c8809e2e0 con 0x7f9c8812d010 2026-02-18T21:02:31.250 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.245+0000 7f9c85ffb640 1 -- 10.20.193.68:0/1686097593 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c74003620 con 0x7f9c8812d010 2026-02-18T21:02:31.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.245+0000 7f9c867fc640 1 -- 10.20.193.68:0/1686097593 >> v2:10.20.193.68:3300/0 conn(0x7f9c88135df0 msgr2=0x7f9c881381e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:31.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.245+0000 7f9c867fc640 1 --2- 10.20.193.68:0/1686097593 >> v2:10.20.193.68:3300/0 conn(0x7f9c88135df0 0x7f9c881381e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.245+0000 7f9c867fc640 1 -- 10.20.193.68:0/1686097593 >> v1:10.20.193.68:6789/0 conn(0x7f9c8812d010 legacy=0x7f9c8812d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.245+0000 7f9c867fc640 1 -- 10.20.193.68:0/1686097593 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c88071480 con 0x7f9c881334c0 2026-02-18T21:02:31.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.245+0000 7f9c877fe640 1 --2- 10.20.193.68:0/1686097593 >> v2:10.20.193.68:3300/0 conn(0x7f9c88135df0 0x7f9c881381e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:31.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.246+0000 7f9c867fc640 1 --2- 10.20.193.68:0/1686097593 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9c881334c0 0x7f9c881358b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9c700098a0 tx=0x7f9c7002ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9d2710c66b09d5 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:31.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.246+0000 7f9c85ffb640 1 -- 10.20.193.68:0/1686097593 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7003c070 con 0x7f9c881334c0 2026-02-18T21:02:31.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.246+0000 7f9c85ffb640 1 -- 10.20.193.68:0/1686097593 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c7002fa40 con 0x7f9c881334c0 2026-02-18T21:02:31.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.246+0000 7f9c85ffb640 1 -- 10.20.193.68:0/1686097593 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7002fe10 con 0x7f9c881334c0 2026-02-18T21:02:31.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.246+0000 7f9c8d78d640 1 -- 10.20.193.68:0/1686097593 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9c881334c0 msgr2=0x7f9c881358b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.251 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.246+0000 7f9c8d78d640 1 --2- 10.20.193.68:0/1686097593 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9c881334c0 0x7f9c881358b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9c700098a0 tx=0x7f9c7002ed80 comp rx=0 tx=0).stop 2026-02-18T21:02:31.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.246+0000 7f9c8d78d640 1 -- 10.20.193.68:0/1686097593 shutdown_connections 2026-02-18T21:02:31.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.246+0000 7f9c8d78d640 1 --2- 10.20.193.68:0/1686097593 >> v2:10.20.193.68:3300/0 conn(0x7f9c88135df0 0x7f9c881381e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.246+0000 7f9c8d78d640 1 --2- 10.20.193.68:0/1686097593 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9c881334c0 0x7f9c881358b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.246+0000 7f9c8d78d640 1 -- 10.20.193.68:0/1686097593 >> 10.20.193.68:0/1686097593 conn(0x7f9c8809d020 msgr2=0x7f9c8809d430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:31.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.246+0000 7f9c8d78d640 1 -- 10.20.193.68:0/1686097593 shutdown_connections 2026-02-18T21:02:31.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.246+0000 7f9c8d78d640 1 -- 10.20.193.68:0/1686097593 wait complete. 2026-02-18T21:02:31.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c8d78d640 1 Processor -- start 2026-02-18T21:02:31.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c8d78d640 1 -- start start 2026-02-18T21:02:31.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c8d78d640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9c8812d010 0x7f9c881291d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c8d78d640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9c881334c0 0x7f9c88129710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.252 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c8d78d640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9c88135df0 0x7f9c88130120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c8d78d640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f9c881167b0 con 0x7f9c8812d010 2026-02-18T21:02:31.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c8d78d640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f9c8812dbc0 con 0x7f9c88135df0 2026-02-18T21:02:31.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c8d78d640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f9c88138720 con 0x7f9c881334c0 2026-02-18T21:02:31.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c867fc640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9c881334c0 0x7f9c88129710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c86ffd640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9c8812d010 0x7f9c881291d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c867fc640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9c881334c0 0x7f9c88129710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:52340/0 (socket says 10.20.193.68:52340) 2026-02-18T21:02:31.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c867fc640 1 -- 10.20.193.68:0/977065943 learned_addr learned my addr 10.20.193.68:0/977065943 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:31.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c877fe640 1 --2- 10.20.193.68:0/977065943 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9c88135df0 0x7f9c88130120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c867fc640 1 -- 10.20.193.68:0/977065943 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9c88135df0 msgr2=0x7f9c88130120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c867fc640 1 --2- 10.20.193.68:0/977065943 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9c88135df0 0x7f9c88130120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.253 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c867fc640 1 -- 10.20.193.68:0/977065943 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9c8812d010 msgr2=0x7f9c881291d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c867fc640 1 --2- 10.20.193.68:0/977065943 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9c8812d010 0x7f9c881291d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c867fc640 1 -- 10.20.193.68:0/977065943 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c88132fc0 con 0x7f9c881334c0 2026-02-18T21:02:31.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c867fc640 1 --2- 10.20.193.68:0/977065943 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9c881334c0 0x7f9c88129710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9c70009130 tx=0x7f9c700047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:31.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c677fe640 1 -- 10.20.193.68:0/977065943 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7003c040 con 0x7f9c881334c0 2026-02-18T21:02:31.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c677fe640 1 -- 10.20.193.68:0/977065943 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c70042450 con 0x7f9c881334c0 2026-02-18T21:02:31.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c8d78d640 1 -- 10.20.193.68:0/977065943 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c8811bbd0 con 0x7f9c881334c0 2026-02-18T21:02:31.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c677fe640 1 -- 10.20.193.68:0/977065943 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c70042820 con 0x7f9c881334c0 2026-02-18T21:02:31.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.247+0000 7f9c8d78d640 1 -- 10.20.193.68:0/977065943 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c88132400 con 0x7f9c881334c0 2026-02-18T21:02:31.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.248+0000 7f9c8d78d640 1 -- 10.20.193.68:0/977065943 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9c88074040 con 0x7f9c881334c0 2026-02-18T21:02:31.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.248+0000 7f9c677fe640 1 -- 10.20.193.68:0/977065943 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f9c7004b410 con 0x7f9c881334c0 2026-02-18T21:02:31.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.248+0000 7f9c677fe640 1 -- 10.20.193.68:0/977065943 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f9c7008b950 con 0x7f9c881334c0 2026-02-18T21:02:31.254 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.248+0000 7f9c677fe640 1 -- 10.20.193.68:0/977065943 --> v1:10.20.193.68:6812/1687218919 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c7003ee50 con 0x7f9c54056080 2026-02-18T21:02:31.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.248+0000 7f9c677fe640 1 -- 10.20.193.68:0/977065943 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9c700902c0 con 0x7f9c881334c0 2026-02-18T21:02:31.255 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.249+0000 7f9c677fe640 1 -- 10.20.193.68:0/977065943 <== osd.3 v1:10.20.193.68:6812/1687218919 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (unknown 0 0 3365489958) 0x7f9c7003ee50 con 0x7f9c54056080 2026-02-18T21:02:31.257 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.256+0000 7f9c8d78d640 1 -- 10.20.193.68:0/977065943 --> v1:10.20.193.68:6812/1687218919 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9c88132cc0 con 0x7f9c54056080 2026-02-18T21:02:31.257 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.257+0000 7f9c677fe640 1 -- 10.20.193.68:0/977065943 <== osd.3 v1:10.20.193.68:6812/1687218919 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7f9c88132cc0 con 0x7f9c54056080 2026-02-18T21:02:31.257 INFO:teuthology.orchestra.run.trial068.stdout:{ 2026-02-18T21:02:31.257 INFO:teuthology.orchestra.run.trial068.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-18T21:02:31.257 INFO:teuthology.orchestra.run.trial068.stdout:} 2026-02-18T21:02:31.258 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.257+0000 7f9c8d78d640 1 -- 10.20.193.68:0/977065943 >> v1:10.20.193.68:6812/1687218919 conn(0x7f9c54056080 legacy=0x7f9c540584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.259 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.257+0000 7f9c8d78d640 1 -- 10.20.193.68:0/977065943 >> v1:10.20.193.68:6816/2904515774 conn(0x7f9c5404f790 legacy=0x7f9c54051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.259 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.257+0000 7f9c8d78d640 1 -- 10.20.193.68:0/977065943 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9c881334c0 msgr2=0x7f9c88129710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.259 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.257+0000 7f9c8d78d640 1 --2- 10.20.193.68:0/977065943 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9c881334c0 0x7f9c88129710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9c70009130 tx=0x7f9c700047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.259 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.257+0000 7f9c877fe640 1 -- 10.20.193.68:0/977065943 reap_dead start 2026-02-18T21:02:31.259 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.257+0000 7f9c8d78d640 1 -- 10.20.193.68:0/977065943 shutdown_connections 2026-02-18T21:02:31.259 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.257+0000 7f9c8d78d640 1 -- 10.20.193.68:0/977065943 >> 10.20.193.68:0/977065943 conn(0x7f9c8809d020 msgr2=0x7f9c8812c310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:31.259 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.257+0000 7f9c8d78d640 1 -- 10.20.193.68:0/977065943 shutdown_connections 2026-02-18T21:02:31.259 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.257+0000 7f9c8d78d640 1 -- 10.20.193.68:0/977065943 wait complete. 2026-02-18T21:02:31.264 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-18T21:02:31.336 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.332+0000 7f9cded64640 1 Processor -- start 2026-02-18T21:02:31.336 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.332+0000 7f9cded64640 1 -- start start 2026-02-18T21:02:31.336 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.332+0000 7f9cded64640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9cd812ac90 0x7f9cd812b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.332+0000 7f9cded64640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cd8073680 0x7f9cd8071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.332+0000 7f9cded64640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f9cd8071960 0x7f9cd8071de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.332+0000 7f9cded64640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f9cd812a7b0 con 0x7f9cd8071960 2026-02-18T21:02:31.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.332+0000 7f9cded64640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd8073e60 con 0x7f9cd8073680 2026-02-18T21:02:31.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.332+0000 7f9cded64640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f9cd8072d10 con 0x7f9cd812ac90 2026-02-18T21:02:31.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.332+0000 7f9cdcad9640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9cd812ac90 0x7f9cd812b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.332+0000 7f9ccffff640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cd8073680 0x7f9cd8071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.332+0000 7f9cdd2da640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f9cd8071960 0x7f9cd8071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.332+0000 7f9cdcad9640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9cd812ac90 0x7f9cd812b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:52352/0 (socket says 10.20.193.68:52352) 2026-02-18T21:02:31.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.332+0000 7f9cdcad9640 1 -- 10.20.193.68:0/2261674767 learned_addr learned my addr 10.20.193.68:0/2261674767 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:31.337 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.332+0000 7f9ccffff640 1 -- 10.20.193.68:0/2261674767 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9cd812ac90 msgr2=0x7f9cd812b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:31.338 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.332+0000 7f9ccffff640 1 --2- 10.20.193.68:0/2261674767 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9cd812ac90 0x7f9cd812b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.338 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.332+0000 7f9ccffff640 1 -- 10.20.193.68:0/2261674767 >> v2:10.20.193.68:3300/0 conn(0x7f9cd8071960 msgr2=0x7f9cd8071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:31.338 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.332+0000 7f9ccffff640 1 --2- 10.20.193.68:0/2261674767 >> v2:10.20.193.68:3300/0 conn(0x7f9cd8071960 0x7f9cd8071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.338 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.332+0000 7f9ccffff640 1 -- 10.20.193.68:0/2261674767 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd812b5b0 con 0x7f9cd8073680 2026-02-18T21:02:31.338 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.333+0000 7f9ccffff640 1 --2- 10.20.193.68:0/2261674767 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cd8073680 0x7f9cd8071420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9cc00098a0 tx=0x7f9cc002ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c856c275ce99b473 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:31.338 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.333+0000 7f9ccf7fe640 1 -- 10.20.193.68:0/2261674767 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc003c070 con 0x7f9cd8073680 2026-02-18T21:02:31.338 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.333+0000 7f9ccf7fe640 1 -- 10.20.193.68:0/2261674767 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc002f9f0 con 0x7f9cd8073680 2026-02-18T21:02:31.338 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.333+0000 7f9ccf7fe640 1 -- 10.20.193.68:0/2261674767 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc002fdc0 con 0x7f9cd8073680 2026-02-18T21:02:31.338 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.333+0000 7f9cded64640 1 -- 10.20.193.68:0/2261674767 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cd8073680 msgr2=0x7f9cd8071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.338 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.333+0000 7f9cded64640 1 --2- 10.20.193.68:0/2261674767 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cd8073680 0x7f9cd8071420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9cc00098a0 tx=0x7f9cc002ed80 comp rx=0 tx=0).stop 2026-02-18T21:02:31.338 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.333+0000 7f9cded64640 1 -- 10.20.193.68:0/2261674767 shutdown_connections 2026-02-18T21:02:31.339 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.333+0000 7f9cded64640 1 --2- 10.20.193.68:0/2261674767 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cd8073680 0x7f9cd8071420 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.339 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.333+0000 7f9cded64640 1 --2- 10.20.193.68:0/2261674767 >> v2:10.20.193.68:3300/0 conn(0x7f9cd8071960 0x7f9cd8071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.339 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.333+0000 7f9cded64640 1 --2- 10.20.193.68:0/2261674767 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9cd812ac90 0x7f9cd812b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.339 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.333+0000 7f9cded64640 1 -- 10.20.193.68:0/2261674767 >> 10.20.193.68:0/2261674767 conn(0x7f9cd809cea0 msgr2=0x7f9cd809d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:31.339 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.333+0000 7f9cded64640 1 -- 10.20.193.68:0/2261674767 shutdown_connections 2026-02-18T21:02:31.339 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.333+0000 7f9cded64640 1 -- 10.20.193.68:0/2261674767 wait complete. 2026-02-18T21:02:31.339 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9cded64640 1 Processor -- start 2026-02-18T21:02:31.339 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9cded64640 1 -- start start 2026-02-18T21:02:31.339 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9cded64640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9cd8071960 0x7f9cd8116ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.339 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9cded64640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9cd8073680 0x7f9cd8117420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.339 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9cded64640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cd812ac90 0x7f9cd8117960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.339 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9cded64640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd81353f0 con 0x7f9cd8073680 2026-02-18T21:02:31.339 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9cded64640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd8135270 con 0x7f9cd812ac90 2026-02-18T21:02:31.340 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9cded64640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f9cd8135570 con 0x7f9cd8071960 2026-02-18T21:02:31.340 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9cdcad9640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9cd8071960 0x7f9cd8116ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.340 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9ccffff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9cd8073680 0x7f9cd8117420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.340 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9cdcad9640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9cd8071960 0x7f9cd8116ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:52364/0 (socket says 10.20.193.68:52364) 2026-02-18T21:02:31.340 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9cdcad9640 1 -- 10.20.193.68:0/1616187042 learned_addr learned my addr 10.20.193.68:0/1616187042 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:31.340 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9cdd2da640 1 --2- 10.20.193.68:0/1616187042 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cd812ac90 0x7f9cd8117960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.340 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9cdcad9640 1 -- 10.20.193.68:0/1616187042 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cd812ac90 msgr2=0x7f9cd8117960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.340 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9cdcad9640 1 --2- 10.20.193.68:0/1616187042 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cd812ac90 0x7f9cd8117960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.340 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9cdcad9640 1 -- 10.20.193.68:0/1616187042 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9cd8073680 msgr2=0x7f9cd8117420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.340 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9cdcad9640 1 --2- 10.20.193.68:0/1616187042 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9cd8073680 0x7f9cd8117420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.340 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9cdcad9640 1 -- 10.20.193.68:0/1616187042 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd8133ee0 con 0x7f9cd8071960 2026-02-18T21:02:31.341 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9cdcad9640 1 --2- 10.20.193.68:0/1616187042 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9cd8071960 0x7f9cd8116ee0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9cc800e930 tx=0x7f9cc800ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:31.341 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9ccd7fa640 1 -- 10.20.193.68:0/1616187042 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8017070 con 0x7f9cd8071960 2026-02-18T21:02:31.341 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9ccd7fa640 1 -- 10.20.193.68:0/1616187042 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc800c9a0 con 0x7f9cd8071960 2026-02-18T21:02:31.341 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9cded64640 1 -- 10.20.193.68:0/1616187042 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd8119310 con 0x7f9cd8071960 2026-02-18T21:02:31.341 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9ccd7fa640 1 -- 10.20.193.68:0/1616187042 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc800cd90 con 0x7f9cd8071960 2026-02-18T21:02:31.341 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.334+0000 7f9cded64640 1 -- 10.20.193.68:0/1616187042 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd81c73f0 con 0x7f9cd8071960 2026-02-18T21:02:31.341 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.335+0000 7f9cded64640 1 -- 10.20.193.68:0/1616187042 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cd8071420 con 0x7f9cd8071960 2026-02-18T21:02:31.341 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.335+0000 7f9ccd7fa640 1 -- 10.20.193.68:0/1616187042 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f9cc8024060 con 0x7f9cd8071960 2026-02-18T21:02:31.341 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.336+0000 7f9ccd7fa640 1 -- 10.20.193.68:0/1616187042 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f9cc8066b20 con 0x7f9cd8071960 2026-02-18T21:02:31.342 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.338+0000 7f9ccd7fa640 1 -- 10.20.193.68:0/1616187042 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f9cc8040870 con 0x7f9cd8071960 2026-02-18T21:02:31.410 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.410+0000 7f9cded64640 1 -- 10.20.193.68:0/1616187042 --> v1:10.20.193.68:6816/2904515774 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f9cd8069ef0 con 0x7f9ca804f790 2026-02-18T21:02:31.410 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.410+0000 7f9ccd7fa640 1 -- 10.20.193.68:0/1616187042 <== mgr.14114 v1:10.20.193.68:6816/2904515774 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7f9cd8069ef0 con 0x7f9ca804f790 2026-02-18T21:02:31.411 INFO:teuthology.orchestra.run.trial068.stderr:instructed osd(s) 3 to deep-scrub 2026-02-18T21:02:31.412 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.411+0000 7f9cded64640 1 -- 10.20.193.68:0/1616187042 >> v1:10.20.193.68:6816/2904515774 conn(0x7f9ca804f790 legacy=0x7f9ca8051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.412 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.411+0000 7f9cded64640 1 -- 10.20.193.68:0/1616187042 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9cd8071960 msgr2=0x7f9cd8116ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.412 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.411+0000 7f9cded64640 1 --2- 10.20.193.68:0/1616187042 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9cd8071960 0x7f9cd8116ee0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9cc800e930 tx=0x7f9cc800ee00 comp rx=0 tx=0).stop 2026-02-18T21:02:31.412 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.411+0000 7f9cded64640 1 -- 10.20.193.68:0/1616187042 shutdown_connections 2026-02-18T21:02:31.412 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.411+0000 7f9cded64640 1 --2- 10.20.193.68:0/1616187042 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f9cd812ac90 0x7f9cd8117960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.412 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.411+0000 7f9cded64640 1 --2- 10.20.193.68:0/1616187042 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f9cd8073680 0x7f9cd8117420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.412 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.411+0000 7f9cded64640 1 --2- 10.20.193.68:0/1616187042 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f9cd8071960 0x7f9cd8116ee0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.412 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.411+0000 7f9cded64640 1 -- 10.20.193.68:0/1616187042 >> 10.20.193.68:0/1616187042 conn(0x7f9cd809cea0 msgr2=0x7f9cd8125180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:31.412 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.411+0000 7f9cded64640 1 -- 10.20.193.68:0/1616187042 shutdown_connections 2026-02-18T21:02:31.413 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.411+0000 7f9cded64640 1 -- 10.20.193.68:0/1616187042 wait complete. 2026-02-18T21:02:31.420 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-18T21:02:31.493 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.489+0000 7fea2b5bc640 1 Processor -- start 2026-02-18T21:02:31.493 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.489+0000 7fea2b5bc640 1 -- start start 2026-02-18T21:02:31.493 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.489+0000 7fea2b5bc640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea24071400 0x7fea240717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.493 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.489+0000 7fea2b5bc640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea2412e510 0x7fea2413ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.493 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.489+0000 7fea2b5bc640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea240731f0 con 0x7fea24071d20 2026-02-18T21:02:31.494 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.489+0000 7fea2b5bc640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fea2409e090 con 0x7fea2412e510 2026-02-18T21:02:31.494 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.489+0000 7fea2b5bc640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fea24073f90 con 0x7fea24071400 2026-02-18T21:02:31.494 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.489+0000 7fea29331640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea24071400 0x7fea240717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.494 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.489+0000 7fea29331640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea24071400 0x7fea240717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:52370/0 (socket says 10.20.193.68:52370) 2026-02-18T21:02:31.494 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.489+0000 7fea29331640 1 -- 10.20.193.68:0/2544592450 learned_addr learned my addr 10.20.193.68:0/2544592450 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:31.494 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.489+0000 7fea29b32640 1 --2- 10.20.193.68:0/2544592450 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea2412e510 0x7fea2413ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.494 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.489+0000 7fea29331640 1 -- 10.20.193.68:0/2544592450 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea2412e510 msgr2=0x7fea2413ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:31.494 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.489+0000 7fea29331640 1 --2- 10.20.193.68:0/2544592450 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea2412e510 0x7fea2413ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.494 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.489+0000 7fea29331640 1 -- 10.20.193.68:0/2544592450 >> v1:10.20.193.68:6789/0 conn(0x7fea24071d20 legacy=0x7fea2412de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.494 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.489+0000 7fea29331640 1 -- 10.20.193.68:0/2544592450 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea24072900 con 0x7fea24071400 2026-02-18T21:02:31.494 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.490+0000 7fea29331640 1 --2- 10.20.193.68:0/2544592450 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea24071400 0x7fea240717e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fea140099a0 tx=0x7fea1402ef50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12e61c0936e0602 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:31.495 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.490+0000 7fea13fff640 1 -- 10.20.193.68:0/2544592450 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1403c070 con 0x7fea24071400 2026-02-18T21:02:31.495 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.490+0000 7fea13fff640 1 -- 10.20.193.68:0/2544592450 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea1402fb80 con 0x7fea24071400 2026-02-18T21:02:31.495 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.490+0000 7fea13fff640 1 -- 10.20.193.68:0/2544592450 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14037440 con 0x7fea24071400 2026-02-18T21:02:31.495 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.490+0000 7fea2b5bc640 1 -- 10.20.193.68:0/2544592450 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea24071400 msgr2=0x7fea240717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.495 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.490+0000 7fea2b5bc640 1 --2- 10.20.193.68:0/2544592450 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea24071400 0x7fea240717e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fea140099a0 tx=0x7fea1402ef50 comp rx=0 tx=0).stop 2026-02-18T21:02:31.495 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.490+0000 7fea2b5bc640 1 -- 10.20.193.68:0/2544592450 shutdown_connections 2026-02-18T21:02:31.495 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.490+0000 7fea2b5bc640 1 --2- 10.20.193.68:0/2544592450 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea2412e510 0x7fea2413ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.495 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.490+0000 7fea2b5bc640 1 --2- 10.20.193.68:0/2544592450 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea24071400 0x7fea240717e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.495 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.490+0000 7fea2b5bc640 1 -- 10.20.193.68:0/2544592450 >> 10.20.193.68:0/2544592450 conn(0x7fea2409cee0 msgr2=0x7fea2409d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:31.495 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.490+0000 7fea2b5bc640 1 -- 10.20.193.68:0/2544592450 shutdown_connections 2026-02-18T21:02:31.495 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.490+0000 7fea2b5bc640 1 -- 10.20.193.68:0/2544592450 wait complete. 2026-02-18T21:02:31.496 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.491+0000 7fea2b5bc640 1 Processor -- start 2026-02-18T21:02:31.496 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.491+0000 7fea2b5bc640 1 -- start start 2026-02-18T21:02:31.496 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.491+0000 7fea2b5bc640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea24071400 0x7fea24135a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.496 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.491+0000 7fea2b5bc640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea24071d20 0x7fea24135f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.496 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.491+0000 7fea2b5bc640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fea2412e510 0x7fea24136480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:31.496 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.491+0000 7fea2b5bc640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fea2412e990 con 0x7fea2412e510 2026-02-18T21:02:31.496 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.491+0000 7fea2b5bc640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fea2412eb10 con 0x7fea24071d20 2026-02-18T21:02:31.496 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.491+0000 7fea2b5bc640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fea2412ec90 con 0x7fea24071400 2026-02-18T21:02:31.496 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.491+0000 7fea29331640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea24071400 0x7fea24135a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.496 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.491+0000 7fea29331640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea24071400 0x7fea24135a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:52386/0 (socket says 10.20.193.68:52386) 2026-02-18T21:02:31.496 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.491+0000 7fea29331640 1 -- 10.20.193.68:0/3657635263 learned_addr learned my addr 10.20.193.68:0/3657635263 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:31.497 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.491+0000 7fea28b30640 1 --2- 10.20.193.68:0/3657635263 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea24071d20 0x7fea24135f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.497 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.491+0000 7fea29b32640 1 --2- 10.20.193.68:0/3657635263 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fea2412e510 0x7fea24136480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:31.497 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.491+0000 7fea29331640 1 -- 10.20.193.68:0/3657635263 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea24071d20 msgr2=0x7fea24135f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.497 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.491+0000 7fea29331640 1 --2- 10.20.193.68:0/3657635263 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea24071d20 0x7fea24135f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.497 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.491+0000 7fea29331640 1 -- 10.20.193.68:0/3657635263 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fea2412e510 msgr2=0x7fea24136480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.497 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.491+0000 7fea29331640 1 --2- 10.20.193.68:0/3657635263 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fea2412e510 0x7fea24136480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.497 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.491+0000 7fea29331640 1 -- 10.20.193.68:0/3657635263 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea2411a980 con 0x7fea24071400 2026-02-18T21:02:31.497 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.491+0000 7fea29331640 1 --2- 10.20.193.68:0/3657635263 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea24071400 0x7fea24135a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fea14009ad0 tx=0x7fea140047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:31.497 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.491+0000 7fea11ffb640 1 -- 10.20.193.68:0/3657635263 <== mon.2 v2:10.20.193.68:3302/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1403c040 con 0x7fea24071400 2026-02-18T21:02:31.497 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.492+0000 7fea11ffb640 1 -- 10.20.193.68:0/3657635263 <== mon.2 v2:10.20.193.68:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea14042630 con 0x7fea24071400 2026-02-18T21:02:31.497 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.492+0000 7fea2b5bc640 1 -- 10.20.193.68:0/3657635263 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea2412e230 con 0x7fea24071400 2026-02-18T21:02:31.497 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.492+0000 7fea11ffb640 1 -- 10.20.193.68:0/3657635263 <== mon.2 v2:10.20.193.68:3302/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14042a20 con 0x7fea24071400 2026-02-18T21:02:31.498 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.492+0000 7fea2b5bc640 1 -- 10.20.193.68:0/3657635263 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fea24136ec0 con 0x7fea24071400 2026-02-18T21:02:31.498 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.492+0000 7fea2b5bc640 1 -- 10.20.193.68:0/3657635263 --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea240717e0 con 0x7fea24071400 2026-02-18T21:02:31.498 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.492+0000 7fea11ffb640 1 -- 10.20.193.68:0/3657635263 <== mon.2 v2:10.20.193.68:3302/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fea14042bc0 con 0x7fea24071400 2026-02-18T21:02:31.498 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.492+0000 7fea11ffb640 1 -- 10.20.193.68:0/3657635263 <== mon.2 v2:10.20.193.68:3302/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7fea1408bd80 con 0x7fea24071400 2026-02-18T21:02:31.498 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.494+0000 7fea11ffb640 1 -- 10.20.193.68:0/3657635263 <== mon.2 v2:10.20.193.68:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fea14065c80 con 0x7fea24071400 2026-02-18T21:02:31.563 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.563+0000 7fea2b5bc640 1 -- 10.20.193.68:0/3657635263 --> v1:10.20.193.68:6816/2904515774 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fea24072dc0 con 0x7fe9f404f790 2026-02-18T21:02:31.564 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.564+0000 7fea11ffb640 1 -- 10.20.193.68:0/3657635263 <== mgr.14114 v1:10.20.193.68:6816/2904515774 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31985 (unknown 2965378022 0 3588534937) 0x7fea24072dc0 con 0x7fe9f404f790 2026-02-18T21:02:31.565 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:31.566 INFO:teuthology.orchestra.run.trial068.stderr:dumped all 2026-02-18T21:02:31.566 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.565+0000 7fea2b5bc640 1 -- 10.20.193.68:0/3657635263 >> v1:10.20.193.68:6816/2904515774 conn(0x7fe9f404f790 legacy=0x7fe9f4051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.566 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.565+0000 7fea2b5bc640 1 -- 10.20.193.68:0/3657635263 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea24071400 msgr2=0x7fea24135a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:31.566 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.565+0000 7fea2b5bc640 1 --2- 10.20.193.68:0/3657635263 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea24071400 0x7fea24135a00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fea14009ad0 tx=0x7fea140047c0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.566 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.565+0000 7fea2b5bc640 1 -- 10.20.193.68:0/3657635263 shutdown_connections 2026-02-18T21:02:31.566 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.565+0000 7fea2b5bc640 1 --2- 10.20.193.68:0/3657635263 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fea2412e510 0x7fea24136480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.567 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.565+0000 7fea2b5bc640 1 --2- 10.20.193.68:0/3657635263 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fea24071d20 0x7fea24135f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.567 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.565+0000 7fea2b5bc640 1 --2- 10.20.193.68:0/3657635263 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fea24071400 0x7fea24135a00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:31.567 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.565+0000 7fea2b5bc640 1 -- 10.20.193.68:0/3657635263 >> 10.20.193.68:0/3657635263 conn(0x7fea2409cee0 msgr2=0x7fea2412f020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:31.567 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.565+0000 7fea2b5bc640 1 -- 10.20.193.68:0/3657635263 shutdown_connections 2026-02-18T21:02:31.567 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:31.565+0000 7fea2b5bc640 1 -- 10.20.193.68:0/3657635263 wait complete. 2026-02-18T21:02:31.573 INFO:teuthology.orchestra.run.trial068.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2026-02-18T21:02:31.004351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":128768,"kb_used_data":2248,"kb_used_omap":17,"kb_used_meta":126446,"kb_avail":377358592,"statfs":{"total":386547056640,"available":386415198208,"internally_reserved":0,"allocated":2301952,"data_stored":1570395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18173,"internal_metadata":129480963},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.961900"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048218+0000","last_change":"2026-02-18T21:02:21.035499+0000","last_active":"2026-02-18T21:02:25.048218+0000","last_peered":"2026-02-18T21:02:25.048218+0000","last_clean":"2026-02-18T21:02:25.048218+0000","last_became_active":"2026-02-18T21:02:21.035326+0000","last_became_peered":"2026-02-18T21:02:21.035326+0000","last_unstale":"2026-02-18T21:02:25.048218+0000","last_undegraded":"2026-02-18T21:02:25.048218+0000","last_fullsized":"2026-02-18T21:02:25.048218+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T00:53:21.914540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000486527,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:26.365211+0000","last_change":"2026-02-18T21:02:19.036890+0000","last_active":"2026-02-18T21:02:26.365211+0000","last_peered":"2026-02-18T21:02:26.365211+0000","last_clean":"2026-02-18T21:02:26.365211+0000","last_became_active":"2026-02-18T21:02:19.036766+0000","last_became_peered":"2026-02-18T21:02:19.036766+0000","last_unstale":"2026-02-18T21:02:26.365211+0000","last_undegraded":"2026-02-18T21:02:26.365211+0000","last_fullsized":"2026-02-18T21:02:26.365211+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T04:56:21.470671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018692399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048248+0000","last_change":"2026-02-18T21:02:21.035264+0000","last_active":"2026-02-18T21:02:25.048248+0000","last_peered":"2026-02-18T21:02:25.048248+0000","last_clean":"2026-02-18T21:02:25.048248+0000","last_became_active":"2026-02-18T21:02:21.035120+0000","last_became_peered":"2026-02-18T21:02:21.035120+0000","last_unstale":"2026-02-18T21:02:25.048248+0000","last_undegraded":"2026-02-18T21:02:25.048248+0000","last_fullsized":"2026-02-18T21:02:25.048248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T08:23:02.934853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044243599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:26.365172+0000","last_change":"2026-02-18T21:02:19.036659+0000","last_active":"2026-02-18T21:02:26.365172+0000","last_peered":"2026-02-18T21:02:26.365172+0000","last_clean":"2026-02-18T21:02:26.365172+0000","last_became_active":"2026-02-18T21:02:19.036530+0000","last_became_peered":"2026-02-18T21:02:19.036530+0000","last_unstale":"2026-02-18T21:02:26.365172+0000","last_undegraded":"2026-02-18T21:02:26.365172+0000","last_fullsized":"2026-02-18T21:02:26.365172+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T05:12:12.426889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020214300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"16'2","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048221+0000","last_change":"2026-02-18T21:02:21.036361+0000","last_active":"2026-02-18T21:02:25.048221+0000","last_peered":"2026-02-18T21:02:25.048221+0000","last_clean":"2026-02-18T21:02:25.048221+0000","last_became_active":"2026-02-18T21:02:21.036142+0000","last_became_peered":"2026-02-18T21:02:21.036142+0000","last_unstale":"2026-02-18T21:02:25.048221+0000","last_undegraded":"2026-02-18T21:02:25.048221+0000","last_fullsized":"2026-02-18T21:02:25.048221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T04:35:27.290307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036890000000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048111+0000","last_change":"2026-02-18T21:02:21.035466+0000","last_active":"2026-02-18T21:02:25.048111+0000","last_peered":"2026-02-18T21:02:25.048111+0000","last_clean":"2026-02-18T21:02:25.048111+0000","last_became_active":"2026-02-18T21:02:21.035305+0000","last_became_peered":"2026-02-18T21:02:21.035305+0000","last_unstale":"2026-02-18T21:02:25.048111+0000","last_undegraded":"2026-02-18T21:02:25.048111+0000","last_fullsized":"2026-02-18T21:02:25.048111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T01:23:13.378008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021428500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048222+0000","last_change":"2026-02-18T21:02:21.036020+0000","last_active":"2026-02-18T21:02:25.048222+0000","last_peered":"2026-02-18T21:02:25.048222+0000","last_clean":"2026-02-18T21:02:25.048222+0000","last_became_active":"2026-02-18T21:02:21.035916+0000","last_became_peered":"2026-02-18T21:02:21.035916+0000","last_unstale":"2026-02-18T21:02:25.048222+0000","last_undegraded":"2026-02-18T21:02:25.048222+0000","last_fullsized":"2026-02-18T21:02:25.048222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T06:05:49.040282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017934099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"14'1","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:25.048226+0000","last_change":"2026-02-18T21:02:21.035434+0000","last_active":"2026-02-18T21:02:25.048226+0000","last_peered":"2026-02-18T21:02:25.048226+0000","last_clean":"2026-02-18T21:02:25.048226+0000","last_became_active":"2026-02-18T21:02:21.035231+0000","last_became_peered":"2026-02-18T21:02:21.035231+0000","last_unstale":"2026-02-18T21:02:25.048226+0000","last_undegraded":"2026-02-18T21:02:25.048226+0000","last_fullsized":"2026-02-18T21:02:25.048226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:25.969636+0000","last_clean_scrub_stamp":"2026-02-18T21:01:25.969636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T00:30:40.499896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000176987,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"20'79","reported_seq":156,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:26.365112+0000","last_change":"2026-02-18T21:02:19.036859+0000","last_active":"2026-02-18T21:02:26.365112+0000","last_peered":"2026-02-18T21:02:26.365112+0000","last_clean":"2026-02-18T21:02:26.365112+0000","last_became_active":"2026-02-18T21:02:19.036727+0000","last_became_peered":"2026-02-18T21:02:19.036727+0000","last_unstale":"2026-02-18T21:02:26.365112+0000","last_undegraded":"2026-02-18T21:02:26.365112+0000","last_fullsized":"2026-02-18T21:02:26.365112+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:01:20.963920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:01:20.963920+0000","last_clean_scrub_stamp":"2026-02-18T21:01:20.963920+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T04:27:19.526940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":29,"seq":124554051588,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":276,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":282624,"data_stored":98317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":32370240},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":28,"seq":120259084292,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31904,"kb_used_data":272,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":278528,"data_stored":98298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":32370240},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":27,"seq":115964116996,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":856,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":876544,"data_stored":688685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":32370242},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149700,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":844,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":864256,"data_stored":685095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4543,"internal_metadata":32370241},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-18T21:02:31.580 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-18T21:01:25.969636+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=18, tm_hour=21, tm_min=1, tm_sec=25, tm_wday=2, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=18, tm_hour=21, tm_min=2, tm_sec=29, tm_wday=2, tm_yday=49, tm_isdst=0) 2026-02-18T21:02:31.580 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-18T21:01:25.969636+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=18, tm_hour=21, tm_min=1, tm_sec=25, tm_wday=2, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=18, tm_hour=21, tm_min=2, tm_sec=29, tm_wday=2, tm_yday=49, tm_isdst=0) 2026-02-18T21:02:31.580 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-18T21:01:25.969636+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=18, tm_hour=21, tm_min=1, tm_sec=25, tm_wday=2, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=18, tm_hour=21, tm_min=2, tm_sec=29, tm_wday=2, tm_yday=49, tm_isdst=0) 2026-02-18T21:02:31.580 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-18T21:01:25.969636+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=18, tm_hour=21, tm_min=1, tm_sec=25, tm_wday=2, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=18, tm_hour=21, tm_min=2, tm_sec=29, tm_wday=2, tm_yday=49, tm_isdst=0) 2026-02-18T21:02:31.580 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-18T21:01:25.969636+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=18, tm_hour=21, tm_min=1, tm_sec=25, tm_wday=2, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=18, tm_hour=21, tm_min=2, tm_sec=29, tm_wday=2, tm_yday=49, tm_isdst=0) 2026-02-18T21:02:31.581 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-18T21:01:25.969636+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=18, tm_hour=21, tm_min=1, tm_sec=25, tm_wday=2, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=18, tm_hour=21, tm_min=2, tm_sec=29, tm_wday=2, tm_yday=49, tm_isdst=0) 2026-02-18T21:02:31.581 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-18T21:01:25.969636+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=18, tm_hour=21, tm_min=1, tm_sec=25, tm_wday=2, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=18, tm_hour=21, tm_min=2, tm_sec=29, tm_wday=2, tm_yday=49, tm_isdst=0) 2026-02-18T21:02:31.581 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-18T21:01:25.969636+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=18, tm_hour=21, tm_min=1, tm_sec=25, tm_wday=2, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=18, tm_hour=21, tm_min=2, tm_sec=29, tm_wday=2, tm_yday=49, tm_isdst=0) 2026-02-18T21:02:31.581 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-18T21:01:20.963920+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=18, tm_hour=21, tm_min=1, tm_sec=20, tm_wday=2, tm_yday=49, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=18, tm_hour=21, tm_min=2, tm_sec=29, tm_wday=2, tm_yday=49, tm_isdst=0) 2026-02-18T21:02:31.581 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-18T21:02:51.583 DEBUG:teuthology.orchestra.run.trial068:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-18T21:02:51.655 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.653+0000 7fdd3b185640 1 Processor -- start 2026-02-18T21:02:51.655 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.653+0000 7fdd3b185640 1 -- start start 2026-02-18T21:02:51.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.653+0000 7fdd3b185640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fdd34071400 0x7fdd340717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:51.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.653+0000 7fdd3b185640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fdd34071d20 0x7fdd3412de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:51.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.653+0000 7fdd3b185640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdd3412e340 0x7fdd3412e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:51.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.653+0000 7fdd3b185640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7fdd340731f0 con 0x7fdd34071d20 2026-02-18T21:02:51.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.653+0000 7fdd3b185640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fdd3409e090 con 0x7fdd3412e340 2026-02-18T21:02:51.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.653+0000 7fdd3b185640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fdd34073f90 con 0x7fdd34071400 2026-02-18T21:02:51.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.653+0000 7fdd38efa640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fdd34071400 0x7fdd340717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:51.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.653+0000 7fdd2bfff640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fdd34071d20 0x7fdd3412de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:51.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.653+0000 7fdd396fb640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdd3412e340 0x7fdd3412e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:51.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.653+0000 7fdd2bfff640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7fdd34071d20 0x7fdd3412de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:44420/0 (socket says 10.20.193.68:44420) 2026-02-18T21:02:51.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.653+0000 7fdd2bfff640 1 -- 10.20.193.68:0/1609310454 learned_addr learned my addr 10.20.193.68:0/1609310454 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:51.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.653+0000 7fdd38efa640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fdd34071400 0x7fdd340717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60336/0 (socket says 10.20.193.68:60336) 2026-02-18T21:02:51.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.653+0000 7fdd2bfff640 1 -- 10.20.193.68:0/1609310454 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fdd34071400 msgr2=0x7fdd340717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:51.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.653+0000 7fdd2bfff640 1 --2- 10.20.193.68:0/1609310454 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fdd34071400 0x7fdd340717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:51.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.653+0000 7fdd2bfff640 1 -- 10.20.193.68:0/1609310454 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdd3412e340 msgr2=0x7fdd3412e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:51.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.653+0000 7fdd2bfff640 1 --2- 10.20.193.68:0/1609310454 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdd3412e340 0x7fdd3412e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:51.656 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.653+0000 7fdd2bfff640 1 -- 10.20.193.68:0/1609310454 --> v2:10.20.193.68:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd34072900 con 0x7fdd34071d20 2026-02-18T21:02:51.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.654+0000 7fdd2bfff640 1 --2- 10.20.193.68:0/1609310454 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdd34071d20 0x7fdd3412de00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c009970 tx=0x7fdd1c02eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc6c19c1089dc98 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:51.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.654+0000 7fdd2b7fe640 1 -- 10.20.193.68:0/1609310454 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c03c070 con 0x7fdd34071d20 2026-02-18T21:02:51.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.654+0000 7fdd2b7fe640 1 -- 10.20.193.68:0/1609310454 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd1c02fb60 con 0x7fdd34071d20 2026-02-18T21:02:51.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.654+0000 7fdd2b7fe640 1 -- 10.20.193.68:0/1609310454 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c037440 con 0x7fdd34071d20 2026-02-18T21:02:51.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.654+0000 7fdd3b185640 1 -- 10.20.193.68:0/1609310454 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdd34071d20 msgr2=0x7fdd3412de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:51.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.654+0000 7fdd3b185640 1 --2- 10.20.193.68:0/1609310454 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdd34071d20 0x7fdd3412de00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c009970 tx=0x7fdd1c02eef0 comp rx=0 tx=0).stop 2026-02-18T21:02:51.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.654+0000 7fdd3b185640 1 -- 10.20.193.68:0/1609310454 shutdown_connections 2026-02-18T21:02:51.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.654+0000 7fdd3b185640 1 --2- 10.20.193.68:0/1609310454 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdd3412e340 0x7fdd3412e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:51.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.654+0000 7fdd3b185640 1 --2- 10.20.193.68:0/1609310454 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdd34071d20 0x7fdd3412de00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:51.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.654+0000 7fdd3b185640 1 --2- 10.20.193.68:0/1609310454 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fdd34071400 0x7fdd340717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:51.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.654+0000 7fdd3b185640 1 -- 10.20.193.68:0/1609310454 >> 10.20.193.68:0/1609310454 conn(0x7fdd3409cee0 msgr2=0x7fdd3409d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:51.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.654+0000 7fdd3b185640 1 -- 10.20.193.68:0/1609310454 shutdown_connections 2026-02-18T21:02:51.657 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.654+0000 7fdd3b185640 1 -- 10.20.193.68:0/1609310454 wait complete. 2026-02-18T21:02:51.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd3b185640 1 Processor -- start 2026-02-18T21:02:51.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd3b185640 1 -- start start 2026-02-18T21:02:51.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd3b185640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fdd34071400 0x7fdd34114c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:51.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd3b185640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdd34071d20 0x7fdd34115190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:51.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd3b185640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdd3412e340 0x7fdd341156d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:51.659 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd3b185640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7fdd34072100 con 0x7fdd34071d20 2026-02-18T21:02:51.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd3b185640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7fdd3413ba30 con 0x7fdd3412e340 2026-02-18T21:02:51.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd3b185640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7fdd3413b340 con 0x7fdd34071400 2026-02-18T21:02:51.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd2bfff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdd34071d20 0x7fdd34115190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:51.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd38efa640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fdd34071400 0x7fdd34114c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:51.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd38efa640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fdd34071400 0x7fdd34114c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3302/0 says I am v2:10.20.193.68:60344/0 (socket says 10.20.193.68:60344) 2026-02-18T21:02:51.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd2bfff640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdd34071d20 0x7fdd34115190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:44436/0 (socket says 10.20.193.68:44436) 2026-02-18T21:02:51.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd396fb640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdd3412e340 0x7fdd341156d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:51.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd2bfff640 1 -- 10.20.193.68:0/1278385332 learned_addr learned my addr 10.20.193.68:0/1278385332 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:51.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd396fb640 1 -- 10.20.193.68:0/1278385332 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fdd34071400 msgr2=0x7fdd34114c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:51.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd396fb640 1 --2- 10.20.193.68:0/1278385332 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fdd34071400 0x7fdd34114c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:51.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd396fb640 1 -- 10.20.193.68:0/1278385332 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdd34071d20 msgr2=0x7fdd34115190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:51.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd396fb640 1 --2- 10.20.193.68:0/1278385332 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdd34071d20 0x7fdd34115190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:51.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd396fb640 1 -- 10.20.193.68:0/1278385332 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3413a9e0 con 0x7fdd3412e340 2026-02-18T21:02:51.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd2bfff640 1 --2- 10.20.193.68:0/1278385332 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdd34071d20 0x7fdd34115190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:51.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd396fb640 1 --2- 10.20.193.68:0/1278385332 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdd3412e340 0x7fdd341156d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdd3000efc0 tx=0x7fdd3000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:51.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd297fa640 1 -- 10.20.193.68:0/1278385332 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30018020 con 0x7fdd3412e340 2026-02-18T21:02:51.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd297fa640 1 -- 10.20.193.68:0/1278385332 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd30014480 con 0x7fdd3412e340 2026-02-18T21:02:51.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd3b185640 1 -- 10.20.193.68:0/1278385332 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd34117190 con 0x7fdd3412e340 2026-02-18T21:02:51.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd297fa640 1 -- 10.20.193.68:0/1278385332 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30014870 con 0x7fdd3412e340 2026-02-18T21:02:51.660 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.655+0000 7fdd3b185640 1 -- 10.20.193.68:0/1278385332 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd341cba50 con 0x7fdd3412e340 2026-02-18T21:02:51.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.656+0000 7fdd3b185640 1 -- 10.20.193.68:0/1278385332 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd341317a0 con 0x7fdd3412e340 2026-02-18T21:02:51.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.656+0000 7fdd297fa640 1 -- 10.20.193.68:0/1278385332 <== mon.1 v2:10.20.193.68:3301/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7fdd30014a10 con 0x7fdd3412e340 2026-02-18T21:02:51.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.656+0000 7fdd297fa640 1 -- 10.20.193.68:0/1278385332 <== mon.1 v2:10.20.193.68:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7fdd30067b80 con 0x7fdd3412e340 2026-02-18T21:02:51.661 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.658+0000 7fdd297fa640 1 -- 10.20.193.68:0/1278385332 <== mon.1 v2:10.20.193.68:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7fdd341317a0 con 0x7fdd3412e340 2026-02-18T21:02:51.727 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.726+0000 7fdd3b185640 1 -- 10.20.193.68:0/1278385332 --> v1:10.20.193.68:6816/2904515774 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdd341304d0 con 0x7fdd0404f790 2026-02-18T21:02:51.728 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.727+0000 7fdd297fa640 1 -- 10.20.193.68:0/1278385332 <== mgr.14114 v1:10.20.193.68:6816/2904515774 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31994 (unknown 2965378022 0 3693098169) 0x7fdd341304d0 con 0x7fdd0404f790 2026-02-18T21:02:51.729 INFO:teuthology.orchestra.run.trial068.stdout: 2026-02-18T21:02:51.730 INFO:teuthology.orchestra.run.trial068.stderr:dumped all 2026-02-18T21:02:51.730 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.727+0000 7fdd3b185640 1 -- 10.20.193.68:0/1278385332 >> v1:10.20.193.68:6816/2904515774 conn(0x7fdd0404f790 legacy=0x7fdd04051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:51.730 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.727+0000 7fdd3b185640 1 -- 10.20.193.68:0/1278385332 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdd3412e340 msgr2=0x7fdd341156d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:51.730 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.727+0000 7fdd3b185640 1 --2- 10.20.193.68:0/1278385332 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdd3412e340 0x7fdd341156d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdd3000efc0 tx=0x7fdd3000c490 comp rx=0 tx=0).stop 2026-02-18T21:02:51.730 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.727+0000 7fdd3b185640 1 -- 10.20.193.68:0/1278385332 shutdown_connections 2026-02-18T21:02:51.731 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.727+0000 7fdd3b185640 1 --2- 10.20.193.68:0/1278385332 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7fdd3412e340 0x7fdd341156d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:51.731 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.727+0000 7fdd3b185640 1 --2- 10.20.193.68:0/1278385332 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7fdd34071d20 0x7fdd34115190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:51.731 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.727+0000 7fdd3b185640 1 --2- 10.20.193.68:0/1278385332 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7fdd34071400 0x7fdd34114c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:51.731 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.727+0000 7fdd3b185640 1 -- 10.20.193.68:0/1278385332 >> 10.20.193.68:0/1278385332 conn(0x7fdd3409cee0 msgr2=0x7fdd341342e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:51.731 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.727+0000 7fdd3b185640 1 -- 10.20.193.68:0/1278385332 shutdown_connections 2026-02-18T21:02:51.731 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.727+0000 7fdd3b185640 1 -- 10.20.193.68:0/1278385332 wait complete. 2026-02-18T21:02:51.736 INFO:teuthology.orchestra.run.trial068.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2026-02-18T21:02:51.006135+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":115,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":128752,"kb_used_data":2256,"kb_used_omap":17,"kb_used_meta":126446,"kb_avail":377358608,"statfs":{"total":386547056640,"available":386415214592,"internally_reserved":0,"allocated":2310144,"data_stored":1573958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18173,"internal_metadata":129480963},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001017"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:33.662097+0000","last_change":"2026-02-18T21:02:33.662113+0000","last_active":"2026-02-18T21:02:33.662097+0000","last_peered":"2026-02-18T21:02:33.662097+0000","last_clean":"2026-02-18T21:02:33.662097+0000","last_became_active":"2026-02-18T21:02:21.035326+0000","last_became_peered":"2026-02-18T21:02:21.035326+0000","last_unstale":"2026-02-18T21:02:33.662097+0000","last_undegraded":"2026-02-18T21:02:33.662097+0000","last_fullsized":"2026-02-18T21:02:33.662097+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:02:33.662050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:02:33.662050+0000","last_clean_scrub_stamp":"2026-02-18T21:02:33.662050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T01:49:59.290665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000486527,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:33.443463+0000","last_change":"2026-02-18T21:02:33.443486+0000","last_active":"2026-02-18T21:02:33.443463+0000","last_peered":"2026-02-18T21:02:33.443463+0000","last_clean":"2026-02-18T21:02:33.443463+0000","last_became_active":"2026-02-18T21:02:19.036766+0000","last_became_peered":"2026-02-18T21:02:19.036766+0000","last_unstale":"2026-02-18T21:02:33.443463+0000","last_undegraded":"2026-02-18T21:02:33.443463+0000","last_fullsized":"2026-02-18T21:02:33.443463+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:02:33.443380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:02:33.443380+0000","last_clean_scrub_stamp":"2026-02-18T21:02:33.443380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T01:21:17.236071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018692399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:31.646709+0000","last_change":"2026-02-18T21:02:31.646728+0000","last_active":"2026-02-18T21:02:31.646709+0000","last_peered":"2026-02-18T21:02:31.646709+0000","last_clean":"2026-02-18T21:02:31.646709+0000","last_became_active":"2026-02-18T21:02:21.035120+0000","last_became_peered":"2026-02-18T21:02:21.035120+0000","last_unstale":"2026-02-18T21:02:31.646709+0000","last_undegraded":"2026-02-18T21:02:31.646709+0000","last_fullsized":"2026-02-18T21:02:31.646709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:02:31.646631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:02:31.646631+0000","last_clean_scrub_stamp":"2026-02-18T21:02:31.646631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T07:20:02.133755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044243599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:31.387843+0000","last_change":"2026-02-18T21:02:31.387856+0000","last_active":"2026-02-18T21:02:31.387843+0000","last_peered":"2026-02-18T21:02:31.387843+0000","last_clean":"2026-02-18T21:02:31.387843+0000","last_became_active":"2026-02-18T21:02:19.036530+0000","last_became_peered":"2026-02-18T21:02:19.036530+0000","last_unstale":"2026-02-18T21:02:31.387843+0000","last_undegraded":"2026-02-18T21:02:31.387843+0000","last_fullsized":"2026-02-18T21:02:31.387843+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:02:31.387780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:02:31.387780+0000","last_clean_scrub_stamp":"2026-02-18T21:02:31.387780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T02:46:02.319890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020214300000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"33'3","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:35.640233+0000","last_change":"2026-02-18T21:02:35.640251+0000","last_active":"2026-02-18T21:02:35.640233+0000","last_peered":"2026-02-18T21:02:35.640233+0000","last_clean":"2026-02-18T21:02:35.640233+0000","last_became_active":"2026-02-18T21:02:21.036142+0000","last_became_peered":"2026-02-18T21:02:21.036142+0000","last_unstale":"2026-02-18T21:02:35.640233+0000","last_undegraded":"2026-02-18T21:02:35.640233+0000","last_fullsized":"2026-02-18T21:02:35.640233+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2026-02-18T21:02:35.640202+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2026-02-18T21:02:35.640202+0000","last_clean_scrub_stamp":"2026-02-18T21:02:35.640202+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T23:29:19.354233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036890000000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:31.650096+0000","last_change":"2026-02-18T21:02:31.650113+0000","last_active":"2026-02-18T21:02:31.650096+0000","last_peered":"2026-02-18T21:02:31.650096+0000","last_clean":"2026-02-18T21:02:31.650096+0000","last_became_active":"2026-02-18T21:02:21.035305+0000","last_became_peered":"2026-02-18T21:02:21.035305+0000","last_unstale":"2026-02-18T21:02:31.650096+0000","last_undegraded":"2026-02-18T21:02:31.650096+0000","last_fullsized":"2026-02-18T21:02:31.650096+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:02:31.650034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:02:31.650034+0000","last_clean_scrub_stamp":"2026-02-18T21:02:31.650034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T02:16:22.756633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00021428500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:34.662634+0000","last_change":"2026-02-18T21:02:34.662650+0000","last_active":"2026-02-18T21:02:34.662634+0000","last_peered":"2026-02-18T21:02:34.662634+0000","last_clean":"2026-02-18T21:02:34.662634+0000","last_became_active":"2026-02-18T21:02:21.035916+0000","last_became_peered":"2026-02-18T21:02:21.035916+0000","last_unstale":"2026-02-18T21:02:34.662634+0000","last_undegraded":"2026-02-18T21:02:34.662634+0000","last_fullsized":"2026-02-18T21:02:34.662634+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-18T21:02:34.662584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-18T21:02:34.662584+0000","last_clean_scrub_stamp":"2026-02-18T21:02:34.662584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T02:07:59.922399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00017934099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"33'2","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:32.627721+0000","last_change":"2026-02-18T21:02:32.627734+0000","last_active":"2026-02-18T21:02:32.627721+0000","last_peered":"2026-02-18T21:02:32.627721+0000","last_clean":"2026-02-18T21:02:32.627721+0000","last_became_active":"2026-02-18T21:02:21.035231+0000","last_became_peered":"2026-02-18T21:02:21.035231+0000","last_unstale":"2026-02-18T21:02:32.627721+0000","last_undegraded":"2026-02-18T21:02:32.627721+0000","last_fullsized":"2026-02-18T21:02:32.627721+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'2","last_scrub_stamp":"2026-02-18T21:02:32.627667+0000","last_deep_scrub":"33'2","last_deep_scrub_stamp":"2026-02-18T21:02:32.627667+0000","last_clean_scrub_stamp":"2026-02-18T21:02:32.627667+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T07:56:31.873912+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.000176987,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"33'80","reported_seq":166,"reported_epoch":33,"state":"active+clean","last_fresh":"2026-02-18T21:02:32.396364+0000","last_change":"2026-02-18T21:02:32.396378+0000","last_active":"2026-02-18T21:02:32.396364+0000","last_peered":"2026-02-18T21:02:32.396364+0000","last_clean":"2026-02-18T21:02:32.396364+0000","last_became_active":"2026-02-18T21:02:19.036727+0000","last_became_peered":"2026-02-18T21:02:19.036727+0000","last_unstale":"2026-02-18T21:02:32.396364+0000","last_undegraded":"2026-02-18T21:02:32.396364+0000","last_fullsized":"2026-02-18T21:02:32.396364+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'80","last_scrub_stamp":"2026-02-18T21:02:32.396333+0000","last_deep_scrub":"33'80","last_deep_scrub_stamp":"2026-02-18T21:02:32.396333+0000","last_clean_scrub_stamp":"2026-02-18T21:02:32.396333+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-20T01:42:03.142471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":29,"seq":124554051592,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31900,"kb_used_data":276,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339940,"statfs":{"total":96636764160,"available":96604098560,"internally_reserved":0,"allocated":282624,"data_stored":98317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":32370240},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":28,"seq":120259084296,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31896,"kb_used_data":272,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339944,"statfs":{"total":96636764160,"available":96604102656,"internally_reserved":0,"allocated":278528,"data_stored":98298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4544,"internal_metadata":32370240},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":27,"seq":115964117000,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32480,"kb_used_data":856,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":876544,"data_stored":688685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4542,"internal_metadata":32370242},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":26,"seq":111669149704,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":852,"kb_used_omap":4,"kb_used_meta":31611,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":872448,"data_stored":688658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4543,"internal_metadata":32370241},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-18T21:02:51.738 DEBUG:teuthology.orchestra.run.trial068:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-18T21:02:51.806 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.803+0000 7f14796ac640 1 Processor -- start 2026-02-18T21:02:51.806 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.803+0000 7f14796ac640 1 -- start start 2026-02-18T21:02:51.806 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.803+0000 7f14796ac640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f14741311a0 0x7f1474133590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:51.806 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.803+0000 7f14796ac640 1 --2- >> v2:10.20.193.68:3300/0 conn(0x7f1474133ad0 0x7f1474135ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:51.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.803+0000 7f14796ac640 1 -- --> v1:10.20.193.68:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14740741e0 con 0x7f147412add0 2026-02-18T21:02:51.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.803+0000 7f14796ac640 1 -- --> v2:10.20.193.68:3300/0 -- mon_getmap magic: 0 -- 0x7f1474073080 con 0x7f1474133ad0 2026-02-18T21:02:51.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.803+0000 7f14796ac640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f1474073f40 con 0x7f14741311a0 2026-02-18T21:02:51.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.803+0000 7f1472ffd640 1 --1- >> v1:10.20.193.68:6789/0 conn(0x7f147412add0 0x7f147412b1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.68:6789/0 says I am v1:10.20.193.68:34600/0 (socket says 10.20.193.68:34600) 2026-02-18T21:02:51.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.803+0000 7f1472ffd640 1 -- 10.20.193.68:0/4032271708 learned_addr learned my addr 10.20.193.68:0/4032271708 (peer_addr_for_me v1:10.20.193.68:0/0) 2026-02-18T21:02:51.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.803+0000 7f14727fc640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f14741311a0 0x7f1474133590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:51.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.803+0000 7f14737fe640 1 --2- 10.20.193.68:0/4032271708 >> v2:10.20.193.68:3300/0 conn(0x7f1474133ad0 0x7f1474135ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:51.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.803+0000 7f1471ffb640 1 -- 10.20.193.68:0/4032271708 <== mon.0 v1:10.20.193.68:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 104848542 0 0) 0x7f14740741e0 con 0x7f147412add0 2026-02-18T21:02:51.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.803+0000 7f1471ffb640 1 -- 10.20.193.68:0/4032271708 --> v1:10.20.193.68:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1460003620 con 0x7f147412add0 2026-02-18T21:02:51.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.803+0000 7f14727fc640 1 -- 10.20.193.68:0/4032271708 >> v2:10.20.193.68:3300/0 conn(0x7f1474133ad0 msgr2=0x7f1474135ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-18T21:02:51.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.803+0000 7f14727fc640 1 --2- 10.20.193.68:0/4032271708 >> v2:10.20.193.68:3300/0 conn(0x7f1474133ad0 0x7f1474135ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:51.807 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.803+0000 7f14727fc640 1 -- 10.20.193.68:0/4032271708 >> v1:10.20.193.68:6789/0 conn(0x7f147412add0 legacy=0x7f147412b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:51.808 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.803+0000 7f14727fc640 1 -- 10.20.193.68:0/4032271708 --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147412ab60 con 0x7f14741311a0 2026-02-18T21:02:51.808 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.804+0000 7f14727fc640 1 --2- 10.20.193.68:0/4032271708 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f14741311a0 0x7f1474133590 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f145c0098a0 tx=0x7f145c02ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d0cc6260f187116 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:51.808 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.804+0000 7f1471ffb640 1 -- 10.20.193.68:0/4032271708 <== mon.1 v2:10.20.193.68:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c03c070 con 0x7f14741311a0 2026-02-18T21:02:51.808 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.804+0000 7f1471ffb640 1 -- 10.20.193.68:0/4032271708 <== mon.1 v2:10.20.193.68:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f145c02fa40 con 0x7f14741311a0 2026-02-18T21:02:51.808 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.804+0000 7f1471ffb640 1 -- 10.20.193.68:0/4032271708 <== mon.1 v2:10.20.193.68:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c02fe10 con 0x7f14741311a0 2026-02-18T21:02:51.808 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.804+0000 7f14796ac640 1 -- 10.20.193.68:0/4032271708 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f14741311a0 msgr2=0x7f1474133590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:51.808 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.804+0000 7f14796ac640 1 --2- 10.20.193.68:0/4032271708 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f14741311a0 0x7f1474133590 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f145c0098a0 tx=0x7f145c02ed80 comp rx=0 tx=0).stop 2026-02-18T21:02:51.808 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.804+0000 7f14796ac640 1 -- 10.20.193.68:0/4032271708 shutdown_connections 2026-02-18T21:02:51.808 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.804+0000 7f14796ac640 1 --2- 10.20.193.68:0/4032271708 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f14741311a0 0x7f1474133590 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:51.808 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.804+0000 7f14796ac640 1 --2- 10.20.193.68:0/4032271708 >> v2:10.20.193.68:3300/0 conn(0x7f1474133ad0 0x7f1474135ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:51.808 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.804+0000 7f14796ac640 1 -- 10.20.193.68:0/4032271708 >> 10.20.193.68:0/4032271708 conn(0x7f147409cb30 msgr2=0x7f147409cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:51.808 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.804+0000 7f14796ac640 1 -- 10.20.193.68:0/4032271708 shutdown_connections 2026-02-18T21:02:51.809 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.804+0000 7f14796ac640 1 -- 10.20.193.68:0/4032271708 wait complete. 2026-02-18T21:02:51.809 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f14796ac640 1 Processor -- start 2026-02-18T21:02:51.809 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f14796ac640 1 -- start start 2026-02-18T21:02:51.811 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f14796ac640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f147412add0 0x7f147412e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:51.811 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f14796ac640 1 --2- >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f14741311a0 0x7f147412e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:51.811 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f14796ac640 1 --2- >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1474133ad0 0x7f1474126e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-18T21:02:51.811 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f14796ac640 1 -- --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_getmap magic: 0 -- 0x7f14740737b0 con 0x7f147412add0 2026-02-18T21:02:51.811 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f14796ac640 1 -- --> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] -- mon_getmap magic: 0 -- 0x7f1474073630 con 0x7f1474133ad0 2026-02-18T21:02:51.812 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f14796ac640 1 -- --> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] -- mon_getmap magic: 0 -- 0x7f1474136400 con 0x7f14741311a0 2026-02-18T21:02:51.812 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f1472ffd640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f147412add0 0x7f147412e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:51.812 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f1472ffd640 1 --2- >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f147412add0 0x7f147412e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.68:3300/0 says I am v2:10.20.193.68:44454/0 (socket says 10.20.193.68:44454) 2026-02-18T21:02:51.812 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f1472ffd640 1 -- 10.20.193.68:0/1695649653 learned_addr learned my addr 10.20.193.68:0/1695649653 (peer_addr_for_me v2:10.20.193.68:0/0) 2026-02-18T21:02:51.812 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f14727fc640 1 --2- 10.20.193.68:0/1695649653 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f14741311a0 0x7f147412e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:51.812 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f14737fe640 1 --2- 10.20.193.68:0/1695649653 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1474133ad0 0x7f1474126e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-18T21:02:51.812 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f1472ffd640 1 -- 10.20.193.68:0/1695649653 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f14741311a0 msgr2=0x7f147412e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:51.812 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f1472ffd640 1 --2- 10.20.193.68:0/1695649653 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f14741311a0 0x7f147412e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:51.812 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f1472ffd640 1 -- 10.20.193.68:0/1695649653 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1474133ad0 msgr2=0x7f1474126e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:51.812 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f1472ffd640 1 --2- 10.20.193.68:0/1695649653 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1474133ad0 0x7f1474126e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:51.812 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f1472ffd640 1 -- 10.20.193.68:0/1695649653 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1474116470 con 0x7f147412add0 2026-02-18T21:02:51.812 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f14737fe640 1 --2- 10.20.193.68:0/1695649653 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1474133ad0 0x7f1474126e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-18T21:02:51.813 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f1472ffd640 1 --2- 10.20.193.68:0/1695649653 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f147412add0 0x7f147412e160 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f146800c730 tx=0x7f146800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-18T21:02:51.813 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f14537fe640 1 -- 10.20.193.68:0/1695649653 <== mon.0 v2:10.20.193.68:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1468017070 con 0x7f147412add0 2026-02-18T21:02:51.813 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f14537fe640 1 -- 10.20.193.68:0/1695649653 <== mon.0 v2:10.20.193.68:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1468005bb0 con 0x7f147412add0 2026-02-18T21:02:51.813 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.805+0000 7f14796ac640 1 -- 10.20.193.68:0/1695649653 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14741285e0 con 0x7f147412add0 2026-02-18T21:02:51.813 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.806+0000 7f14537fe640 1 -- 10.20.193.68:0/1695649653 <== mon.0 v2:10.20.193.68:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1468007070 con 0x7f147412add0 2026-02-18T21:02:51.813 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.806+0000 7f14796ac640 1 -- 10.20.193.68:0/1695649653 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1474115be0 con 0x7f147412add0 2026-02-18T21:02:51.813 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.806+0000 7f14796ac640 1 -- 10.20.193.68:0/1695649653 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f147412b1b0 con 0x7f147412add0 2026-02-18T21:02:51.813 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.806+0000 7f14537fe640 1 -- 10.20.193.68:0/1695649653 <== mon.0 v2:10.20.193.68:3300/0 4 ==== mgrmap(e 10) ==== 62057+0+0 (secure 0 0 0) 0x7f1468007210 con 0x7f147412add0 2026-02-18T21:02:51.813 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.807+0000 7f14537fe640 1 -- 10.20.193.68:0/1695649653 <== mon.0 v2:10.20.193.68:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 3025+0+0 (secure 0 0 0) 0x7f14680661d0 con 0x7f147412add0 2026-02-18T21:02:51.813 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.809+0000 7f14537fe640 1 -- 10.20.193.68:0/1695649653 <== mon.0 v2:10.20.193.68:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+156997 (secure 0 0 0) 0x7f1474116470 con 0x7f147412add0 2026-02-18T21:02:51.879 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.878+0000 7f14796ac640 1 -- 10.20.193.68:0/1695649653 --> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f1474069820 con 0x7f147412add0 2026-02-18T21:02:51.881 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.880+0000 7f14537fe640 1 -- 10.20.193.68:0/1695649653 <== mon.0 v2:10.20.193.68:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f146803ffc0 con 0x7f147412add0 2026-02-18T21:02:51.881 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.880+0000 7f14537fe640 1 -- 10.20.193.68:0/1695649653 <== mon.0 v2:10.20.193.68:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1468065280 con 0x7f147412add0 2026-02-18T21:02:51.883 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.881+0000 7f14796ac640 1 -- 10.20.193.68:0/1695649653 >> v1:10.20.193.68:6816/2904515774 conn(0x7f144004f7c0 legacy=0x7f1440051c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:51.883 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.881+0000 7f14796ac640 1 -- 10.20.193.68:0/1695649653 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f147412add0 msgr2=0x7f147412e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-18T21:02:51.883 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.881+0000 7f14796ac640 1 --2- 10.20.193.68:0/1695649653 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f147412add0 0x7f147412e160 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f146800c730 tx=0x7f146800cc00 comp rx=0 tx=0).stop 2026-02-18T21:02:51.883 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.881+0000 7f14796ac640 1 -- 10.20.193.68:0/1695649653 shutdown_connections 2026-02-18T21:02:51.883 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.881+0000 7f14796ac640 1 --2- 10.20.193.68:0/1695649653 >> [v2:10.20.193.68:3301/0,v1:10.20.193.68:6790/0] conn(0x7f1474133ad0 0x7f1474126e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:51.883 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.881+0000 7f14796ac640 1 --2- 10.20.193.68:0/1695649653 >> [v2:10.20.193.68:3302/0,v1:10.20.193.68:6791/0] conn(0x7f14741311a0 0x7f147412e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:51.883 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.881+0000 7f14796ac640 1 --2- 10.20.193.68:0/1695649653 >> [v2:10.20.193.68:3300/0,v1:10.20.193.68:6789/0] conn(0x7f147412add0 0x7f147412e160 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-18T21:02:51.883 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.881+0000 7f14796ac640 1 -- 10.20.193.68:0/1695649653 >> 10.20.193.68:0/1695649653 conn(0x7f147409cb30 msgr2=0x7f147406f020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-18T21:02:51.883 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.881+0000 7f14796ac640 1 -- 10.20.193.68:0/1695649653 shutdown_connections 2026-02-18T21:02:51.883 INFO:teuthology.orchestra.run.trial068.stderr:2026-02-18T21:02:51.881+0000 7f14796ac640 1 -- 10.20.193.68:0/1695649653 wait complete. 2026-02-18T21:02:51.890 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-18T21:02:51.890 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-18T21:02:51.891 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-18T21:02:51.891 INFO:teuthology.orchestra.run:waiting for 300 2026-02-18T21:02:51.932 INFO:tasks.ceph.osd.0:Stopped 2026-02-18T21:02:51.932 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-18T21:02:51.932 INFO:teuthology.orchestra.run:waiting for 300 2026-02-18T21:02:51.968 INFO:tasks.ceph.osd.1:Stopped 2026-02-18T21:02:51.968 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-18T21:02:51.968 INFO:teuthology.orchestra.run:waiting for 300 2026-02-18T21:02:52.039 INFO:tasks.ceph.osd.2:Stopped 2026-02-18T21:02:52.039 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-18T21:02:52.040 INFO:teuthology.orchestra.run:waiting for 300 2026-02-18T21:02:52.115 INFO:tasks.ceph.osd.3:Stopped 2026-02-18T21:02:52.116 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-18T21:02:52.116 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-18T21:02:52.116 INFO:teuthology.orchestra.run:waiting for 300 2026-02-18T21:02:52.178 INFO:tasks.ceph.mgr.x:Stopped 2026-02-18T21:02:52.178 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-18T21:02:52.178 INFO:teuthology.orchestra.run:waiting for 300 2026-02-18T21:02:52.238 INFO:tasks.ceph.mgr.y:Stopped 2026-02-18T21:02:52.238 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-18T21:02:52.239 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-18T21:02:52.239 INFO:teuthology.orchestra.run:waiting for 300 2026-02-18T21:02:52.287 INFO:tasks.ceph.mon.a:Stopped 2026-02-18T21:02:52.288 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-18T21:02:52.288 INFO:teuthology.orchestra.run:waiting for 300 2026-02-18T21:02:52.339 INFO:tasks.ceph.mon.b:Stopped 2026-02-18T21:02:52.340 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-18T21:02:52.340 INFO:teuthology.orchestra.run:waiting for 300 2026-02-18T21:02:52.389 INFO:tasks.ceph.mon.c:Stopped 2026-02-18T21:02:52.389 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-18T21:02:52.390 DEBUG:teuthology.orchestra.run.trial068:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v 'is offline because no MDS' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v MGR_MODULE_ERROR | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'pg .* is stuck inactive' | egrep -v 'pg .* is .*degraded' | egrep -v 'pg .* is stuck peering' | egrep -v 'scrub mismatch' | egrep -v ScrubResult | egrep -v 'wrongly marked' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_MSGR2_NOT_ENABLED\)' | egrep -v 'slow request' | head -n 1 2026-02-18T21:02:52.458 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial068.front.sepia.ceph.com 2026-02-18T21:02:52.458 DEBUG:teuthology.orchestra.run.trial068:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-18T21:02:52.528 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial068.front.sepia.ceph.com 2026-02-18T21:02:52.528 DEBUG:teuthology.orchestra.run.trial068:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-18T21:02:52.599 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial068.front.sepia.ceph.com 2026-02-18T21:02:52.599 DEBUG:teuthology.orchestra.run.trial068:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-18T21:02:52.672 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial068.front.sepia.ceph.com 2026-02-18T21:02:52.673 DEBUG:teuthology.orchestra.run.trial068:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-18T21:02:52.742 INFO:tasks.ceph:Archiving mon data... 2026-02-18T21:02:52.744 DEBUG:teuthology.misc:Transferring archived files from trial068:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:34:58-fs-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53280/data/mon.a.tgz 2026-02-18T21:02:52.744 DEBUG:teuthology.orchestra.run.trial068:> mktemp 2026-02-18T21:02:52.799 INFO:teuthology.orchestra.run.trial068.stdout:/tmp/tmp.s0Kje4RIDS 2026-02-18T21:02:52.799 DEBUG:teuthology.orchestra.run.trial068:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.s0Kje4RIDS 2026-02-18T21:02:52.891 DEBUG:teuthology.orchestra.run.trial068:> sudo chmod 0666 /tmp/tmp.s0Kje4RIDS 2026-02-18T21:02:52.973 DEBUG:teuthology.orchestra.remote:trial068:/tmp/tmp.s0Kje4RIDS is 220KB 2026-02-18T21:02:53.067 DEBUG:teuthology.orchestra.run.trial068:> rm -fr /tmp/tmp.s0Kje4RIDS 2026-02-18T21:02:53.085 DEBUG:teuthology.misc:Transferring archived files from trial068:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:34:58-fs-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53280/data/mon.b.tgz 2026-02-18T21:02:53.085 DEBUG:teuthology.orchestra.run.trial068:> mktemp 2026-02-18T21:02:53.140 INFO:teuthology.orchestra.run.trial068.stdout:/tmp/tmp.UxzlJCCNjh 2026-02-18T21:02:53.141 DEBUG:teuthology.orchestra.run.trial068:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.UxzlJCCNjh 2026-02-18T21:02:53.237 DEBUG:teuthology.orchestra.run.trial068:> sudo chmod 0666 /tmp/tmp.UxzlJCCNjh 2026-02-18T21:02:53.318 DEBUG:teuthology.orchestra.remote:trial068:/tmp/tmp.UxzlJCCNjh is 267KB 2026-02-18T21:02:53.382 DEBUG:teuthology.orchestra.run.trial068:> rm -fr /tmp/tmp.UxzlJCCNjh 2026-02-18T21:02:53.398 DEBUG:teuthology.misc:Transferring archived files from trial068:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:34:58-fs-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53280/data/mon.c.tgz 2026-02-18T21:02:53.398 DEBUG:teuthology.orchestra.run.trial068:> mktemp 2026-02-18T21:02:53.453 INFO:teuthology.orchestra.run.trial068.stdout:/tmp/tmp.cDDG0u0DpD 2026-02-18T21:02:53.454 DEBUG:teuthology.orchestra.run.trial068:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.cDDG0u0DpD 2026-02-18T21:02:53.550 DEBUG:teuthology.orchestra.run.trial068:> sudo chmod 0666 /tmp/tmp.cDDG0u0DpD 2026-02-18T21:02:53.630 DEBUG:teuthology.orchestra.remote:trial068:/tmp/tmp.cDDG0u0DpD is 267KB 2026-02-18T21:02:53.691 DEBUG:teuthology.orchestra.run.trial068:> rm -fr /tmp/tmp.cDDG0u0DpD 2026-02-18T21:02:53.709 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-18T21:02:53.709 DEBUG:teuthology.orchestra.run.trial068:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-18T21:02:53.831 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-18T21:02:53.831 INFO:tasks.ceph:Archiving crash dumps... 2026-02-18T21:02:53.833 DEBUG:teuthology.misc:Transferring archived files from trial068:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:34:58-fs-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53280/remote/trial068/crash 2026-02-18T21:02:53.834 DEBUG:teuthology.orchestra.run.trial068:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-18T21:02:53.895 INFO:tasks.ceph:Compressing logs... 2026-02-18T21:02:53.895 DEBUG:teuthology.orchestra.run.trial068:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T21:02:53.998 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37991.log 2026-02-18T21:02:53.998 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37506.log 2026-02-18T21:02:53.998 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.37991.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-18T21:02:53.998 INFO:teuthology.orchestra.run.trial068.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37991.log.gz 2026-02-18T21:02:53.999 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29980.log 2026-02-18T21:02:53.999 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.37506.log: /var/log/ceph/ceph-osd.2.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37506.log.gz 2026-02-18T21:02:53.999 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-18T21:02:53.999 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.29980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31738.log 2026-02-18T21:02:53.999 INFO:teuthology.orchestra.run.trial068.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29980.log.gz 2026-02-18T21:02:53.999 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31989.log 2026-02-18T21:02:53.999 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.31738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31741.log 2026-02-18T21:02:53.999 INFO:teuthology.orchestra.run.trial068.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31738.log.gz 2026-02-18T21:02:53.999 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.31989.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-18T21:02:53.999 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.31741.log: gzip -5 --verbose 89.2% -- /var/log/ceph/ceph-client.admin.24982.log -- replaced with /var/log/ceph/ceph-client.admin.31989.log.gz 2026-02-18T21:02:53.999 INFO:teuthology.orchestra.run.trial068.stderr: 2026-02-18T21:02:53.999 INFO:teuthology.orchestra.run.trial068.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31741.log.gz 2026-02-18T21:02:53.999 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31545.log 2026-02-18T21:02:54.000 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.24982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36668.log 2026-02-18T21:02:54.000 INFO:teuthology.orchestra.run.trial068.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.24982.log.gz 2026-02-18T21:02:54.000 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2026-02-18T21:02:54.000 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.31545.log: /var/log/ceph/ceph-client.admin.36668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32388.log 2026-02-18T21:02:54.000 INFO:teuthology.orchestra.run.trial068.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31545.log.gz 2026-02-18T21:02:54.000 INFO:teuthology.orchestra.run.trial068.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36668.log.gz 2026-02-18T21:02:54.000 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29226.log 2026-02-18T21:02:54.000 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-18T21:02:54.000 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.32388.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.32388.log.gz 2026-02-18T21:02:54.000 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.29226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25297.log 2026-02-18T21:02:54.000 INFO:teuthology.orchestra.run.trial068.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.29226.log.gz 2026-02-18T21:02:54.000 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25029.log 2026-02-18T21:02:54.000 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36622.log 2026-02-18T21:02:54.000 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.25297.log: /var/log/ceph/ceph-client.admin.25029.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.25297.log.gz 2026-02-18T21:02:54.000 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29591.log 2026-02-18T21:02:54.001 INFO:teuthology.orchestra.run.trial068.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.25029.log.gz 2026-02-18T21:02:54.001 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.36622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38138.log 2026-02-18T21:02:54.001 INFO:teuthology.orchestra.run.trial068.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36622.log.gz 2026-02-18T21:02:54.001 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.29591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29423.log 2026-02-18T21:02:54.001 INFO:teuthology.orchestra.run.trial068.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29591.log.gz 2026-02-18T21:02:54.001 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29000.log 2026-02-18T21:02:54.001 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.38138.log: /var/log/ceph/ceph-client.admin.29423.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38138.log.gz 2026-02-18T21:02:54.001 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29592.log 2026-02-18T21:02:54.001 INFO:teuthology.orchestra.run.trial068.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2026-02-18T21:02:54.001 INFO:teuthology.orchestra.run.trial068.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29423.log.gz 2026-02-18T21:02:54.001 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.29000.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-18T21:02:54.001 INFO:teuthology.orchestra.run.trial068.stderr: 87.7%/var/log/ceph/ceph-client.admin.29592.log: -- replaced with /var/log/ceph/ceph-client.admin.29000.log.gz 2026-02-18T21:02:54.001 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32623.log 2026-02-18T21:02:54.001 INFO:teuthology.orchestra.run.trial068.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29592.log.gz 2026-02-18T21:02:54.001 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30076.log 2026-02-18T21:02:54.001 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.32623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31366.log 2026-02-18T21:02:54.002 INFO:teuthology.orchestra.run.trial068.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32623.log.gz 2026-02-18T21:02:54.002 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.30076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37139.log 2026-02-18T21:02:54.002 INFO:teuthology.orchestra.run.trial068.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30076.log.gz 2026-02-18T21:02:54.002 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.31366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37844.log 2026-02-18T21:02:54.002 INFO:teuthology.orchestra.run.trial068.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31366.log.gz 2026-02-18T21:02:54.002 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.37139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31739.log 2026-02-18T21:02:54.002 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.37844.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37139.log.gz 2026-02-18T21:02:54.002 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37893.log 2026-02-18T21:02:54.002 INFO:teuthology.orchestra.run.trial068.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37844.log.gz 2026-02-18T21:02:54.002 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.31739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31987.log 2026-02-18T21:02:54.002 INFO:teuthology.orchestra.run.trial068.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31739.log.gz 2026-02-18T21:02:54.002 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.37893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36527.log 2026-02-18T21:02:54.002 INFO:teuthology.orchestra.run.trial068.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37893.log.gz 2026-02-18T21:02:54.002 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.31987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37504.log 2026-02-18T21:02:54.002 INFO:teuthology.orchestra.run.trial068.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31987.log.gz 2026-02-18T21:02:54.002 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.36527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29227.log 2026-02-18T21:02:54.003 INFO:teuthology.orchestra.run.trial068.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36527.log.gz 2026-02-18T21:02:54.003 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.37504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31544.log 2026-02-18T21:02:54.003 INFO:teuthology.orchestra.run.trial068.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37504.log.gz 2026-02-18T21:02:54.003 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.29227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37141.log 2026-02-18T21:02:54.003 INFO:teuthology.orchestra.run.trial068.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29227.log.gz 2026-02-18T21:02:54.003 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.31544.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.18315.log 2026-02-18T21:02:54.003 INFO:teuthology.orchestra.run.trial068.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31544.log.gz 2026-02-18T21:02:54.003 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.37141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28935.log 2026-02-18T21:02:54.003 INFO:teuthology.orchestra.run.trial068.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37141.log.gz 2026-02-18T21:02:54.003 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph.tmp-client.admin.18315.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.18315.log.gz 2026-02-18T21:02:54.003 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38479.log 2026-02-18T21:02:54.003 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.28935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38383.log 2026-02-18T21:02:54.003 INFO:teuthology.orchestra.run.trial068.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.28935.log.gz 2026-02-18T21:02:54.003 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.38479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32306.log 2026-02-18T21:02:54.003 INFO:teuthology.orchestra.run.trial068.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38479.log.gz 2026-02-18T21:02:54.003 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.38383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32927.log 2026-02-18T21:02:54.003 INFO:teuthology.orchestra.run.trial068.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38383.log.gz 2026-02-18T21:02:54.004 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.32306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37336.log 2026-02-18T21:02:54.004 INFO:teuthology.orchestra.run.trial068.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32306.log.gz 2026-02-18T21:02:54.004 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.32927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38040.log 2026-02-18T21:02:54.004 INFO:teuthology.orchestra.run.trial068.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32927.log.gz 2026-02-18T21:02:54.004 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.37336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31285.log 2026-02-18T21:02:54.004 INFO:teuthology.orchestra.run.trial068.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37336.log.gz 2026-02-18T21:02:54.004 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.38040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29225.log 2026-02-18T21:02:54.004 INFO:teuthology.orchestra.run.trial068.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38040.log.gz 2026-02-18T21:02:54.004 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.31285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29049.log 2026-02-18T21:02:54.004 INFO:teuthology.orchestra.run.trial068.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31285.log.gz 2026-02-18T21:02:54.004 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.29225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33499.log 2026-02-18T21:02:54.004 INFO:teuthology.orchestra.run.trial068.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.29225.log.gz 2026-02-18T21:02:54.004 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.29049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36717.log 2026-02-18T21:02:54.004 INFO:teuthology.orchestra.run.trial068.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29049.log.gz 2026-02-18T21:02:54.004 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.33499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32157.log 2026-02-18T21:02:54.004 INFO:teuthology.orchestra.run.trial068.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33499.log.gz 2026-02-18T21:02:54.004 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.36717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29424.log 2026-02-18T21:02:54.005 INFO:teuthology.orchestra.run.trial068.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36717.log.gz 2026-02-18T21:02:54.005 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.32157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24606.log 2026-02-18T21:02:54.005 INFO:teuthology.orchestra.run.trial068.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32157.log.gz 2026-02-18T21:02:54.005 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.29424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29228.log 2026-02-18T21:02:54.005 INFO:teuthology.orchestra.run.trial068.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29424.log.gz 2026-02-18T21:02:54.005 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.24606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37138.log 2026-02-18T21:02:54.005 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.29228.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.24606.log.gz 2026-02-18T21:02:54.005 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36945.log 2026-02-18T21:02:54.005 INFO:teuthology.orchestra.run.trial068.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.29228.log.gz 2026-02-18T21:02:54.005 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.37138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30029.log 2026-02-18T21:02:54.005 INFO:teuthology.orchestra.run.trial068.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37138.log.gz 2026-02-18T21:02:54.005 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.36945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36574.log 2026-02-18T21:02:54.005 INFO:teuthology.orchestra.run.trial068.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36945.log.gz 2026-02-18T21:02:54.005 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.30029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36645.log 2026-02-18T21:02:54.005 INFO:teuthology.orchestra.run.trial068.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30029.log.gz 2026-02-18T21:02:54.005 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.36574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32155.log 2026-02-18T21:02:54.005 INFO:teuthology.orchestra.run.trial068.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36574.log.gz 2026-02-18T21:02:54.005 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.36645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29098.log 2026-02-18T21:02:54.006 INFO:teuthology.orchestra.run.trial068.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36645.log.gz 2026-02-18T21:02:54.006 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.32155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28840.log 2026-02-18T21:02:54.006 INFO:teuthology.orchestra.run.trial068.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32155.log.gz 2026-02-18T21:02:54.006 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.29098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31542.log 2026-02-18T21:02:54.006 INFO:teuthology.orchestra.run.trial068.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29098.log.gz 2026-02-18T21:02:54.006 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.28840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38187.log 2026-02-18T21:02:54.006 INFO:teuthology.orchestra.run.trial068.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28840.log.gz 2026-02-18T21:02:54.006 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.31542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25182.log 2026-02-18T21:02:54.006 INFO:teuthology.orchestra.run.trial068.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31542.log.gz 2026-02-18T21:02:54.006 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.38187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37334.log 2026-02-18T21:02:54.006 INFO:teuthology.orchestra.run.trial068.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38187.log.gz 2026-02-18T21:02:54.006 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.25182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36433.log 2026-02-18T21:02:54.006 INFO:teuthology.orchestra.run.trial068.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.25182.log.gz 2026-02-18T21:02:54.006 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.37334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32083.log 2026-02-18T21:02:54.006 INFO:teuthology.orchestra.run.trial068.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37334.log.gz 2026-02-18T21:02:54.006 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.36433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37140.log 2026-02-18T21:02:54.006 INFO:teuthology.orchestra.run.trial068.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36433.log.gz 2026-02-18T21:02:54.006 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.32083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29650.log 2026-02-18T21:02:54.007 INFO:teuthology.orchestra.run.trial068.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32083.log.gz 2026-02-18T21:02:54.007 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.37140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37648.log 2026-02-18T21:02:54.007 INFO:teuthology.orchestra.run.trial068.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37140.log.gz 2026-02-18T21:02:54.007 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.29650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38236.log 2026-02-18T21:02:54.007 INFO:teuthology.orchestra.run.trial068.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29650.log.gz 2026-02-18T21:02:54.007 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.37648.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-18T21:02:54.007 INFO:teuthology.orchestra.run.trial068.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37648.log.gz 2026-02-18T21:02:54.007 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.38236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28725.log 2026-02-18T21:02:54.007 INFO:teuthology.orchestra.run.trial068.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38236.log.gz 2026-02-18T21:02:54.007 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-18T21:02:54.007 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.28725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37942.log 2026-02-18T21:02:54.007 INFO:teuthology.orchestra.run.trial068.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-18T21:02:54.007 INFO:teuthology.orchestra.run.trial068.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28725.log.gz 2026-02-18T21:02:54.007 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30123.log 2026-02-18T21:02:54.007 INFO:teuthology.orchestra.run.trial068.stderr: 94.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-18T21:02:54.007 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.37942.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-18T21:02:54.007 INFO:teuthology.orchestra.run.trial068.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37942.log.gz 2026-02-18T21:02:54.007 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.30123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29855.log 2026-02-18T21:02:54.008 INFO:teuthology.orchestra.run.trial068.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30123.log.gz 2026-02-18T21:02:54.008 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32314.log 2026-02-18T21:02:54.008 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.29855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38285.log 2026-02-18T21:02:54.008 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.32314.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29855.log.gz 2026-02-18T21:02:54.008 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36386.log 2026-02-18T21:02:54.008 INFO:teuthology.orchestra.run.trial068.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32314.log.gz 2026-02-18T21:02:54.008 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.38285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32241.log 2026-02-18T21:02:54.008 INFO:teuthology.orchestra.run.trial068.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.38285.log.gz 2026-02-18T21:02:54.008 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.36386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36942.log 2026-02-18T21:02:54.008 INFO:teuthology.orchestra.run.trial068.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36386.log.gz 2026-02-18T21:02:54.008 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.32241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29593.log 2026-02-18T21:02:54.008 INFO:teuthology.orchestra.run.trial068.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32241.log.gz 2026-02-18T21:02:54.008 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.36942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37335.log 2026-02-18T21:02:54.008 INFO:teuthology.orchestra.run.trial068.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36942.log.gz 2026-02-18T21:02:54.008 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.29593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32535.log 2026-02-18T21:02:54.008 INFO:teuthology.orchestra.run.trial068.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29593.log.gz 2026-02-18T21:02:54.008 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.37335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32437.log 2026-02-18T21:02:54.008 INFO:teuthology.orchestra.run.trial068.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37335.log.gz 2026-02-18T21:02:54.009 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.32535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29420.log 2026-02-18T21:02:54.009 INFO:teuthology.orchestra.run.trial068.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32535.log.gz 2026-02-18T21:02:54.009 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.32437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37697.log 2026-02-18T21:02:54.009 INFO:teuthology.orchestra.run.trial068.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32437.log.gz 2026-02-18T21:02:54.009 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.29420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29931.log 2026-02-18T21:02:54.009 INFO:teuthology.orchestra.run.trial068.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29420.log.gz 2026-02-18T21:02:54.009 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.37697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28910.log 2026-02-18T21:02:54.009 INFO:teuthology.orchestra.run.trial068.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37697.log.gz 2026-02-18T21:02:54.009 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.29931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29422.log 2026-02-18T21:02:54.009 INFO:teuthology.orchestra.run.trial068.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29931.log.gz 2026-02-18T21:02:54.009 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.28910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38432.log 2026-02-18T21:02:54.009 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.29422.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28910.log.gz 2026-02-18T21:02:54.009 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31415.log 2026-02-18T21:02:54.009 INFO:teuthology.orchestra.run.trial068.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.29422.log.gz 2026-02-18T21:02:54.009 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.38432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29761.log 2026-02-18T21:02:54.009 INFO:teuthology.orchestra.run.trial068.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38432.log.gz 2026-02-18T21:02:54.009 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.31415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36943.log 2026-02-18T21:02:54.009 INFO:teuthology.orchestra.run.trial068.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31415.log.gz 2026-02-18T21:02:54.009 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.29761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36480.log 2026-02-18T21:02:54.010 INFO:teuthology.orchestra.run.trial068.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29761.log.gz 2026-02-18T21:02:54.010 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.36943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24888.log 2026-02-18T21:02:54.010 INFO:teuthology.orchestra.run.trial068.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36943.log.gz 2026-02-18T21:02:54.010 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.36480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37561.log 2026-02-18T21:02:54.010 INFO:teuthology.orchestra.run.trial068.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36480.log.gz 2026-02-18T21:02:54.010 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.24888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32717.log 2026-02-18T21:02:54.010 INFO:teuthology.orchestra.run.trial068.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.24888.log.gz 2026-02-18T21:02:54.010 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.37561.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-18T21:02:54.010 INFO:teuthology.orchestra.run.trial068.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37561.log.gz 2026-02-18T21:02:54.010 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.32717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32822.log 2026-02-18T21:02:54.010 INFO:teuthology.orchestra.run.trial068.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32717.log.gz 2026-02-18T21:02:54.010 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-mgr.x.log: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-18T21:02:54.010 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31740.log 2026-02-18T21:02:54.010 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.32822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38334.log 2026-02-18T21:02:54.010 INFO:teuthology.orchestra.run.trial068.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32822.log.gz 2026-02-18T21:02:54.010 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.31740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31990.log 2026-02-18T21:02:54.010 INFO:teuthology.orchestra.run.trial068.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31740.log.gz 2026-02-18T21:02:54.010 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.38334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37746.log 2026-02-18T21:02:54.010 INFO:teuthology.orchestra.run.trial068.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38334.log.gz 2026-02-18T21:02:54.011 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.31990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37795.log 2026-02-18T21:02:54.011 INFO:teuthology.orchestra.run.trial068.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31990.log.gz 2026-02-18T21:02:54.011 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.37746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36766.log 2026-02-18T21:02:54.011 INFO:teuthology.orchestra.run.trial068.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37746.log.gz 2026-02-18T21:02:54.011 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.37795.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-18T21:02:54.011 INFO:teuthology.orchestra.run.trial068.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37795.log.gz 2026-02-18T21:02:54.011 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.36766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37505.log 2026-02-18T21:02:54.011 INFO:teuthology.orchestra.run.trial068.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36766.log.gz 2026-02-18T21:02:54.011 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24935.log 2026-02-18T21:02:54.011 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.37505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37337.log 2026-02-18T21:02:54.011 INFO:teuthology.orchestra.run.trial068.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37505.log.gz 2026-02-18T21:02:54.011 INFO:teuthology.orchestra.run.trial068.stderr: 93.5% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-18T21:02:54.011 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.24935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36111.log 2026-02-18T21:02:54.011 INFO:teuthology.orchestra.run.trial068.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.24935.log.gz 2026-02-18T21:02:54.011 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.37337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29762.log 2026-02-18T21:02:54.011 INFO:teuthology.orchestra.run.trial068.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37337.log.gz 2026-02-18T21:02:54.011 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.36111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36815.log 2026-02-18T21:02:54.011 INFO:teuthology.orchestra.run.trial068.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36111.log.gz 2026-02-18T21:02:54.011 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.29762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36944.log 2026-02-18T21:02:54.011 INFO:teuthology.orchestra.run.trial068.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.29762.log.gz 2026-02-18T21:02:54.012 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.36815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32486.log 2026-02-18T21:02:54.012 INFO:teuthology.orchestra.run.trial068.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36815.log.gz 2026-02-18T21:02:54.012 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.36944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29852.log 2026-02-18T21:02:54.012 INFO:teuthology.orchestra.run.trial068.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36944.log.gz 2026-02-18T21:02:54.012 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.32486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31541.log 2026-02-18T21:02:54.012 INFO:teuthology.orchestra.run.trial068.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32486.log.gz 2026-02-18T21:02:54.012 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.29852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38089.log 2026-02-18T21:02:54.012 INFO:teuthology.orchestra.run.trial068.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29852.log.gz 2026-02-18T21:02:54.012 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.31541.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31541.log.gz 2026-02-18T21:02:54.012 INFO:teuthology.orchestra.run.trial068.stderr:/var/log/ceph/ceph-client.admin.38089.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.38089.log.gz 2026-02-18T21:02:54.012 INFO:teuthology.orchestra.run.trial068.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-18T21:02:54.012 INFO:teuthology.orchestra.run.trial068.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-18T21:02:54.013 INFO:teuthology.orchestra.run.trial068.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-18T21:02:54.013 INFO:teuthology.orchestra.run.trial068.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-18T21:02:54.019 INFO:teuthology.orchestra.run.trial068.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-18T21:02:54.020 INFO:teuthology.orchestra.run.trial068.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-18T21:02:54.021 INFO:teuthology.orchestra.run.trial068.stderr: 2026-02-18T21:02:54.021 INFO:teuthology.orchestra.run.trial068.stderr:real 0m0.068s 2026-02-18T21:02:54.021 INFO:teuthology.orchestra.run.trial068.stderr:user 0m0.286s 2026-02-18T21:02:54.021 INFO:teuthology.orchestra.run.trial068.stderr:sys 0m0.070s 2026-02-18T21:02:54.022 INFO:tasks.ceph:Archiving logs... 2026-02-18T21:02:54.023 DEBUG:teuthology.misc:Transferring archived files from trial068:/var/log/ceph to /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:34:58-fs-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53280/remote/trial068/log 2026-02-18T21:02:54.024 DEBUG:teuthology.orchestra.run.trial068:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-18T21:02:54.247 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-18T21:02:54.273 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-18T21:02:54.273 DEBUG:teuthology.orchestra.run.trial068:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-18T21:02:54.395 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-18T21:02:54.407 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-18T21:02:54.407 DEBUG:teuthology.orchestra.run.trial068:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-18T21:02:54.424 INFO:teuthology.orchestra.run.trial068.stderr:bash: line 1: ntpq: command not found 2026-02-18T21:02:54.441 INFO:teuthology.orchestra.run.trial068.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-18T21:02:54.441 INFO:teuthology.orchestra.run.trial068.stdout:=============================================================================== 2026-02-18T21:02:54.441 INFO:teuthology.orchestra.run.trial068.stdout:^- 172-234-37-140.ip.linode> 2 6 177 0 +16ms[ +16ms] +/- 95ms 2026-02-18T21:02:54.441 INFO:teuthology.orchestra.run.trial068.stdout:^+ ntpool0.603.newcontinuum> 2 6 77 63 -146us[ -146us] +/- 40ms 2026-02-18T21:02:54.441 INFO:teuthology.orchestra.run.trial068.stdout:^- 170-187-147-56.ip.linode> 2 6 177 0 -5447us[-5447us] +/- 82ms 2026-02-18T21:02:54.441 INFO:teuthology.orchestra.run.trial068.stdout:^* as393746.mci.trtnw.net 2 6 77 63 +225us[-2232us] +/- 23ms 2026-02-18T21:02:54.442 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-18T21:02:54.453 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-18T21:02:54.453 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-18T21:02:54.468 DEBUG:teuthology.orchestra.run.trial068:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-18T21:02:54.526 DEBUG:teuthology.orchestra.run.trial068:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-18T21:02:54.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T21:02:54.552 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-18T21:02:54.571 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-18T21:02:54.590 INFO:teuthology.task.internal:Duration was 266.500736 seconds 2026-02-18T21:02:54.591 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-18T21:02:54.612 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-18T21:02:54.612 DEBUG:teuthology.orchestra.run.trial068:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-18T21:02:54.651 INFO:teuthology.orchestra.run.trial068.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-18T21:02:55.006 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-18T21:02:55.006 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial068.front.sepia.ceph.com 2026-02-18T21:02:55.006 DEBUG:teuthology.orchestra.run.trial068:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-18T21:02:55.065 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-18T21:02:55.065 DEBUG:teuthology.orchestra.run.trial068:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T21:02:55.148 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-18T21:02:55.149 DEBUG:teuthology.orchestra.run.trial068:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-18T21:02:55.211 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-18T21:02:55.211 INFO:teuthology.orchestra.run.trial068.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-18T21:02:55.211 INFO:teuthology.orchestra.run.trial068.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-18T21:02:55.211 INFO:teuthology.orchestra.run.trial068.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-18T21:02:55.212 INFO:teuthology.orchestra.run.trial068.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-18T21:02:55.216 INFO:teuthology.orchestra.run.trial068.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 87.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-18T21:02:55.218 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-18T21:02:55.238 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-18T21:02:55.238 DEBUG:teuthology.orchestra.run.trial068:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-18T21:02:55.283 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-18T21:02:55.302 DEBUG:teuthology.orchestra.run.trial068:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-18T21:02:55.347 INFO:teuthology.orchestra.run.trial068.stdout:kernel.core_pattern = core 2026-02-18T21:02:55.364 DEBUG:teuthology.orchestra.run.trial068:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-18T21:02:55.418 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-18T21:02:55.419 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-18T21:02:55.440 INFO:teuthology.task.internal:Transferring archived files... 2026-02-18T21:02:55.441 DEBUG:teuthology.misc:Transferring archived files from trial068:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:34:58-fs-wip-jcollin-testing-20260217.080557-squid-distro-default-trial/53280/remote/trial068 2026-02-18T21:02:55.441 DEBUG:teuthology.orchestra.run.trial068:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-18T21:02:55.492 INFO:teuthology.task.internal:Removing archive directory... 2026-02-18T21:02:55.493 DEBUG:teuthology.orchestra.run.trial068:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-18T21:02:55.541 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-18T21:02:55.562 INFO:teuthology.task.internal:Not uploading archives. 2026-02-18T21:02:55.562 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-18T21:02:55.581 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-18T21:02:55.581 DEBUG:teuthology.orchestra.run.trial068:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-18T21:02:55.598 INFO:teuthology.orchestra.run.trial068.stdout: 917576 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 18 21:02 /home/ubuntu/cephtest 2026-02-18T21:02:55.599 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-18T21:02:55.619 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-18T21:02:55.661 INFO:teuthology.run:Summary data: description: fs/upgrade/nofs/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} kernel no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn pg_health} tasks/{0-from/quincy 1-upgrade}} duration: 266.5007357597351 flavor: default owner: scheduled_jcollin@soko04.front.sepia.ceph.com success: true 2026-02-18T21:02:55.662 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-18T21:02:55.779 INFO:teuthology.run:pass